CI for wayland (buildbot).

Sat Jan 4 05:14:43 PST 2014

Hi, everyone, Happy New Year!!! :-)

Eventually I have some stuff working.

*What is already there?*

1) Users support.

Anyone can request either a piece of my resources (user gets a unix user
and a buildbot slave on my machine which share) or u may want to use your
hardware in this case you will need to install buildbot-slave which comes
as a package on most linux distributions (u will also need configure it to
connect to my buildmaster).

2) Schedulers.

You can run your builders (no matter how this sounds :) manually,
periodically or after code change in the repo.

3) Builders.

Builder is a set of steps you want to take. A step is basically any script
(command) understood by bash (based on return code buildmaster marks step
successful or failed).

*What's not there yet?*

1) UI for interactive setup (user creation, builders creation and
everything related).

It's in progress. I want to use google api based authentication.

2) Pretty build status email format (emails generated by default are pretty
ugly and informationless).

I will try to update how emails look today.

3) Looks like I'll need to move to external hosting due to the fact that my
pc is online only when I'm at work.

-----------

I'm writing this to get a feedback on what's the most valuable features
that community would appreciate. For example: should I create a builder for
a full wayland+weston build with tests being run and run it once a day
emailing the status to wayland-devel?

If you want to test the stuff you are very welcome (contact me for details
or I can write to everyone what I need to make you able to run your
stuff). *Also
I'm wondering why I see these errors (oh looks like there is a couple of
new: socket-test and queue-test) especially resources-test:*

*http://buildbot.zorg.by/builders/pure_wayland/builds/32/steps/run-make-check/logs/stdio*<http://buildbot.zorg.by/builders/pure_wayland/builds/32/steps/run-make-check/logs/stdio>

Thanks and have a good year again!

On Mon, Nov 11, 2013 at 10:19 PM, Eoff, Ullysses A <
ullysses.a.eoff at intel.com> wrote:

>  Hopefully I didn’t come across as trying to discourage you or anyone
> else from contributing in this realm.
>
>
>
> I think it’s great you’re exploring this for Wayland!  I look forward to
> seeing your solution come together and think it’ll be very useful ;-).
>
>
>
> Regards!
>
>
>
> ----
>
> U. Artie
>
>
>
> *From:* Artsiom Anikeyenka [mailto:arty.anikey at gmail.com]
> *Sent:* Monday, November 11, 2013 9:55 AM
> *To:* Eoff, Ullysses A
> *Cc:* wayland-devel at lists.freedesktop.org
> *Subject:* Re: CI for wayland (buildbot).
>
>
>
> Ok, cool then I'll just be working on that letting everyone know about the
> status (just for fun at least). Regarding your concerns:
>
>
>
> 1) Time and effort - people will be joining, I'm sure. In the beginning I
> can handle it. I'll deal with ISP and later on we will be moving of course
> to some of "official" wayland servers.
>
> 2) Contributing slaves is not that hard and not neccessary requires direct
> access to the server (master). In the beginning we can just make it an
> email-request-based (with slave installation script) and later on we can
> create our own UI for configuring buildbot which is possible as buildbot
> config is just a python program (authorized users will be able to add slave
> support on the master themselves).
>
> 3) Buildbot UI (which is improving, I believe I've seen some plans on
> creating real cool one on buildbot side) will be used in the beginning only
> (and maybe not).
>
>
>
> Thanks!
>
>
>
> On Mon, Nov 11, 2013 at 8:15 PM, Eoff, Ullysses A <
> ullysses.a.eoff at intel.com> wrote:
>
> Currently, there is no “official” continuous integration (CI) tool for the
> Wayland community.  However, there are several people and organizations
> that run Wayland CI on their own, each tailored to their specific tools,
> needs and environment.
>
>
>
> If you want to provide a CI service to any community, then I think there
> is quite a bit to consider.  First of all, it will be time consuming to
> manage… especially up front.  Also, you would likely need a reasonable
> infrastructure (i.e. hardware and network) for the “master” service.  Are
> you ready to devote time and support for that?  How would your current ISP
> respond to running a “home” server like this?
>
>
>
> Next, a Wayland software stack can be tailored for all sorts of
> environments and platforms, leading to a “lot” of different
> software/hardware build variants.  IMHO, an “official” Wayland CI solution
> would probably need to cover all those variants to be generally useful to
> the entire Wayland community.  And to support that, you’d likely want
> contributors to be able to easily “plug” their own slave variant(s) into
> the service.  IIRC, setting up a Buildbot slave network requires some sort
> of direct access and privileges to the “master” server (to change the
> config scripts, restart the service, etc.).
>
>
>
> I’m a strong supporter of CI and have used several tools like Buildbot,
> Jenkins, QuickBuild, and even custom solutions.  Each one has their own
> strengths and weaknesses.  I personally find that the Buildbot web UI is
> clunky and unpleasant to look at and master/slave configurations can be
> high maintenance (although I do love Python ;-).  In that regard, I feel
> that Buildbot is more like a “framework” for developing a CI tool… not a
> “out-of-the-box” CI tool in itself.
>
>
>
> Currently, my “Test Team” has been employing QuickBuild internally (using
> free OSS license) to run Wayland CI for several years now and we’ve been
> quite happy with it.  I’ve thought about exposing this service to the
> community too but, of course, it would be costly and time consuming.
>
>
>
> ----
>
> U. Artie Eoff
>
> Intel Open Source Technology Center
>
>
>
> *From:* wayland-devel-bounces at lists.freedesktop.org [mailto:
> wayland-devel-bounces at lists.freedesktop.org] *On Behalf Of *Artsiom
> Anikeyenka
> *Sent:* Monday, November 11, 2013 5:26 AM
> *To:* wayland-devel at lists.freedesktop.org
> *Subject:* CI for wayland (buildbot).
>
>
>
> Hi, guys,
>
>
>
> Do you have any of those running (I mean CI tools) (I didn't find any
> links)? If not then I can setup a buildbot <http://buildbot.net/>.
> Actually it's already runnig on my home machine. You can access it here<http://zorg.by:8010/builders/runtests/builds/10>
> .
>
>
>
> This build indicates 1 failing test for "make check" in wayland project.
> I've just started and currently I'm working on setting up CI for the whole
> process of building as described here<http://wayland.freedesktop.org/building.html>
> .
>
>
>
> Later on we can change the way buildbot builds stuff, and add more slaves
> (different platforms) which can be distributed over the internet. I chose
> buildbot because it's super flexible.
>
>
>
> If you agree then I'll follow up with the "next-steps-email". BTW I'll be
> setting it up anyways :) to understand how wayland is built, so I just
> wanted to know if you want buildbot as the "official" CI tool for wayland
> (BTW I highly recommend it over the other tools like Jenkins or CC).
>
>
>
> Any thoughts, feedback?
>
>
>
> Cheers!
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freedesktop.org/archives/wayland-devel/attachments/20140104/2dbf4d34/attachment-0001.html>