[Automated-testing] Some LAVA updates

[Otavio Salvador]

On Wed, May 21, 2014 at 7:12 PM, Alan Bennett <alan.bennett at linaro.org> wrote:
> Hello;
>   Just wanted to provide and update and ask what happened to the
> auto-builder artifacts.
>
> As we continue to review the use of LAVA for OE, we figured the best way
> would be to determine value first.  Tyler enabled KVM testing for all the OE
> builds across a good start of platforms.  We were able to burn through the
> 25 builds in roughly 33 minutes (which includes image file transfer time).
> Adding more instances, it looks like we could hit ~ 8 minutes for boot
> testing across the 25 variations, which starts to get interesting.
>   Current Platforms: [Beaglebone Black, qemu-arm, qemu-mips, qemu-x86,
> qemu-x86_64]
>   Current Builds: [minimal, minimal-dev, sato, sato-dev, sato-sdk].

We are working in setup an instance of LAVA at O.S. Systems and we're
doing it in the distributed way (server and control client in
separated machines) so we can scale easily.

Lucas, the guy working on this, been getting further but we couldn't
yet get KVM to work out. I think we'll ping Tyler tomorrow to see if
he can help us.

> We are able to run the ptests that are installed by default in the sato-sdk
> builds, but are still working (borrowed time) on creating a sensible results
> parser for the different flavors of ptest results.  Once I get something
> that is a bit cleaner, the data can be store and trended in the LAVA
> interface each time we boot test the sato-sdk build.  For now, you can see
> the OE boot image report[2].

Great! This will be very helpful and will give it a huge boost in usefulness :)

> However, all good things must come to an end and it seems that the builds
> have disappeared[1] or we no longer have access.  So the question is, where
> did they go?

There were an Auto Builder issue, which affects the artifacts. Beth
(here in Cc) is working (or has fixed) on it.

It should be working fine soon...

-- 
Otavio Salvador                             O.S. Systems
http://www.ossystems.com.br        http://code.ossystems.com.br
Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750