[yocto] QA Test Report for Yocto Project 2.2 rc6

[Perez Carranza, Jose]

Hi

Here is the report for Partial QA Cycle on 2.2 rc6

Full Report :  https://wiki.yoctoproject.org/wiki/WW44_-_2016-10-26_-_Full_Test_Cycle_2.2_rc6

Summary

Only a subset of components related to kernel and build appliance were tested on this cycle.  We found  3 new bugs found, 1 introduced after build appliance fix , another one for qemu and one more for parselogs, in general the fix for "Dirty COW" seems not affecting the functionality validated on components related to the kernel. Performance shows a little improvements on measurements for  "core-image-sato" and "rm-work" . pTest results were exactly the same of previous test cycle for 2.2 rc4. Regarding to bug 10447 [1] test were applied on "morty" and "master" branches and the error still appears so the bug was reopened.

Bugs

           *New bugs found

-        10514           test_parselogs on genericx86-lsb minnow board max 32 FAILED LOGIN (1) on '/dev/tty1' FOR 'UNKNOWN', Authentication failure [2]

-        10504           [Build Appliance] The default user builder can not login [3]

-        10519           Can not run multiple QEMU machines under UNFS [4]

           *Not New High and M+
-      10456           X can not launch on qemumips64 [5]
-      10434           runqemu can not launch qemu image in Build Appliance [6]
-      10447           eSDK: runqemu fails unless unless DEPLOY_DIR_IMAGE is set [7]
-      10477           yocto-bsp: tool should output a conf file to be consume by the qemu runner [8]

            *Not New Medium Low
-     10494            [Test Case 1059] Parselogs is failing on genericx86-64-WIC on NUC giving error: Failed to load DMC firmware [9]
                              -     10455            [Test Case 1059] Parselogs is failing on genericx86 (32 and 64 bits) giving error: blk_update_request: I/O error, dev loop0 [10]
-     10481            [Test Case 1059] Parselogs is failing on genericx86 (32 and 64 bits) WIC giving error: GPT: Use GNU Parted to correct GPT errors. [11]
-     10025            Missing 'Connection Manager' icon for qemumips and qemumips64 [12]
Performance


-        Core-image-sato has an improvement of around 6% (2 minutes) on Ubuntu machine, Fedora remains on the average ranges

-        rm-work has an improvement of around 5% (1 minute) on both Ubuntu and Fedora

-        Full performance charts [13]

Links

1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10447
2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10514
3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10504
4. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10519
5. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10456
6. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10434
7. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10447
8. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10477
9. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10494
10. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10455
11. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10481
12. https://bugzilla.yoctoproject.org/show_bug.cgi?id=10025
13. https://wiki.yoctoproject.org/wiki/WW44_-_2016-10-26_-_Full_Test_Cycle_2.2_rc6#Build_Performance_Test


Regards,
José

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20161028/c57e6678/attachment.html>