[yocto] QA Test Report for Yocto Project Release 2.3 rc4

[Perez Carranza, Jose]

Hello All,



Here is the report for the Full QA Cycle on Release 2.3 M3 rc4



Full Report : https://wiki.yoctoproject.org/wiki/WW19_-_2017-05-02_-_Full_Test_Cycle_2.3_rc4



======== Summary ========





The QA cycle for release 2.3 rc2 is complete, There is 1 new bug found related to eSDK toolchain, this is not a blocker issues. Bug 11409 found during rc2 that was blocking Eclipse was already verified and is working correctly. Performance measurements were very similar to the ones for rc2. In pTest numbers were almost the same as in rc2 with a slight improvement on "tlc" module.





=========================





======== Details ========



QA Hints



There was only one new bug found 11471, initially this was blocking some of the eSDK / CROPS testing but with a simple workout (already described on bug history) test were executed correctly, hence this doesn't represent a blocker for QA cycle. In general this release locks good form QA perspective only adding the workaround to the release notes for bug 11471 should be necessary and have the fix ready for a point release cycle.





Bugs

      * New



           - 11471 - eSDK toolchain cannot install using i586 extensible-toolchain [1]





      * High / M+ Not New



           - 10477 - yocto-bsp: tool should output a conf file to be consume by the qemu runner [2]

           - 11431 - Crops-ESDK: devtool is unable to add recipe for nodejs-native recipe [3]



Full Bug Report : https://wiki.yoctoproject.org/wiki/WW19_-_2017-05-02_-_Full_Test_Cycle_2.3_rc4#Bugs_Found_during_QA_Test



=========================





====== Performance ======



Measurements were practically the same as in rc2, no noticeable deviations were detected from the execution of the test on rc4.



-        Ubuntu



            Test     2.3 rc2    2.3 rc4    %

            sato     1:12:54    1:12:18    -0.82

            rootfs   2:17       2:16       -0.73

            rmwork   1:05:33    1:06:17    1.12

            kernel   5:14       5:13       -0.32

            eSDK     2:44       2:44       0.00





-        Fedora



           Test     2.3 rc2    2.3 rc4    %

            sato     1:12:49    1:12:42    -0.16

            rootfs   2:34       2:29       -3.25

            rmwork   1:06:45    1:06:24    -0.52

            kernel   5:56       5:58       0.56

            eSDK     3:02       3:01       -0.55





Performance Charts :  https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html



========================





========= pTest ========



    -  There was an slight improvement on PASS rate for the "tcl" module, the rest of the numbers were the same as in rc2





pTest full report : https://wiki.yoctoproject.org/wiki/WW19_-_2017-05-02_-_Full_Test_Cycle_2.3_rc4#pTest_for_genericx86-64_on_NUC



========================





======== Links =========

1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11471

2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11477

3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11431

========================

Regards
José

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20170508/99c05c1a/attachment.html>