[yocto] Yocto 1.5.2.rc3 Full Pass QA Report
Georgescu, Alexandru C
alexandru.c.georgescu at intel.com
Fri May 9 06:07:20 PDT 2014
Hello,
Here is the full pass report for 1.5.2.rc3 release.The QA report summary, testing data and issue summary are available below, and the full pass report is available on https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3 wiki.
Issue summary:
* There were no release blocker issues found in this release. We have found:
* 6269 - gtk 2.24.20 fails at do_compile on Ubuntu 13.10 which have been addressed.
* 6264 - repository 'http://git.pingu.fi/xf86-video-omapfb/' not found which was fixed
* 6301 - nightly-world build hangs on AB machine having OpenSuse 13.1
Testing data
Test type: Full Pass Release
Branch: Dora
Build name: 1.5.2 rc3
poky commit: b626e109e83384558f45dc2e30e7caec677ce1db
Eclipse Plugin commit Kepler: e842d41f05066df1533a2788e650f0be213ad5b5
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.5.2.rc3/
Distributions tested: Ubuntu 14.04 64bit, Ubuntu 13.10 64bit, Fedora 19 64bit, Fedora 20 32bit, OpenSuse 13.1 64bit, CentOS 6.5 64bit, Debian 7 64bit
Summary Report
Testing Summary Report
Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete
2318<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2318>2320<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2320> ADT: dora branch Fedora 20 i686 100.0% none 0.0% none 0.0% none 100.0%
1751<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1751>1753<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1753> ADT: dora branch Ubuntu 13.10 x86_64 100.0% none 0.0% none 0.0% none 100.0%
2321<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2321>2322<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2322> BSP/QEMU: dora branch Beagleboard 71.0% none 4.3% 5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936> 24.6% 5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182> 100.0%
2297<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2297>2300<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2300> BSP/QEMU: dora branch generic-x86 on AtomPC 97.1% none 2.9% 4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834> 0.0% none 100.0%
2303<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2303>2307<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2307> BSP/QEMU: dora branch genericx86-64 on Sugarbay 98.6% none 1.4% 5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834> 0.0% none 100.0%
2327<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2327>2328<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2328> BSP/QEMU: dora branch MPC8315e-rdb 100.0% none 0.0% none 0.0% none 100.0%
2323<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2323>2324<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2324> BSP/QEMU: dora branch P1022ds 100.0% none 0.0% none 0.0% none 100.0%
2339<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2339>2340<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2340> BSP/QEMU: dora branch qemu-x86 100.0% none 0.0% none 0.0% none 100.0%
2311<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2311>2312<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2312> BSP/QEMU: dora branch qemuarm 100.0% none 0.0% none 0.0% none 100.0%
2315<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2315>2316<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2316> BSP/QEMU: dora branch qemumips 100.0% none 0.0% none 0.0% none 100.0%
2313<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2313>2314<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2314> BSP/QEMU: dora branch qemuppc 100.0% none 0.0% none 0.0% none 100.0%
2336<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2336>2337<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2337> BSP/QEMU: dora branch qemux86-64 100.0% none 0.0% none 0.0% none 100.0%
2325<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2325>2326<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2326> BSP/QEMU: dora branch Routerstationpro 100.0% none 0.0% none 0.0% none 100.0%
2301<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2301>2302<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2302>2304<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2304>2305<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2305>2306<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2306>2332<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2332> Eclipse plugin: Dora branch Ubuntu 13.10 x86_64 100.0% 5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163> 0.0% none 0.0% none 100.0%
2329<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2329>2330<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2330> Meta-yocto: dora branch Ubuntu 13.10 x86-64 100.0% none 0.0% none 0.0% none 100.0%
2309<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2309>2310<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2310> Hob: dora branch Ubuntu 14.04 x86_64 97.8% none 2.2% 5892<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5892> 0.0% none 100.0%
2298<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2298>2299<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2299> OE-Core: dora branch Multiple environments 100.0% none 0.0% none 0.0% none 100.0%
2333<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2333>2334<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2334> Bitbake: dora branch Ubuntu 13.10 x86_64 100.0% none 0.0% none 0.0% none 100.0%
2335<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2335> Runtime: dora branch Multiple Environments 100.0% none 0.0% none 0.0% none 100.0%
2331<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2331> Build Appliance: dora branch qemu-kvm on Ubuntu 12.04 libvirt 100.0% none 0.0% none 0.0% none 100.0%
Total: 20
Test Case Status Report
Status Count
BLOCKED 17
FAILED 7
PASSED 1015
Total: 1039
[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:17,7,1015&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(17)+2%|FAILED(7)+1%|PASSED(1015)+98%]
Bug Status Report
[Bug Status]
ID[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Priority[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Status[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Resolution[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Description[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Version[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#> Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3#>
3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936> Medium ACCEPTED 2321<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2321> [beagleboard xM] Some error message with usbhs_omap in dmesg 1.4 1.6 426
4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005> Low NEW 2297<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2297> dmesg log errors in Atom-PC 1.3.1 1.7 413
5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163> Medium ACCEPTED 2305<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2305>2301<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2301> no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2) 1.5 1.7 229
5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182> Medium+ RESOLVED WONTFIX 2322<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2322>2321<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2321> [Beagleboard xM]X can not startup with 3.10 kernel 1.5 1.5.1 227
5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760> Low NEW 2305<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2305>2301<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2301> headless build takes took long 1.6 1.6 91
5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834> Medium NEW 2300<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2300>2307<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2307> Cannot wake from suspend state using the USB mouse or keyboard 1.6 1.6 70
5892<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5892> Medium RESOLVED FIXED 2310<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2310> Deploy image does not always write correctly to USB 1.6 1.6 M4 60
Total: 7
Distro testing
Here are the distro testing results for 1.5.2.rc3 release. The distribution hosts used are Fedora 20, OpenSuse 13.1, CentOS 6.5 and Ubuntu 13.10. We have also performed manual distro tests on Ubuntu 14.04.
BRANCH sgw/dora-next dora
COMMIT 9b7d43963f54d25e087a4cc55623a4cfeac121a9 6a92f7ede3be3edd58d7819aa611b0c5270756bf
RELEASE 1.5.2 RC3 1.5.2 RC3
Fedora 20
• nighlty-world FAILED - 6264 PASS
• buildtools PASS
• nightly-arm FAILED - 6264 PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
OpenSuSE 13.1
• nighlty-world FAILED - 6301
• buildtools PASS
• nightly-arm FAILED - 6264 PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
Ubuntu 13.10
• nighlty-world FAILED - 6269 FAILED - 6269
• buildtools PASS
• nightly-arm FAILED - 6264 PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
CentOS 6.5
• nighlty-world PASS
• buildtools PASS
• nightly-arm FAILED - 6264 PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
Performance test
The build performance test data is available on the 1.5.2 performance_test wiki. The below charts reflects the data tables in the wiki which shows an overall similar build performance, even though there are slight degradations observed from the trend.
Trend for building core-image-sato (rm_work):
[cid:4B90558F-BECA-451C-B0DC-B54C15229FDA]
The trend for building the virtual/kernel:
[cid:84F90239-A3D0-42FC-B796-17FD36C8462C]
The trend for building the rootfs:
[cid:675CDE5B-A905-4DF6-AA78-79E336C76534]
Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 4B90558F-BECA-451C-B0DC-B54C15229FDA.png
Type: image/png
Size: 91404 bytes
Desc: 4B90558F-BECA-451C-B0DC-B54C15229FDA.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140509/f05dfc20/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 84F90239-A3D0-42FC-B796-17FD36C8462C.png
Type: image/png
Size: 67739 bytes
Desc: 84F90239-A3D0-42FC-B796-17FD36C8462C.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140509/f05dfc20/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 675CDE5B-A905-4DF6-AA78-79E336C76534.png
Type: image/png
Size: 47309 bytes
Desc: 675CDE5B-A905-4DF6-AA78-79E336C76534.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140509/f05dfc20/attachment-0002.png>
More information about the yocto
mailing list