[yocto] Yocto Full Pass QA Report - 1.5.1 build - WW50

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Fri Dec 20 01:24:22 PST 2013


Hello,
Here is the Full pass QA report for Yocto 1.5.1 rc2 build.
Issue summary:

-          5679<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5679> - meta-intel: core-image-sato-sdk builds are failing due to "deadlock in the timekeeping subsystem" error

-          5672<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5672> - yocto-bsp error on 3.10 kernel - dora

-          5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473> - [KEPLER] unable to create new bitbake commander project

-          5403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5403> - crosstap doesn't work on qemuppc and qemumips

-          5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182> - [Beagleboard xM]X can not startup with 3.10 kernel

As seen below as well, no critical issues have been found. The full pass report is available: https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2

Testing data

 Test type: Full Pass Release

 Branch: Dora

 Build name: 1.5.1 rc2

 poky commit: 8e410e9e46e3335458a7747cdd32e05f5c19ccbb

 Eclipse Plugin commit Kepler:  ad74249895f882a8f00bdeef7a0f7c18998cc43e

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/dora-10.0.1.rc2/

 Distributions tested: Ubuntu 12.10 64bit, Ubuntu 13.10 64bit, Fedora 19 64bit, Fedora 19 32bit, Fedora 18 64bit, OpenSuse 12.3 64bit, CentOS 6.5 64bit,  Debian 7 64bit



Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

1752<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1752> 1754<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1754>

ADT: dora branch

Fedora 19 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

1751<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1751> 1753<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1753>

ADT: dora branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1740<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1740> 1741<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1741>

BSP/QEMU: dora branch

Beagleboard

71.0%

none

4.3%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182> 3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

24.6%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

100.0%

1716<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1716> 1717<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1717>

BSP/QEMU: dora branch

generic-x86 on AtomPC

98.6%

none

1.4%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

0.0%

none

100.0%

1714<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1714> 1715<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1715>

BSP/QEMU: dora branch

genericx86-64 on Sugarbay

100.0%

none

0.0%

none

0.0%

none

100.0%

1738<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1738> 1739<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1739>

BSP/QEMU: dora branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

1734<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1734> 1735<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1735>

BSP/QEMU: dora branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

1721<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1721> 1722<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1722>

BSP/QEMU: dora branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

1725<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1725> 1726<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1726>

BSP/QEMU: dora branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

1730<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1730> 1731<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1731>

BSP/QEMU: dora branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

1728<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1728> 1729<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1729>

BSP/QEMU: dora branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

1723<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1723> 1724<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1724>

BSP/QEMU: dora branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

1736<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1736> 1737<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1737>

BSP/QEMU: dora branch

Routerstationpro

100.0%

none

0.0%

none

0.0%

none

100.0%

1747<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1747> 1748<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1748> 1749<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1749> 1755<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1755> 1756<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1756>1757<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1757>

Eclipse plugin: Dora branch

Ubuntu 13.10 x86_64

87.5%

none

5.4%

5672<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5672> 5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>

7.1%

5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>

100.0%

1732<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1732> 1733<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1733>

Meta-yocto: dora branch

Ubuntu 13.10 x86-64

96.0%

none

4.0%

5403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5403>

0.0%

none

100.0%

1742<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1742> 1744<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1744>

Hob: dora branch

Multiple environments

100.0%

none

0.0%

none

0.0%

none

100.0%

1712<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1712> 1713<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1713>

OE-Core: dora branch

Multiple environments

97.1%

none

2.9%

5669<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5669>

0.0%

none

100.0%

1743<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1743>

Bitbake: dora branch

Fedora 19 X86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1750<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1750>

Bitbake: dora branch

Ubuntu 13.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1761<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1761>

Runtime: dora branch

Multiple Environments

37.5%

none

12.5%

5679<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5679>

50.0%

5679<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5679>

100.0%

1727<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1727>

Build Appliance: dora branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 21



Test Case Status Report

Status

Count

BLOCKED

25

FAILED

10

PASSED

1007

Total: 1042


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:25,10,1007&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(25)+2%25|FAILED(10)+1%25|PASSED(1007)+97%25]



Bug Status Report

[Bug Status]

ID[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Priority[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Status[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Resolution[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Description[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Version[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW50_-_2013-12-13_-_Full_Pass_Release_Dora_1.5.1_rc2>

3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

Medium

NEW

1740<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1740>

[beagleboard xM] Some error message with usbhs_omap in dmesg

1.4

1.6

290

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

1716<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1716>

dmesg log errors in Atom-PC

1.3.1

1.5

277

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

Medium+

ACCEPTED

1741<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1741> 1740<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1740>

[Beagleboard xM]X can not startup with 3.10 kernel

1.5

1.5.1

91

5403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5403>

Medium+

ACCEPTED

1733<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1733>

crosstap doesn't work on qemuppc and qemumips

1.5

1.5.1

45

5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>

Medium

NEW

1749<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1749> 1748<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1748>

[KEPLER] unable to create new bitbake commander project

1.5

1.5.1

38

5669<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5669>

Medium

IN PROGRESS REVIEW

1712<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1712>

Check if the directfb image can be built - rootfs is missing in tmp/deploy/images/qemuarm

1.5.1

1.5.2

NEW

5672<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5672>

Medium+

RESOLVED

FIXED

1749<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1749> 1748<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1748>

yocto-bsp error on 3.10 kernel - dora

1.5.1

1.5.2

NEW

5679<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5679>

Medium+

ACCEPTED

1761<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1761>

meta-intel: core-image-sato-sdk builds are failing due to "deadlock in the timekeeping subsystem" error

1.5.1

1.5.1

NEW

Total: 8




Performance Test

There are no regressions comparing with the previous release. On the charts, there can be seen a slight increase in build time for the Kernel and Rootfs only on H1 (Ubuntu 12) but not present in H2 (Fedora 19). The data computed is available on 1.5 Performance Test wiki and the detailed charts are attached: https://wiki.yoctoproject.org/wiki/Performance_Test#1.5_Milestones_results

[cid:image004.png at 01CEFD74.5DB045B0]


Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131220/b7ea7142/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 85644 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131220/b7ea7142/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 10187 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131220/b7ea7142/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 9473 bytes
Desc: image002.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131220/b7ea7142/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 462 bytes
Desc: image003.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131220/b7ea7142/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Performance Comparison - Dora.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 45088 bytes
Desc: Performance Comparison - Dora.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131220/b7ea7142/attachment.xlsx>


More information about the yocto mailing list