[yocto] Yocto 1.6_M1.rc1 Full Pass test report

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Wed Dec 11 05:53:04 PST 2013


Hello,

Here is the full pass test report for 1.6_M1.rc1 build. We also have added to our weekly report the Toaster component. Below you can find the QA Runs summary report, also the Bug status report containing all the new and known bugs found in our testing for this build. The full report is available here: https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1. During this build there were no critical issues found.


Testing data

 Test type: Full Pass Release Test

 Branch: master

 Milestone: M1

 Build name: 1.6_M1.rc1

 poky commit: c51730aaa91066cfb51ad6ec2920fb4f9d9ea94c

 Eclipse Plugin commit Kepler:  3dd620d9f89e297ee9e22d5ba9fe741a5f40ac82

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/1.6_M1.rc1

 Distributions tested: Ubuntu 13.10 64bit, Fedora 19 64bit, Fedora 19 32bit, Fedora 19 64bit, Opensuse 12.3 64bit, CentOS 6.5 64 bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

1625<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1625> 1627<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1627>

ADT: master branch

Fedora 19 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

1626<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1626> 1628<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1628>

ADT: master branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1604<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1604> 1605<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1605>

BSP/QEMU: master branch

Beagleboard

71.0%

5651<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5651>

4.3%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182> 3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

24.6%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

100.0%

1569<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1569> 1573<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1573>

BSP/QEMU: master branch

generic-x86 on AtomPC

98.6%

none

1.4%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

0.0%

none

100.0%

1576<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1576> 1577<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1577>

BSP/QEMU: master branch

genericx86-64 on Sugarbay

100.0%

none

0.0%

none

0.0%

none

100.0%

1602<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1602> 1603<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1603>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

5651<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5651>

0.0%

none

0.0%

none

100.0%

1598<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1598> 1599<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1599>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

1587<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1587> 1588<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1588>

BSP/QEMU: master branch

qemu-x86

98.1%

none

1.9%

5637<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5637>

0.0%

none

100.0%

1623<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1623>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

1622<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1622> 1621<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1621> 1622<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1622>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

1619<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1619> 1620<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1620>

BSP/QEMU: master branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

1586<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1586> 1591<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1591>

BSP/QEMU: master branch

qemux86-64

98.1%

none

1.9%

5638<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5638>

0.0%

none

100.0%

1600<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1600> 1601<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1601>

BSP/QEMU: master branch

Routerstationpro

100.0%

none

0.0%

none

0.0%

none

100.0%

1568<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1568> 1570<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1570> 1571<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1571> 1572<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1572>1574<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1574> 1575<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1575>

Eclipse Plugin: master branch

Ubuntu 13.10 x86_64

83.9%

5630<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5630>

8.9%

5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285> 5634<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5634>5640<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5640> 5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>

7.1%

5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>

100.0%

1596<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1596> 1597<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1597>

Meta-yocto: master branch

Ubuntu 13.10 x86-64

92.3%

5636<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5636>

7.7%

5588<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5588> 5403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5403>

0.0%

none

100.0%

1585<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1585> 1594<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1594>

Hob: master branch

Multiple environments

89.1%

5632<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5632>

10.9%

5632<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5632> 5579<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5579>5609<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5609>

0.0%

none

100.0%

1567<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1567> 1578<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1578>

OE-Core: master branch

Multiple environments

97.2%

none

2.8%

5146<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5146>

0.0%

none

100.0%

1582<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1582> 1583<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1583>

BitBake: master branch

Fedora 19 X86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1581<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1581>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

1595<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1595>

Build Appliance: master branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 20



Test Case Status Report

Status

Count

BLOCKED

21

FAILED

19

PASSED

874

Total: 914


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:21,19,874&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(21)+2%25|FAILED(19)+2%25|PASSED(874)+96%25]



Bug Status Report

[Bug Status]

ID[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Priority[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Status[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Resolution[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Test Runs[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Description[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Version[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Target Milestone[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

Age (days)[↓]<https://wiki.yoctoproject.org/wiki/WW49_-_2013-12-03_-_Full_Pass_Release_1.6_M1.rc1>

3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

Medium

NEW

1604<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1604>

[beagleboard xM] Some error message with usbhs_omap in dmesg

1.4

1.6

280

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

1569<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1569>

dmesg log errors in Atom-PC

1.3.1

1.5

267

5146<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5146>

Medium

NEEDINFO

1567<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1567>

btrfs image build fails at do_rootfs

1.5

1.5.1

85

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

Medium+

ACCEPTED

1604<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1604> 1605<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1605>

[Beagleboard xM]X can not startup with 3.10 kernel

1.5

1.5.1

81

5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285>

Medium

NEW

1570<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1570> 1568<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1568>

powertop: Output is useless

unspecified

1.6

67

5403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5403>

Medium+

ACCEPTED

1597<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1597>

crosstap doesn't work on qemuppc and qemumips

1.5

1.5.1

35

5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>

Medium

NEW

1574<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1574> 1568<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1568>

unable to create new bitbake commander project

1.5

1.5.1

28

5579<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5579>

Medium

NEW

1585<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1585>

Recipes parsing stop.

1.6

1.6

12

5588<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5588>

Medium

NEW

1597<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1597>

pybootchartgui.py doesn't work with -o option

1.6

1.6

11

5609<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5609>

Medium

NEW

1594<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1594>

Hob error when hitting stop button during build

1.6

1.6

4 (Recent)

5630<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5630>

Medium

NEW

1570<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1570> 1568<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1568>

perf test shows multiple errors and fails on qemux86

unspecified

1.6 M2

NEW

5632<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5632>

Medium

IN PROGRESS REVIEW

1594<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1594> 1585<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1585>

Add layer for a new target build - meta intel machines list is not auto updated

1.6

1.6

NEW

5634<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5634>

Medium

NEW

1568<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1568>

systemtap in kepler doesn't recognize the kernel build

1.6

1.6

NEW

5636<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5636>

Undecided

ACCEPTED

1597<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1597>

No IP address for eth0 on qemu at the first boot

1.6

1.6

NEW

5637<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5637>

Medium

NEEDINFO

1588<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1588>

sudoku fails on qemux86 - needs gdk-x11-2.0

1.6

1.6

NEW

5638<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5638>

Medium

NEEDINFO

1591<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1591>

sudoku fails on qemux86-64 at make

1.6

1.6

NEW

5640<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5640>

Undecided

NEW

1570<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1570>

systemtap output is useless in Juno

1.6

---

NEW

5651<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5651>

Undecided

NEW

1602<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1602> 1604<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1604>

Error message for networking on some hardware boards when booting: "ip: RTNETLINK answers: File exists"

1.6

---

NEW

Total: 18




Performance test:

Here is the performance charts for the 1.6_M1.rc1 (full report attached). As you can see in the Performance test wiki<https://wiki.yoctoproject.org/wiki/Performance_Test> (search for 1.6_M1.rc1 in git describe column) , there are some variations on H1 *Ubuntu 12 host for building the rootfs. There were 7 builds for 1.6_M1.rc1 with times varying from 4:43.24 (*shortest time) to  6:05.00 (longest time). In the wiki, it can be seen that the next commit has similar variations, and the last commit the variations settle for around 6:30 minutes.

[cid:image004.png at 01CEF689.1244E320]

Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131211/81050bbf/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 10244 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131211/81050bbf/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 9999 bytes
Desc: image002.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131211/81050bbf/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 462 bytes
Desc: image003.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131211/81050bbf/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 83538 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131211/81050bbf/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Performance Comparison.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 46040 bytes
Desc: Performance Comparison.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131211/81050bbf/attachment.xlsx>


More information about the yocto mailing list