[yocto] Yocto 1.6_M5.rc4 full pass report

Stoicescu, CorneliuX corneliux.stoicescu at intel.com
Fri Apr 18 04:53:08 PDT 2014 

Hello,

Here is the Full Pass report for Yocto 1.6_M5.rc4 build.



New issues summary:

-          We have 2 new Medium+ bugs:

                * # 6162 is a regression in adding a kernel patch using the yocto-kernel script.

                * # 6165 is regarding Beaglebone Black kernel  not booting if it's built in certain circumstances (TMPDIR path too long). We already have a fix for this on the oe-core mailing list and we also have a workaround in the bug entry itself.

-          Beagleboard BSP has recently been replaced by Beaglebone and Beaglebone Black. Despite the booting issues with Beaglebone Black, we managed to boot the board using a workaround and did most of the BSP and stress tests. We did not manage to run the USB storage and audio tests because of the missing needed hardware and short timeframe.



The detailed full pass report is available on the wiki: https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4



Testing data

 Test type:  Full Pass Release Test

 Branch: daisy

 Milestone: M5

 Build name: 1.6_M5.rc4

 poky commit: a0958261265049904fd78a2ba0198d46e5e65ea9

 Eclipse Plugin commit Kepler:  1dfe1d2f1322b5fda8e1a7637c447b0e060efb3e

 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-1.6_M5.rc4

 Distributions tested: Ubuntu 14.04 64bit (BETA), Ubuntu 13.10 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2277<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2277> 2279<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2279>

ADT: master branch

Fedora 20 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

2276<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2276> 2278<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2278>

ADT: master branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2264<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2264> 2265<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2265>

BSP/QEMU: master branch

Beaglebone Black

96.6%

none

3.4%

3937<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3937> 6165<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6165>

0.0%

none

100.0%

2285<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2285> 2286<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2286>

BSP/QEMU: master branch

EdgeRouter

98.0%

none

2.0%

6111<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6111>

0.0%

none

100.0%

2238<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2238> 2240<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2240>

BSP/QEMU: master branch

generic-x86 on AtomPC

97.1%

none

2.9%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005> 5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2249<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2249> 2252<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2252>

BSP/QEMU: master branch

genericx86-64 on Sugarbay

98.6%

none

1.4%

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2281<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2281> 2282<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2282>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

2283<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2283> 2284<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2284>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

2259<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2259> 2260<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2260>

BSP/QEMU: master branch

qemu-x86

100.0%

2646<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2646>

0.0%

none

0.0%

none

100.0%

2268<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2268> 2269<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2269>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

2272<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2272> 2273<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2273>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

2270<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2270> 2271<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2271>

BSP/QEMU: master branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

2263<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2263> 2267<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2267>

BSP/QEMU: master branch

qemux86-64

100.0%

2646<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2646>

0.0%

none

0.0%

none

100.0%

2253<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2253> 2255<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2255> 2257<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2257>

Eclipse Plugin: master branch

Fedora 20 x86_64

100.0%

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760> 5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769> 5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

0.0%

none

0.0%

none

100.0%

2254<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2254> 2256<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2256> 2258<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2258>

Eclipse Plugin: master branch

Ubuntu 13.10 x86_64

100.0%

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760> 5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769> 5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

0.0%

none

0.0%

none

100.0%

2274<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2274> 2275<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2275>

Meta-yocto: master branch

Ubuntu 13.10 x86-64

90.9%

none

9.1%

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162> 6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

100.0%

2241<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2241> 2242<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2242>

Hob: master branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2248>

Toaster: master branch

Ubuntu 13.04 x86_64

94.6%

none

5.4%

6114<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6114> 5254<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5254> 5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226> 5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811> 5253<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5253> 5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>

0.0%

none

100.0%

2237<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2237> 2239<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2239>

OE-Core: master branch

Multiple environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2245<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2245> 2246<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2246>

BitBake: master branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2290<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2290>

Runtime: master branch

Multiple Environments

88.9%

none

11.1%

6165<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6165>

0.0%

none

100.0%

2280<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2280>

Build Appliance: master branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 22



Test Case Status Report

Status

Count

FAILED

11

PASSED

952

Total: 963


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:11,952&chco=FF9933|00FF00&chl=FAILED(11)+1%25|PASSED(952)+99%25]



Bug Status Report


ID[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Priority[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Status[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Resolution[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Test Runs[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Description[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Version[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Target Milestone[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

Age (days)[↓]<https://wiki.yoctoproject.org/wiki/WW15_-_2014-04-11_-_Full_Pass_Release_1.6_M5.rc4>

2646<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2646>

Medium

ACCEPTED

2259<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2259> 2267<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2267>

Windows switching failure

1.2

1.6

658

3937<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3937>

Medium

REOPENED

2264<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2264>

[beagleboard xM] Watchdog doesn't work

1.4

1.6

409

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

2238<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2238>

dmesg log errors in Atom-PC

1.3.1

1.5

396

5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

Medium

ACCEPTED

2253<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2253> 2254<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2254>

no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2)

1.5

1.7

212

5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226>

Medium

NEW

2248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2248>

in 'variables' API, the 'changed' field seems to return always 'FALSE'

1.5

1.7

205

5253<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5253>

Medium

RESOLVED

WONTFIX

2248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2248>

[webhob-poky/master] work_directory in tasks table is empty

unspecified

1.6 M1

200

5254<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5254>

Medium

RESOLVED

DUPLICATE

2248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2248>

[webhob-poky/master] line_number in tasks table is empty

unspecified

1.6 M1

200

5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>

Medium

ACCEPTED

2248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2248>

source_url in the tasks table is empty

unspecified

1.7

200

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>

Low

NEW

2253<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2253> 2254<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2254>

headless build takes took long

1.6

1.6

74

5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769>

Low

NEW

2254<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2254> 2253<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2253>

ssh connection doesn't disconnect when qemu is restarted/shut down

1.6

1.6

72

5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811>

Medium

IN PROGRESS IMPLEMENTATION

2248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2248>

the orm_variablehistory table should collect the variable value for each file

unspecified

1.7

59

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

Medium

NEW

2240<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2240> 2252<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2252>

Cannot wake from suspend state using the USB mouse or keyboard

1.6

1.6

53

6111<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6111>

Low

ACCEPTED

2285<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2285>

[edgerouter] rtc-ds1307 error in dmesg

1.6

1.7

7 (Recent)

6114<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6114>

Medium

ACCEPTED

2248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2248>

Elapsed_time value null for tasks with outcome=0

1.6

1.6 M5

7 (Recent)

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

Medium

NEW

2275<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2275>

[crosstap] no trace message output on qemuarm

1.6

1.7

NEW

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>

Medium+

NEEDINFO

2275<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2275>

linux-yocto failed to do_patch after add a patch by yocto-kernel tool

1.6

1.6.1

NEW

6165<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6165>

Medium+

ACCEPTED

2265<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2265> 2290<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2290>

Beaglebone does not boot - hangs at Starting kernel

1.6

1.6.1

NEW

Total: 17



Distro Testing:

All the ‘distro’ tests are passed during this build. We also performed manually the ‘distro’ tests (covered in the summary report from above) on Ubuntu 14.04 (beta).


COMMIT

daisy: a0958261265049904fd78a2ba0198d46e5e65ea9

RELEASE

1.6_M5.rc4

Fedora 20



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS





OpenSuSE 13.1



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS





Ubuntu 13.10



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS





CentOS 6.5



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



Performance Test:

Following are the significant changes in build time performance metrics. The rest have seen no noticeable improvements/degradations over previous 1.6_M5.rc2 build.[cid:image001.jpg at 01CF5B14.E8A86FA0]

[cid:image002.jpg at 01CF5B15.E7F94E70]
[cid:image003.jpg at 01CF5B15.E7F94E70]


[cid:image004.jpg at 01CF5B15.E7F94E70][cid:image005.jpg at 01CF5B15.E7F94E70]



These and all the other measurements are available on the performance_test wiki: https://wiki.yoctoproject.org/wiki/Performance_Test#1.6_Nightly_results

Regards,
Corneliu
Yocto QA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 8043 bytes
Desc: image006.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image007.gif
Type: image/gif
Size: 462 bytes
Desc: image007.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 45558 bytes
Desc: image001.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 52890 bytes
Desc: image002.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment-0001.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 46817 bytes
Desc: image003.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment-0002.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 47664 bytes
Desc: image004.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment-0003.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.jpg
Type: image/jpeg
Size: 46287 bytes
Desc: image005.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140418/61a96c04/attachment-0004.jpg>

More information about the yocto mailing list