[yocto] Yocto 1.5.4 Full Pass Test Report
Georgescu, Alexandru C
alexandru.c.georgescu at intel.com
Thu Dec 4 11:59:47 PST 2014
Hello,
Here is the full pas test report for Yocto 1.5.4 release.
issue summary (bo blockers have been found):
* Archiver .bbclass fails to filter the source licenses (note that the functionality was changed after starting 1.6) - #7012
* Renaming a downloaded file stopped working - #7009
* In Eclipse Kepler, a new Bitbake Commander project cannot be created. The issue is fixed on newer versions (1.6.x and 1.7.x) - #5473
* For Beagleboard BSP, X cannot start with 3.10 kernel. The issue is known - #5182
* Build performance remained about the same against 1.5.3 so no degradations were observed.
* Distro testing against latest common Linux Distributions passed with all builds successfully.
The full detailed report is available here: https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4
The testing data and summary report can be seen below:
Testing data
Test type: Full Pass Release
Branch: Dora
Build name: 1.5.4
poky commit: de14d21bc6633ddeb810cef051b91ee322276496
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.5.3.rc1/
Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit
Summary Report
Testing Summary Report
Test Run
Test Plan
Environment
Passed
Other issues
Failed
Failing bugs
Blocked
Blocking bugs
Complete
3224<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3224> 3225<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3225>
ADT: dora branch
Fedora 20 i686
100.0%
none
0.0%
none
0.0%
none
100.0%
3222<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3222> 3223<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3223>
ADT: dora branch
Ubuntu 14.04 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
3228<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3228> 3229<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3229>
BSP/QEMU: dora branch
Beagleboard
71.0%
none
4.3%
5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>
24.6%
5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>
100.0%
3219<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3219> 3220<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3220>
BSP/QEMU: dora branch
generic-x86 on AtomPC
98.6%
none
1.4%
4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>
0.0%
none
100.0%
3212<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3212> 3213<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3213>
BSP/QEMU: dora branch
genericx86-64 on Sugarbay
98.6%
none
1.4%
5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>
0.0%
none
100.0%
3245<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3245> 3246<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3246>
BSP/QEMU: dora branch
MPC8315e-rdb
100.0%
none
0.0%
none
0.0%
none
100.0%
3226<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3226> 3227<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3227>
BSP/QEMU: dora branch
P1022ds
100.0%
none
0.0%
none
0.0%
none
100.0%
3208<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3208> 3210<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3210>
BSP/QEMU: dora branch
qemu-x86
100.0%
none
0.0%
none
0.0%
none
100.0%
3235<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3235> 3238<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3238>
BSP/QEMU: dora branch
qemuarm
98.1%
none
1.9%
4024<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4024>
0.0%
none
100.0%
3239<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3239> 3240<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3240>
BSP/QEMU: dora branch
qemumips
100.0%
none
0.0%
none
0.0%
none
100.0%
3241<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3241> 3242<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3242>
BSP/QEMU: dora branch
qemuppc
100.0%
none
0.0%
none
0.0%
none
100.0%
3209<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3209> 3211<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3211>
BSP/QEMU: dora branch
qemux86-64
100.0%
none
0.0%
none
0.0%
none
100.0%
3243<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3243> 3244<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3244>
BSP/QEMU: dora branch
Routerstationpro
100.0%
none
0.0%
none
0.0%
none
100.0%
3216<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3216> 3217<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3217>3218<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3218>
Eclipse plugin: Dora branch
Ubuntu 14.04 x86_64
84.8%
none
3.0%
5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>
12.1%
5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>
100.0%
3248<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3248> 3249<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3249>3250<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3250>
Eclipse plugin: Dora branch
Ubuntu 14.10 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
3236<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3236> 3237<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3237>
Meta-yocto: dora branch
Ubuntu 14.04 x86_64
100.0%
6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>
0.0%
none
0.0%
none
100.0%
3214<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3214> 3215<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3215>
Hob: dora branch
Ubuntu 14.10 x86_64
95.6%
none
2.2%
7002<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7002>
2.2%
none
100.0%
3233<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3233> 3234<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3234>
OE-Core: dora branch
Ubuntu 14.04 x86_64
96.2%
none
3.8%
7012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7012>
0.0%
none
100.0%
3231<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3231> 3232<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3232>
Bitbake: dora branch
Ubuntu 14.04 x86_64
95.5%
none
4.5%
7009<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7009>
0.0%
none
100.0%
3221<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3221>
Runtime: dora branch
Multiple Environments
100.0%
none
0.0%
none
0.0%
none
100.0%
3230<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3230>
Build Appliance: dora branch
qemu-kvm on Ubuntu 12.04 libvirt
100.0%
none
0.0%
none
0.0%
none
100.0%
Total: 21
Test Case Status Report
Status
Count
BLOCKED
22
FAILED
10
PASSED
1015
Total: 1047
[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:22,10,1015&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(22)+2%25|FAILED(10)+1%25|PASSED(1015)+97%25]
Bug Status Report
[Bug Status]
ID[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Priority[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Status[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Resolution[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Test Runs[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Description[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Version[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Target Milestone[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
Age (days)[↓]<https://wiki.yoctoproject.org/wiki/WW48_-_2014-11-25_-_Full_Pass_Release_Dora_1.5.4>
4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>
Low
NEW
3220<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3220>
dmesg log errors in Atom-PC
1.3.1
1.8 M1
624
4024<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4024>
Low
REOPENED
3235<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3235>
start qemuarm with "core-image-sato", use "dmesg | grep -i error" shows 2 errors
1.4
1.8 M1
620
5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>
Medium+
RESOLVED
WONTFIX
3229<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3229> 3228<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3228>
[Beagleboard xM]X can not startup with 3.10 kernel
1.5
1.5.1
438
5473<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5473>
Medium
RESOLVED
WONTFIX
3217<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3217> 3216<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3216>
[KEPLER] unable to create new bitbake commander project
1.5
1.5.4
385
5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>
Medium
NEW
3213<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3213>
Cannot wake from suspend state using the USB mouse or keyboard
1.6
1.8
281
6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>
Medium
ACCEPTED
3237<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3237>
[crosstap] no trace message output on qemuarm
1.6
1.8
225
7002<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7002>
Low
NEW
3215<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3215>
Failed to build an non-GPLv3 image
1.5.4
Future
NEW
7009<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7009>
Undecided
NEW
3231<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3231>
Rename downloaded file feature is not working
1.5.4
---
NEW
7012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7012>
Medium
NEW
3233<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3233>
archiver.bbclass fails to filter the source licenses
1.5.4
1.5.4
NEW
Total: 9
Bug Trend
An overview of this week's Yocto Bug Trend<https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend> charts can be accessed on the following page<https://wiki.yoctoproject.org/charts/combo.html>
Build Performance Test
Detailed description on how performance test are run can be found on Performance Test<https://wiki.yoctoproject.org/wiki/Performance_Test> wiki. The below charts are displaying the build performance trend for 1.5 by milestone starting 1.5 on Master including also the recent 1.6.2 and 1.7 releases. The charts by Milestone can be accessed at this link<https://wiki.yoctoproject.org/charts/charts_15/performance_test.html> where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.
§ As a status, building the rootfs remained the same as 1.5.3, with 4:57 minutes on Fedora 20 and 6:19 in Ubuntu 12.
§ Comparing the build time for the kernel remained fairly the same against 1.5.3 with 14:28 minutes on Ubuntu 12 and 12:29 minutes in Fedora 20.
§ Building a sato image with rm_work shows a slow degradation trend against 1.5.3 with 1:08:36 hours (1.7_M4.rc5) against 1:11:32(1.6 release) on Ubuntu 12 and 1:10:32 hours (1.7_M4.rc5) against 1:15:56(1.6 release) on Fedora 19. This is the best performance we had starting 1.6.
Overall the build performance remains fairly the same agasint 1.5.3.
Against the 1.6.2 and1.7 releases, the 1.5.4 lags behind on the kernel and image building side as well when building the rootfs.
Performance Charts
For Bitbake core-image-sato with rm_work
[Ww48 - rmwork.png]<https://wiki.yoctoproject.org/charts/charts_15/bitbake-core-image-sato-rmwork.html>
Building the Virtual kernel
[Ww48 - kernel.png]<https://wiki.yoctoproject.org/charts/charts_15/bitbake-virtual-kernel.html>
Building the rootfs
[Ww48 - rootfs.png]<https://wiki.yoctoproject.org/charts/charts_15/bitbake-core-image-sato-rootfs.html>
Distro Testing
Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.
Summary
All distro tests are passed.
Distro Results
BRANCH
master
COMMIT
Poky: de14d21bc6633ddeb810cef051b91ee322276496
RELEASE
1.5.4
Ubuntu 14.04 LTS
* nighlty-world
PASS
* buildtools
PASS
* nightly-arm
PASS
* nightly-multilib
PASS
* nightly-qa-systemd
PASS
* nightly-x86
PASS
* nightly-x86-64
PASS
* nightly-x86-64-lsb
PASS
Fedora 20
* nighlty-world
PASS
* buildtools
PASS
* nightly-arm
PASS
* nightly-multilib
PASS
* nightly-qa-systemd
PASS
* nightly-x86
PASS
* nightly-x86-64
PASS
* nightly-x86-64-lsb
PASS
CentOS 7
* nighlty-world
PASS
* buildtools
PASS
* nightly-arm
PASS
* nightly-multilib
PASS
* nightly-qa-systemd
PASS
* nightly-x86
PASS
* nightly-x86-64
PASS
* nightly-x86-64-lsb
PASS
OpenSuse 13.3
* nighlty-world
PASS
* buildtools
PASS
* nightly-arm
PASS
* nightly-multilib
PASS
* nightly-qa-systemd
PASS
* nightly-x86
PASS
* nightly-x86-64
PASS
* nightly-x86-64-lsb
PASS
Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141204/88d86013/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 10205 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141204/88d86013/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 8823 bytes
Desc: image002.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141204/88d86013/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 462 bytes
Desc: image003.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141204/88d86013/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 121452 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141204/88d86013/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 100031 bytes
Desc: image005.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141204/88d86013/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 116096 bytes
Desc: image006.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141204/88d86013/attachment-0004.png>
More information about the yocto
mailing list