[yocto] Full Pass Test report for Yocto 1.6.2.rc2
Georgescu, Alexandru C
alexandru.c.georgescu at intel.com
Wed Nov 19 05:11:07 PST 2014
Hello,
Here is the Full pass test report for 1.6.2.rc2 build.
Issue summary:
Two new issues were found during this release:
* 6973 - Buildhistory-diff is not working when analysing changes for 2 builds
* 6975 - elapsed_time value in database doesn't match sometime the value in the task stats file in Toaster
The Distro and Build Performance test interpretations can be found below.
Testing data
Test type: Full Pass Release Test
Branch: daisy
Build name: 1.6.2 rc2
poky commit: 30b8d9378b8260e452552b806610dc9b6fe0b69f
Eclipse Plugin commit Kepler: 932891014ea068e196fcf1f9efedb8a672fb81a0
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.6.2.rc2
Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 7 64 bit
Summary Report
Testing Summary Report
Test Run
Test Plan
Environment
Passed
Other issues
Failed
Failing bugs
Blocked
Blocking bugs
Complete
3154<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3154> 3155<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3155>
ADT: daisy_branch
Fedora 20 i686
100.0%
none
0.0%
none
0.0%
none
100.0%
3156<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3156> 3157<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3157>
ADT: daisy_branch
Ubuntu 14.04 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
3161<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3161> 3162<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3162>
BSP/QEMU: daisy branch
Beaglebone Black
97.3%
none
2.7%
6462<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6462> 6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>
0.0%
none
100.0%
3150<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3150> 3151<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3151>
BSP/QEMU: daisy branch
EdgeRouter
100.0%
none
0.0%
none
0.0%
none
100.0%
3187<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3187> 3188<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3188>
BSP/QEMU: daisy branch
generic-x86 on AtomPC
98.6%
none
1.4%
4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>
0.0%
none
100.0%
3189<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3189> 3190<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3190>
BSP/QEMU: daisy branch
genericx86-64 on Sugarbay
98.6%
none
1.4%
5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>
0.0%
none
100.0%
3152<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3152> 3153<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3153>
BSP/QEMU: daisy branch
MPC8315e-rdb
100.0%
none
0.0%
none
0.0%
none
100.0%
3159<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3159> 3160<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3160>
BSP/QEMU: daisy branch
P1022ds
100.0%
none
0.0%
none
0.0%
none
100.0%
3164<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3164> 3166<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3166>
BSP/QEMU: daisy branch
qemu-x86
100.0%
none
0.0%
none
0.0%
none
100.0%
3180<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3180> 3181<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3181>
BSP/QEMU: daisy branch
qemuarm
98.1%
none
1.9%
4024<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4024>
0.0%
none
100.0%
3182<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3182> 3183<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3183>
BSP/QEMU: daisy branch
qemumips
100.0%
none
0.0%
none
0.0%
none
100.0%
3184<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3184> 3185<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3185>
BSP/QEMU: daisy branch
qemuppc
100.0%
none
0.0%
none
0.0%
none
100.0%
3165<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3165> 3167<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3167>
BSP/QEMU: daisy branch
qemux86-64
100.0%
none
0.0%
none
0.0%
none
100.0%
3168<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3168> 3169<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3169> 3170<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3170>
Eclipse Plugin: Daisy Branch
Fedora 20 x86_64
100.0%
5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285>
0.0%
none
0.0%
none
100.0%
3148<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3148> 3149<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3149>
meta-yocto: daisy branch
Ubuntu 14.04 x86_64
100.0%
6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>
0.0%
none
0.0%
none
100.0%
3173<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3173> 3174<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3174>
HOB: daisy branch
Ubuntu 14.04 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
3186<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3186> 3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
Toaster: daisy branch
Ubuntu 14.04 LTS x86_64
92.5%
none
7.5%
6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684> 6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832>5485<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5485> 6899<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6899>6114<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6114> 6975<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6975>5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255> 5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226>5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811>
0.0%
none
100.0%
3192<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3192> 3193<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3193>
OE-Core: daisy branch
Ubuntu 14.04 x86_64
96.6%
none
3.4%
6973<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6973>
0.0%
none
100.0%
3194<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3194> 3195<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3195>
BitBake: daisy branch
Ubuntu 14.04 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
3191<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3191>
Runtime: daisy branch
Multiple Environments
100.0%
none
0.0%
none
0.0%
none
100.0%
3158<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3158>
Build Appliance: daisy branch
qemu-kvm on Ubuntu 12.04 libvirt
100.0%
none
0.0%
none
0.0%
none
100.0%
Total: 21
Test Case Status Report
Status
Count
FAILED
11
PASSED
1012
Total: 1023
[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:11,1012&chco=FF9933|00FF00&chl=FAILED(11)+1%25|PASSED(1012)+99%25]
Bug Status Report
[Bug Status]
ID[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Priority[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Status[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Resolution[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Description[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Version[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW46_-_2014-11-10_-_Full_Pass_Release_1.6.2_rc2>
4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>
Low
NEW
3187<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3187>
dmesg log errors in Atom-PC
1.3.1
1.8 M1
609
4024<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4024>
Low
REOPENED
3180<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3180>
start qemuarm with "core-image-sato", use "dmesg | grep -i error" shows 2 errors
1.4
1.8 M1
605
5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226>
Medium
NEW
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
in 'variables' API, the 'changed' field seems to return always 'FALSE'
1.5
Future
418
5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>
Medium
ACCEPTED
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
source_url in the tasks table is empty
unspecified
Future
413
5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285>
Medium
NEW
3168<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3168>
powertop: Output is useless
unspecified
Future
409
5485<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5485>
Medium
RESOLVED
WONTFIX
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
Buildstats info and database entries doesn't match sometimes
unspecified
1.6 M1
369
5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811>
Medium
IN PROGRESS IMPLEMENTATION
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
the orm_variablehistory table should collect the variable value for each file
unspecified
Future
272
5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>
Medium
NEW
3190<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3190>
Cannot wake from suspend state using the USB mouse or keyboard
1.6
1.8
266
6114<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6114>
Medium
RESOLVED
WONTFIX
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
Elapsed_time value null for tasks with outcome=0
1.6.1
1.6.1
220
6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>
Medium
ACCEPTED
3149<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3149>
[crosstap] no trace message output on qemuarm
1.6
1.8
210
6462<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6462>
Medium
NEEDINFO
3162<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3162>
[1.6.1] watchdog doesn't work in beaglebone black
1.6.1
1.6.2
145
6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>
Medium
NEW
3162<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3162>
[Beaglebone] Xserver segmentation fault when reboot the system
1.7
1.8
74
6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>
Medium
RESOLVED
FIXED
3186<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3186>
The content of the license column shouldn't be 4.0k.
1.7
1.7.1
66
6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832>
Medium
ACCEPTED
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
disk_io value in database doesn't match sometime with the value in the task buildstats file
1.7
1.7.1
27
6899<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6899>
Medium
NEW
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
cpu_usage value for some tasks doesn't match the value in the stats file
1.6.2
1.6.2
13
6973<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6973>
Undecided
NEEDINFO
3192<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3192>
Buildhistory-diff is not working
1.6.3
---
NEW
6975<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6975>
Undecided
NEW
3201<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3201>
elapsed_time value in database doesn't match sometime the value in the task stats file
1.6.2
---
NEW
Total: 17
Bug Trend
An overview of this week's Yocto Bug Trend<https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend> charts can be accessed on the following page<https://wiki.yoctoproject.org/charts/combo.html>
Build Performance Test
note: all the measurements displayed are against 1.6 release in the performance test page<https://wiki.yoctoproject.org/charts/charts_161/performance_test.html>.
§ Building the rootfs improved on Ubuntu host against 1.6 release by 5 seconds taking 4:35 minutes to build. On the Fedora the build time average takes with 2 seconds less (against 1.6) with 4.34 seconds needed to build.
§ The kernel takes longer to build (against 1.6) with 30 seconds longer on average (12:32 minutes on Ubuntu and 11:23 on Fedora). Agasint 1.6.2.rc2 it maintained the same performance due to no kernel changes.
§ A sato image with rmwork takes less, with 1:11:25 hours against 1:11:32 horurs on Ubuntu and 1:14:47 against 1:15:56 on Fedora Host. It's notable that on 1.6.2.rc2 takes longer with 30 seconds on average against 1.6.2.rc1
Overall even if the kernel takes longer to build, the rootfs and images takes less on average.
Performance Charts
For Bitbake core-image-sato with rm_work
[Ww46 - rmwork.png]<https://wiki.yoctoproject.org/charts/charts_161/bitbake-core-image-sato-rmwork.html>
Building the Virtual kernel
[Ww46 - kernel.png]<https://wiki.yoctoproject.org/charts/charts_161/bitbake-virtual-kernel.html>
Building the rootfs
[Ww46 - rootfs.png]<https://wiki.yoctoproject.org/charts/charts_161/bitbake-core-image-sato-rootfs.html>
Distro Testing
Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.
Summary
At this point all buildsets are fine on Ubuntu and Fedora. Due to an internal failure on our internal Distro setup, the tests on CentOS and OpenSuse were delayed. They will be updated accordingly in the next few days.
Distro Results
BRANCH
master
COMMIT
Poky: 30b8d9378b8260e452552b806610dc9b6fe0b69f
RELEASE
1.6.2 rc2
Ubuntu 14.04 LTS
* nighlty-world
PASS
* buildtools
PASS
* nightly-arm
PASS
* nightly-multilib
PASS
* nightly-qa-systemd
PASS
* nightly-x86
PASS
* nightly-x86-64
PASS
* nightly-x86-64-lsb
PASS
Fedora 20
* nighlty-world
PASS
* buildtools
PASS
* nightly-arm
PASS
* nightly-multilib
PASS
* nightly-qa-systemd
PASS
* nightly-x86
PASS
* nightly-x86-64
PASS
* nightly-x86-64-lsb
PASS
CentOS 7
* nighlty-world
PASS
* buildtools
PASS
* nightly-arm
* nightly-multilib
* nightly-qa-systemd
* nightly-x86
* nightly-x86-64
* nightly-x86-64-lsb
OpenSuse 13.1
* nighlty-world
* buildtools
* nightly-arm
* nightly-multilib
* nightly-qa-systemd
* nightly-x86
* nightly-x86-64
* nightly-x86-64-lsb
Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141119/7b7aa2c8/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 8052 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141119/7b7aa2c8/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 11282 bytes
Desc: image002.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141119/7b7aa2c8/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 462 bytes
Desc: image003.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141119/7b7aa2c8/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 97751 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141119/7b7aa2c8/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 90155 bytes
Desc: image005.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141119/7b7aa2c8/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 86146 bytes
Desc: image006.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141119/7b7aa2c8/attachment-0004.png>
More information about the yocto
mailing list