[yocto] Yocto 1.9_M1.rc2 Full Pass Test report
Georgescu, Alexandru C
alexandru.c.georgescu at intel.com
Fri Jul 17 07:36:30 PDT 2015
Hello,
Here is the full pass test report for Yocto 1.9_M1.rc2 Full Pass test report. The full test report can be accessed here<https://wiki.yoctoproject.org/wiki/WW28_-_2015-07-10_-_Full_Pass_1.9_M1.rc2>.
Highlights:
* There is a dbus startup error #8005
* In Eclipse, creating a new Bitbake Commander fails #7996
* Several dmesg errors found when testing the generic images on NUC/MinnowMax #7897, #6584, #8014, #8016
* There is no kernel image in boot directory for edgerouter rootfs #8006
The build performance shows the same average build times as M1.rc1. The performace charts can be accessed here<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html>.
Testing data
Test type: Full Pass Release Test
Branch: master
Build name: 1.9_M1.rc2
poky commit: f9ea480e6c26fea46c3011c4e9d0e2de3d5c81b4
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-yocto-1.9_M1.rc2/
Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit
Test Run Summary Report
Testing Summary Report
Test Run
Test Plan
Environment
Passed
Other issues
Failed
Failing bugs
Blocked
Blocking bugs
Complete
4150<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4150> 4151<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4151>
ADT: master branch
Fedora 22 i686
99.4%
none
0.6%
7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>
0.0%
none
100.0%
4148<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4148> 4149<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4149>
ADT: master branch
Ubuntu 14.04 x86_64
99.4%
none
0.6%
7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>
0.0%
none
100.0%
4161<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4161> 4162<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4162>
BSP/QEMU: master branch
Beaglebone Black
100.0%
8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005> 8007<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8007>
0.0%
none
0.0%
none
100.0%
4169<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4169> 4170<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4170>
BSP/QEMU: master branch
EdgeRouter
100.0%
8006<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8006> 8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005>
0.0%
none
0.0%
none
100.0%
4129<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4129> 4147<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4147> 4176<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4176>
BSP/QEMU: master branch
genericx86 - on MMAX32bit
96.6%
none
3.4%
6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897> 8014<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8014> 8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012> 8016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8016>
0.0%
none
100.0%
4157<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4157>
BSP/QEMU: master branch
genericx86-64 on MMAX64
96.5%
none
3.5%
6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897>
0.0%
none
100.0%
4128<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4128> 4146<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4146> 4158<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4158>
BSP/QEMU: master branch
genericx86-64 on NUC
96.2%
none
3.8%
6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 8014<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8014> 8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012> 8016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8016> 8013<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8013>
0.0%
none
100.0%
4167<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4167> 4168<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4168>
BSP/QEMU: master branch
MPC8315e-rdb
100.0%
8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005>
0.0%
none
0.0%
none
100.0%
4159<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4159> 4160<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4160>
BSP/QEMU: master branch
P1022ds
100.0%
8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005> 8007<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8007>
0.0%
none
0.0%
none
100.0%
4130<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4130> 4131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4131>
BSP/QEMU: master branch
qemu-x86
100.0%
none
0.0%
none
0.0%
none
100.0%
4136<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4136> 4137<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4137>
BSP/QEMU: master branch
qemuarm
100.0%
none
0.0%
none
0.0%
none
100.0%
4165<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4165> 4166<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4166>
BSP/QEMU: master branch
qemuarm64
100.0%
none
0.0%
none
0.0%
none
100.0%
4139<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4139> 4140<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4140>
BSP/QEMU: master branch
qemumips
100.0%
none
0.0%
none
0.0%
none
100.0%
4163<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4163> 4164<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4164>
BSP/QEMU: master branch
qemumips64
100.0%
none
0.0%
none
0.0%
none
100.0%
4142<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4142> 4143<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4143>
BSP/QEMU: master branch
qemuppc
100.0%
7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>
0.0%
none
0.0%
none
100.0%
4133<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4133> 4134<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4134>
BSP/QEMU: master branch
qemux86-64
100.0%
none
0.0%
none
0.0%
none
100.0%
4123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4123>
Eclipse Plugin: master branch
Ubuntu 14.10 x86_64
94.1%
none
5.9%
7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>
0.0%
none
100.0%
4171<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4171>
Eclipse Plugin: master branch
Ubuntu 15.04 x86_64
91.2%
none
8.8%
7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>
0.0%
none
100.0%
4153<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4153> 4155<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4155>
Meta-yocto: master branch
Ubuntu 14.04 x86_64
100.0%
6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>
0.0%
none
0.0%
none
100.0%
4119<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4119> 4120<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4120> 4121<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4121> 4122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4122>
Toaster: master branch
Ubuntu 15.04 x86_64
88.9%
5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>
11.1%
5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 5192<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5192> 7005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7005> 8022<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8022> 8011<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8011> 8010<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8010> 7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>8023<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8023>
0.0%
none
100.0%
4124<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4124> 4125<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4125>
OE-Core: master branch
Ubuntu 14.10 x86_64
96.0%
none
4.0%
7976<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7976> 8027<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8027>
0.0%
none
100.0%
4126<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4126> 4127<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4127>
BitBake: master branch
Ubuntu 14.10 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
4172<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4172>
Automated Build Testing: master branch
CentOS 7 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
4173<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4173>
Automated Build Testing: master branch
Fedora 21 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
4175<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4175>
Automated Build Testing: master branch
OpenSuse 13.2 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
4174<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4174>
Automated Build Testing: master branch
Ubuntu 14.10 x86_64
100.0%
none
0.0%
none
0.0%
none
100.0%
4145<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4145>
Runtime: master branch
Multiple Environments
100.0%
none
0.0%
none
0.0%
none
100.0%
4152<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4152>
Build Appliance: master branch
VMWare Player on Ubuntu
100.0%
none
0.0%
none
0.0%
none
100.0%
Total: 28
Test Case Status Report
Status
Count
FAILED
37
PASSED
1840
Total: 1877
[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,1840&chxt=y&chxr=0,0,1840,307&chd=t:&chd=t:37,1840&chco=FF9933|00FF00&chdl=FAILED(37)+2%25|PASSED(1840)+98%25]
Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID
Summary (5 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=8010&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%208011&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%208012&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%208005&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207996&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>
P
Assignee
QA
Milestone
Status
Resolution
cf_regression_type
Created
BSPs
8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012>
connection errors on genericx86-64-lsb on NUC
Medium+
Darren Hart
1.9 M2
NEW
New (Never tested)
2015-07-15
Eclipse Plugin
7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>
Create a new BitBake commander project failed
Medium+
Todor Minchev
1.9 M3
NEW
---
2015-07-14
Runtime
8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005>
dbus startup error: Unknown username "xuser" in message bus configuration file
Medium+
Ross Burton
Yi Zhao
1.9 M2
NEW
Regression (Used to work)
2015-07-15
Toaster
8010<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8010>
All builds table missing column information
Medium+
Alexandru Damian
Mihail Stanciu
1.9 M3
NEW
Regression (Used to work)
2015-07-15
8011<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8011>
Sorting columns breaks Toaster
Medium+
Alexandru Damian
Mihail Stanciu
1.9 M2
NEW
Regression (Used to work)
2015-07-15
Other Bugs found during QA Test (including regressions)
ID
Summary (16 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=5187&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%205192&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%206156&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%206584&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207198&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%207236&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%207545&field0-0-7=bug_id&type0-0-7=equals&value0-0-7=%207897&field0-0-8=bug_id&type0-0-8=equals&value0-0-8=%208006&field0-0-9=bug_id&type0-0-9=equals&value0-0-9=%208007&field0-0-10=bug_id&type0-0-10=equals&value0-0-10=%208013&field0-0-11=bug_id&type0-0-11=equals&value0-0-11=%208014&field0-0-12=bug_id&type0-0-12=equals&value0-0-12=%208016&field0-0-13=bug_id&type0-0-13=equals&value0-0-13=%207054&field0-0-14=bug_id&type0-0-14=equals&value0-0-14=%208027&field0-0-15=bug_id&type0-0-15=equals&value0-0-15=%207976&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>
P
Assignee
QA
Milestone
Status
Resolution
cf_regression_type
Created
---
7976<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7976>
Image feature tests should not be touching user's ~/.ssh/known_hosts file
Medium
Daniel Istrate
1.9 M2
IN PROGRESS REVIEW
---
2015-07-09
Toaster
5192<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5192>
non-existent URLs listed in the "Layer index URL" column
Medium
Alexandru Damian
Future
WaitForUpstream
---
2013-09-13
New (Never tested)
7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>
Installing extensible SDK as root should fail earlier with a proper error
Medium
Randy Witt
Yi Zhao
1.9 M1
ACCEPTED
New (Never tested)
2015-03-31
Automated Runtime Testing
8014<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8014>
syslog configure fails on genericx86-64 LSB image
Medium
Lucian Musat
1.9
NEW
New (Never tested)
2015-07-15
8016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8016>
test syslog help fails on genericx86-64 LSB image
Medium
Lucian Musat
1.9 M2
NEW
New (Never tested)
2015-07-15
8027<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8027>
Check rpm version 4 support on image auto test case fails
Undecided
Daniel Istrate
Costin
1.9 M2
NEW
New (Never tested)
2015-07-17
BSPs
7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897>
Dmesg error BAR 14 and BAR 15 failed to assign in Minnow Max
Low
California Sullivan
1.9
NEEDINFO
New (Never tested)
2015-06-17
8013<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8013>
Compile and load a kernel module under BSP's fails on LSB image
Medium
Richard Purdie
1.9 M2
NEW
New (Never tested)
2015-07-15
Toaster
5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>
same cooker log file name used for several builds
Medium
brian avery
1.9
ACCEPTED
New (Never tested)
2013-09-13
Regression (Found by QA test)
6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>
dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMax
Medium
Saul Wold
1.8 M4
REOPENED
Regression (Found by QA test)
2014-07-28
Runtime
8007<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8007>
puseaudio warning: failed to open module module-x11-publish
Medium
Tanu Kaskinen
Yi Zhao
1.9
IN PROGRESS REVIEW
Regression (Found by QA test)
2015-07-15
Regression (Used to work)
8006<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8006>
No kernel image in boot directory for edgerouter rootfs
Medium
Kevin Hao
Yi Zhao
1.9
NEW
Regression (Used to work)
2015-07-15
OE-Core
6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>
[crosstap] no trace message output on qemuarm
Medium
Kevin Hao
1.9
ACCEPTED
Regression (Used to work)
2014-04-14
7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>
OprofileUI needs to be updated to reflect new oprofile functionality
Medium
Ross Burton
Mihail Stanciu
1.9 M1
ACCEPTED
Regression (Used to work)
2014-12-09
System Startup
7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>
The color of splash screen for qemuppc is strange
Medium
Kevin Hao
Yi Zhao
1.9
NEW
Regression (Used to work)
2015-01-23
Toaster
7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>
Hiding a sorted column does not revert to default sorting
Medium
Michael Wood
Mihail Stanciu
1.9 M1
IN PROGRESS REVIEW
Regression (Used to work)
2015-01-20
Regards,
AlexG
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150717/e0a90e6f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 9940 bytes
Desc: image002.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150717/e0a90e6f/attachment.jpg>
More information about the yocto
mailing list