[yocto] Yocto 1.9_M1.rc2 Full Pass Test report

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Fri Jul 17 07:36:30 PDT 2015


Hello,
Here is the full pass test report for Yocto 1.9_M1.rc2 Full Pass test report. The full test report can be accessed here<https://wiki.yoctoproject.org/wiki/WW28_-_2015-07-10_-_Full_Pass_1.9_M1.rc2>.

Highlights:

*       There is a dbus startup error #8005

*       In Eclipse, creating a new Bitbake Commander fails #7996

*       Several dmesg errors found when testing the generic images on NUC/MinnowMax #7897, #6584, #8014, #8016

*       There is no kernel image in boot directory for edgerouter rootfs #8006

The build performance shows the same average build times as M1.rc1. The performace charts can be accessed here<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html>.


Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 1.9_M1.rc2

 poky commit: f9ea480e6c26fea46c3011c4e9d0e2de3d5c81b4

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-yocto-1.9_M1.rc2/

 Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit

Test Run Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

4150<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4150> 4151<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4151>

ADT: master branch

Fedora 22 i686

99.4%

none

0.6%

7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>

0.0%

none

100.0%

4148<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4148> 4149<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4149>

ADT: master branch

Ubuntu 14.04 x86_64

99.4%

none

0.6%

7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>

0.0%

none

100.0%

4161<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4161> 4162<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4162>

BSP/QEMU: master branch

Beaglebone Black

100.0%

8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005> 8007<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8007>

0.0%

none

0.0%

none

100.0%

4169<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4169> 4170<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4170>

BSP/QEMU: master branch

EdgeRouter

100.0%

8006<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8006> 8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005>

0.0%

none

0.0%

none

100.0%

4129<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4129> 4147<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4147> 4176<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4176>

BSP/QEMU: master branch

genericx86 - on MMAX32bit

96.6%

none

3.4%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897> 8014<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8014> 8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012> 8016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8016>

0.0%

none

100.0%

4157<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4157>

BSP/QEMU: master branch

genericx86-64 on MMAX64

96.5%

none

3.5%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897>

0.0%

none

100.0%

4128<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4128> 4146<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4146> 4158<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4158>

BSP/QEMU: master branch

genericx86-64 on NUC

96.2%

none

3.8%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 8014<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8014> 8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012> 8016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8016> 8013<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8013>

0.0%

none

100.0%

4167<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4167> 4168<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4168>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005>

0.0%

none

0.0%

none

100.0%

4159<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4159> 4160<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4160>

BSP/QEMU: master branch

P1022ds

100.0%

8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005> 8007<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8007>

0.0%

none

0.0%

none

100.0%

4130<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4130> 4131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4131>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

4136<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4136> 4137<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4137>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

4165<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4165> 4166<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4166>

BSP/QEMU: master branch

qemuarm64

100.0%

none

0.0%

none

0.0%

none

100.0%

4139<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4139> 4140<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4140>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

4163<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4163> 4164<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4164>

BSP/QEMU: master branch

qemumips64

100.0%

none

0.0%

none

0.0%

none

100.0%

4142<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4142> 4143<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4143>

BSP/QEMU: master branch

qemuppc

100.0%

7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>

0.0%

none

0.0%

none

100.0%

4133<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4133> 4134<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4134>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

4123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4123>

Eclipse Plugin: master branch

Ubuntu 14.10 x86_64

94.1%

none

5.9%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>

0.0%

none

100.0%

4171<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4171>

Eclipse Plugin: master branch

Ubuntu 15.04 x86_64

91.2%

none

8.8%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>

0.0%

none

100.0%

4153<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4153> 4155<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4155>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

0.0%

none

100.0%

4119<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4119> 4120<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4120> 4121<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4121> 4122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4122>

Toaster: master branch

Ubuntu 15.04 x86_64

88.9%

5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>

11.1%

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 5192<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5192> 7005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7005> 8022<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8022> 8011<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8011> 8010<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8010> 7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>8023<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8023>

0.0%

none

100.0%

4124<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4124> 4125<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4125>

OE-Core: master branch

Ubuntu 14.10 x86_64

96.0%

none

4.0%

7976<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7976> 8027<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8027>

0.0%

none

100.0%

4126<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4126> 4127<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4127>

BitBake: master branch

Ubuntu 14.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4172<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4172>

Automated Build Testing: master branch

CentOS 7 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4173<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4173>

Automated Build Testing: master branch

Fedora 21 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4175<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4175>

Automated Build Testing: master branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4174<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4174>

Automated Build Testing: master branch

Ubuntu 14.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4145<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4145>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

4152<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4152>

Build Appliance: master branch

VMWare Player on Ubuntu

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 28






Test Case Status Report

Status

Count

FAILED

37

PASSED

1840

Total: 1877


[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,1840&chxt=y&chxr=0,0,1840,307&chd=t:&chd=t:37,1840&chco=FF9933|00FF00&chdl=FAILED(37)+2%25|PASSED(1840)+98%25]





Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID

Summary (5 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=8010&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%208011&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%208012&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%208005&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207996&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

BSPs

8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012>

connection errors on genericx86-64-lsb on NUC

Medium+

Darren Hart



1.9 M2

NEW

New (Never tested)

2015-07-15

Eclipse Plugin

7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>

Create a new BitBake commander project failed

Medium+

Todor Minchev



1.9 M3

NEW

---

2015-07-14

Runtime

8005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8005>

dbus startup error: Unknown username "xuser" in message bus configuration file

Medium+

Ross Burton

Yi Zhao

1.9 M2

NEW

Regression (Used to work)

2015-07-15

Toaster

8010<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8010>

All builds table missing column information

Medium+

Alexandru Damian

Mihail Stanciu

1.9 M3

NEW

Regression (Used to work)

2015-07-15

8011<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8011>

Sorting columns breaks Toaster

Medium+

Alexandru Damian

Mihail Stanciu

1.9 M2

NEW

Regression (Used to work)

2015-07-15




Other Bugs found during QA Test (including regressions)
ID

Summary (16 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=5187&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%205192&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%206156&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%206584&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207198&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%207236&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%207545&field0-0-7=bug_id&type0-0-7=equals&value0-0-7=%207897&field0-0-8=bug_id&type0-0-8=equals&value0-0-8=%208006&field0-0-9=bug_id&type0-0-9=equals&value0-0-9=%208007&field0-0-10=bug_id&type0-0-10=equals&value0-0-10=%208013&field0-0-11=bug_id&type0-0-11=equals&value0-0-11=%208014&field0-0-12=bug_id&type0-0-12=equals&value0-0-12=%208016&field0-0-13=bug_id&type0-0-13=equals&value0-0-13=%207054&field0-0-14=bug_id&type0-0-14=equals&value0-0-14=%208027&field0-0-15=bug_id&type0-0-15=equals&value0-0-15=%207976&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

---

7976<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7976>

Image feature tests should not be touching user's ~/.ssh/known_hosts file

Medium

Daniel Istrate



1.9 M2

IN PROGRESS REVIEW

---

2015-07-09

Toaster

5192<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5192>

non-existent URLs listed in the "Layer index URL" column

Medium

Alexandru Damian



Future

WaitForUpstream

---

2013-09-13

New (Never tested)

7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>

Installing extensible SDK as root should fail earlier with a proper error

Medium

Randy Witt

Yi Zhao

1.9 M1

ACCEPTED

New (Never tested)

2015-03-31

Automated Runtime Testing

8014<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8014>

syslog configure fails on genericx86-64 LSB image

Medium

Lucian Musat



1.9

NEW

New (Never tested)

2015-07-15

8016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8016>

test syslog help fails on genericx86-64 LSB image

Medium

Lucian Musat



1.9 M2

NEW

New (Never tested)

2015-07-15

8027<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8027>

Check rpm version 4 support on image auto test case fails

Undecided

Daniel Istrate

Costin

1.9 M2

NEW

New (Never tested)

2015-07-17

BSPs

7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897>

Dmesg error BAR 14 and BAR 15 failed to assign in Minnow Max

Low

California Sullivan



1.9

NEEDINFO

New (Never tested)

2015-06-17

8013<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8013>

Compile and load a kernel module under BSP's fails on LSB image

Medium

Richard Purdie



1.9 M2

NEW

New (Never tested)

2015-07-15

Toaster

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>

same cooker log file name used for several builds

Medium

brian avery



1.9

ACCEPTED

New (Never tested)

2013-09-13

Regression (Found by QA test)

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMax

Medium

Saul Wold



1.8 M4

REOPENED

Regression (Found by QA test)

2014-07-28

Runtime

8007<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8007>

puseaudio warning: failed to open module module-x11-publish

Medium

Tanu Kaskinen

Yi Zhao

1.9

IN PROGRESS REVIEW

Regression (Found by QA test)

2015-07-15

Regression (Used to work)

8006<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8006>

No kernel image in boot directory for edgerouter rootfs

Medium

Kevin Hao

Yi Zhao

1.9

NEW

Regression (Used to work)

2015-07-15

OE-Core

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

[crosstap] no trace message output on qemuarm

Medium

Kevin Hao



1.9

ACCEPTED

Regression (Used to work)

2014-04-14

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

OprofileUI needs to be updated to reflect new oprofile functionality

Medium

Ross Burton

Mihail Stanciu

1.9 M1

ACCEPTED

Regression (Used to work)

2014-12-09

System Startup

7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>

The color of splash screen for qemuppc is strange

Medium

Kevin Hao

Yi Zhao

1.9

NEW

Regression (Used to work)

2015-01-23

Toaster

7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>

Hiding a sorted column does not revert to default sorting

Medium

Michael Wood

Mihail Stanciu

1.9 M1

IN PROGRESS REVIEW

Regression (Used to work)

2015-01-20



Regards,
AlexG



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150717/e0a90e6f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 9940 bytes
Desc: image002.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150717/e0a90e6f/attachment.jpg>


More information about the yocto mailing list