[yocto] Full Pass Test report - Yocto 1.8_M2.rc2

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Mon Feb 9 09:25:04 PST 2015


Hello,
Here is the Full Pass test report for Yocto 1.8_M2.rc2 build. The detailed report  is available here<https://wiki.yoctoproject.org/wiki/WW06_-_2015-02-03_-_Full_Pass_1.8_M2.rc2>. During this build kernel config errors were fixed so the bugs found in rc1 related to networking and sound were fixed.

*       A list with the issues found during the test run can be viewed below. The list  includes the bugs found during QA test but also bugs which are open and against current milestone(1.8, 1.8 M2). No blockers have been found during this build.

*       A regression was found during build performance test when building the core-image-sato with rm_work. We have narrowed it down to libtool upstream changes. With the regression it takes 11 minutes longer on average to build the image on both testing machines.


Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 1.8_M2.rc2

 poky commit: 22c38e2d8a058619e3d05534b5e830b750aa4241

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20150202-1/

 Distributions tested: Ubuntu 14.04 64bit, Fedora 21 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit


Test Run Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

3440<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3440> 3441<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3441>

ADT: master branch

Fedora 21 i686

100.0%

7227<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7227>

0.0%

none

0.0%

none

100.0%

3438<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3438> 3439<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3439>

ADT: master branch

Ubuntu 14.04 x86_64

99.1%

7290<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7290>

0.9%

7289<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7289>

0.0%

none

100.0%

3442<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3442> 3443<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3443>

BSP/QEMU: master branch

Beaglebone Black

98.7%

none

1.3%

6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>

0.0%

none

100.0%

3462<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3462> 3463<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3463>

BSP/QEMU: master branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

3431<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3431> 3432<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3432>

BSP/QEMU: master branch

generic-x86 on AtomPC

100.0%

none

0.0%

none

0.0%

none

100.0%

3429<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3429> 3430<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3430>

BSP/QEMU: master branch

genericx86-64 on Sugarbay

97.6%

none

2.4%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

0.0%

none

100.0%

3464<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3464> 3465<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3465>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

3446<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3446> 3447<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3447>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

3454<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3454> 3459<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3459>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

3449<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3449> 3450<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3450>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

3451<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3451> 3455<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3455>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

3457<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3457> 3458<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3458>

BSP/QEMU: master branch

qemuppc

100.0%

7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>

0.0%

none

0.0%

none

100.0%

3456<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3456> 3460<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3460>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

3461<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3461>

Eclipse Plugin: master branch

Ubuntu 14.10 x86_64

97.0%

5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769> 5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285>

3.0%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

3444<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3444> 3445<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3445>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

0.0%

none

100.0%

3433<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3433> 3434<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3434>

Hob: master branch

Ubuntu 14.10 x86_64

97.8%

none

0.0%

none

2.2%

none

100.0%

3452<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3452> 3453<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3453>

Toaster: master branch

Ubuntu 14.04 LTS x86_64

85.0%

7023<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7023> 7025<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7025>

15.0%

7026<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7026> 7004<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7004> 7052<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7052> 7060<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7060> 7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>

0.0%

none

100.0%

3435<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3435> 3468<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3468>

Toaster: master branch

Ubuntu 14.10 x86_64

85.9%

none

12.5%

6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832> 7200<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7200> 7201<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7201> 5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255> 7283<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7283> 7005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7005> 7284<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7284> 7285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7285>

1.6%

none

100.0%

3472<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3472> 3473<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3473>

OE-Core: master branch

Ubuntu 14.10 x86_64

96.6%

none

3.4%

6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>

0.0%

none

100.0%

3466<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3466> 3467<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3467>

BitBake: master branch

Ubuntu 14.10 x86_64

97.3%

none

0.0%

none

2.7%

none

100.0%

3437<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3437>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

3448<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3448>

Build Appliance: master branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

7288<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7288> 7300<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7300>

0.0%

none

0.0%

none

100.0%

Total: 22



[Bug Status]


Test Case Status Report

Status

Count

BLOCKED

3

FAILED

20

PASSED

1239

Total: 1262


[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,1239&chxt=y&chxr=0,0,1239,207&chd=t:&chd=t:3,20,1239&chco=FFFF66|FF9933|00FF00&chdl=BLOCKED(3)+0%25|FAILED(20)+2%25|PASSED(1239)+98%25]





Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID

Summary (5 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=7289&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%207290&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%207300&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%207283&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207285&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

cf_regression_type

Created

ADT

7289<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7289>

Fail to build iptables with mips toolchain sdk

Medium+

Cristian Iorga



1.8 M3

NEW

Regression (Used to work)

2015-02-05

7290<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7290>

A warning message when installing toolchain sdk if using dash

Medium+

Saul Wold



1.8 M3

NEW

New (Never tested)

2015-02-05

Build Appliance

7300<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7300>

many selectable packages are missing when try to build image in build appliance(build 20150202-1)

Undecided

Cristian Iorga



---

NEW

Regression (Used to work)

2015-02-09

Toaster

7283<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7283>

Toaster fails to start in managed mode due to traceback

High

Alexandru Damian

Ionut Chisanovici

1.8 M3

IN PROGRESS REVIEW

Regression (Used to work)

2015-02-04

7285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7285>

Toaster managed mode: toaster fails to start a build with meta-selftest added as a new local layer

High

Alexandru Damian

Ionut Chisanovici

1.8 M3

NEW

New (Never tested)

2015-02-04




Other Bugs found during QA Test (including regressions)
ID

Summary (25 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=7236&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%206832&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%207227&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%206804&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207198&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%207200&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%207201&field0-0-7=bug_id&type0-0-7=equals&value0-0-7=%206474&field0-0-8=bug_id&type0-0-8=equals&value0-0-8=%206665&field0-0-9=bug_id&type0-0-9=equals&value0-0-9=%206584&field0-0-10=bug_id&type0-0-10=equals&value0-0-10=%206156&field0-0-11=bug_id&type0-0-11=equals&value0-0-11=%205769&field0-0-12=bug_id&type0-0-12=equals&value0-0-12=%205285&field0-0-13=bug_id&type0-0-13=equals&value0-0-13=%205255&field0-0-14=bug_id&type0-0-14=equals&value0-0-14=%207060&field0-0-15=bug_id&type0-0-15=equals&value0-0-15=%207052&field0-0-16=bug_id&type0-0-16=equals&value0-0-16=%207054&field0-0-17=bug_id&type0-0-17=equals&value0-0-17=%207023&field0-0-18=bug_id&type0-0-18=equals&value0-0-18=%207025&field0-0-19=bug_id&type0-0-19=equals&value0-0-19=%207026&field0-0-20=bug_id&type0-0-20=equals&value0-0-20=%207004&field0-0-21=bug_id&type0-0-21=equals&value0-0-21=%207005&field0-0-22=bug_id&type0-0-22=equals&value0-0-22=%207284&field0-0-23=bug_id&type0-0-23=equals&value0-0-23=%207288&field0-0-24=bug_id&type0-0-24=equals&value0-0-24=%205589&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

cf_regression_type

Created

---

6474<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6474>

genericx86 does not work on Emenlow hardware

Medium+

Darren Hart



1.8

ACCEPTED

---

2014-06-23

OE-Core

5589<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5589>

gst-plugins-* main package itself is useless

Medium+

Cristian Iorga



1.8 M2

ACCEPTED

---

2013-11-22

New (Never tested)

7005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7005>

Toaster UI - two or more projects having the same name can be created

Medium

Belen Barros Pena



1.8 M4

NEW

New (Never tested)

2014-12-02

Toaster

7026<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7026>

All layers page: Sorting does not work

Medium

Michael Wood



1.8

NEW

New (Never tested)

2014-12-03

7060<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7060>

Filters in "All targets" page not working

Medium

Michael Wood



1.8 M3

NEW

New (Never tested)

2014-12-11

7284<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7284>

Toaster managed mode: two or more variables having the same name can be added for the same project

Medium

David Reyna



1.8 M3

NEW

New (Never tested)

2015-02-04

5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>

source_url in the tasks table is empty

Medium

Alexandru Damian

Ionut Chisanovici

1.9

ACCEPTED

New (Never tested)

2013-09-23

6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832>

disk_io value in database doesn't match sometime with the value in the task buildstats file

Medium

Alexandru Damian

Ionut Chisanovici

1.8 M3

REOPENED

New (Never tested)

2014-10-14

7023<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7023>

All layers page: column head misspelled

Medium

Belen Barros Pena



1.8 M3

IN PROGRESS REVIEW

New (Never tested)

2014-12-03

7052<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7052>

Filters in the all layers page return only the information shown in the page

Medium

Michael Wood

<span style='font-size:
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150209/c2d7520a/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image011.jpg
Type: image/jpeg
Size: 9715 bytes
Desc: image011.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150209/c2d7520a/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image012.jpg
Type: image/jpeg
Size: 7503 bytes
Desc: image012.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150209/c2d7520a/attachment-0001.jpg>


More information about the yocto mailing list