[yocto] Yocto 2.0.rc3 Full Pass test report

Fri Nov 6 06:27:19 PST 2015

Hello,
Here is the full pass test report for Yocto 2.0.rc3 release candidate. The team managed to close and verify many of the recent latest bugs.

Issue summary:

*        Opened 2 new bugs on pTest for openssl #8655 and perl #8656 (regressions). Detailed report is available here<https://wiki.yoctoproject.org/wiki/WW44_-_2015-11-04_-_Full_Pass_2.0.rc3#pTest_results_for_genericx86-64_on_NUC>.

*        sdk_ext on i686 hosts fails to install - #8124. This issue is currently investigated and we are trying more scenarios to confirm it.

*        On eclipse-plugin/mars, errors appear on the editor when debugging a GTK project - #8579.

*        Sometimes, eclipse hangs when trying to create a new bitbake commander project if not using a fresh poky clone - #8453

*        Regarding build performance, no regressions or diffrences were detected since the last 4 RC’s (M3.rc1). We can see here<https://wiki.yoctoproject.org/wiki/WW44_-_2015-11-04_-_Full_Pass_2.0.rc3#Build_Performance_Test> that building a core-image-sato with rm_work takes longer with 4 minutes on average comparing with 2.0 M1.rc1. The virtual-kernel build time maintains its current build time average. The rootfs also improved with about 40 seconds (now taking about 4 minutes to build) comparing with M1.rc1.

The full test report is available on the yoctoproject wiki as well:  https://wiki.yoctoproject.org/wiki/WW44_-_2015-11-04_-_Full_Pass_2.0.rc3

Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 2.0.rc3

 poky commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.0.rc3

 Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit

Test Run Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

4958<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4958>

ADT: master branch

Fedora 22 i686

98.2%

8308<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8308>

1.8%

8124<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8124>

0.0%

none

100.0%

4955<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4955> 4956<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4956>

ADT: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4959<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4959> 4960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4960>

BSP/QEMU: master branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

4936<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4936> 4939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4939> 4945<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4945>

BSP/QEMU: master branch

genericx86 - on MMAX32bit

98.6%

none

1.4%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

0.0%

none

100.0%

4940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4940>

BSP/QEMU: master branch

genericx86-64 on MMAX64

96.5%

none

3.5%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

0.0%

none

100.0%

4937<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4937> 4938<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4938> 4942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4942> 4943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4943>

BSP/QEMU: master branch

genericx86-64 on NUC

96.0%

none

4.0%

8312<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8312> 8448<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8448> 6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

0.0%

none

100.0%

4961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4961> 4962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4962>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

4934<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4934> 4941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4941>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

4967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4967> 4968<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4968>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

4965<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4965> 4966<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4966>

BSP/QEMU: master branch

qemuarm64

100.0%

none

0.0%

none

0.0%

none

100.0%

4963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4963> 4964<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4964>

BSP/QEMU: master branch

qemumips64

100.0%

none

0.0%

none

0.0%

none

100.0%

4935<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4935> 4944<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4944>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

4951<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4951>

Eclipse Plugin: master branch

Kepler - Fedora 22 x86_64

96.7%

none

3.3%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

4952<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4952>

Eclipse Plugin: master branch

Luna on Fedora 22 X86_64

96.7%

none

3.3%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

0.0%

none

100.0%

4950<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4950>

Eclipse Plugin: master branch

Mars on Fedora 22 x86_64

86.7%

none

13.3%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 8579<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8579>

0.0%

none

100.0%

4930<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4930> 4931<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4931> 4932<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4932> 4933<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4933>

Toaster: master branch

Ubuntu 15.04 x86_64

95.0%

none

5.0%

7880<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7880> 8148<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8148> 8125<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8125> 7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>

0.0%

none

100.0%

4949<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4949>

OE-Core: master branch

CentOS 7.1 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4953<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4953>

OE-Core: master branch

Fedora 21 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4948>

OE-Core: master branch

Fedora 22 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4947>

OE-Core: master branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4946<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4946>

OE-Core: master branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4925<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4925>

BitBake: master branch

Fedora 21 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4928<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4928>

Automated Build Testing: master branch

CentOS 7 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4927<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4927>

Automated Build Testing: master branch

Fedora 22 x86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

4929<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4929>

Automated Build Testing: master branch

OpenSuse 13.2 x86_64

94.1%

none

5.9%

8663<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8663>

0.0%

none

100.0%

4926<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4926>

Automated Build Testing: master branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4954>

Runtime: master branch

Multiple Environments

66.7%

none

0.0%

none

0.0%

none

66.7%

Total: 27

Test Case Status Report

Status

Count

FAILED

25

IDLE

3

PASSED

2175

Total: 2203

[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,2175&chxt=y&chxr=0,0,2175,363&chd=t:&chd=t:25,3,2175&chco=FF9933|990066|00FF00&chdl=FAILED(25)+1%25|IDLE(3)+0%25|PASSED(2175)+99%25]

Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID

Summary (2 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=7880&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%208124&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

ADT

8124<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8124>

Fail to install sdk ext on i686 host

Medium+

Randy Witt

Yi Zhao

2.0.1

NEW

New (Never tested)

2015-08-07

Toaster

7880<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7880>

Toaster uses the same /tmp dir across releases

Medium+

brian avery

Mihail Stanciu

2.1

IN PROGRESS IMPLEMENTATION

New (Never tested)

2015-06-11

Other Bugs found during QA Test
ID

Summary (15 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=6584&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%207054&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%208125&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%208148&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%208308&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%208312&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%208448&field0-0-7=bug_id&type0-0-7=equals&value0-0-7=%208579&field0-0-8=bug_id&type0-0-8=equals&value0-0-8=%208303&field0-0-9=bug_id&type0-0-9=equals&value0-0-9=%208028&field0-0-10=bug_id&type0-0-10=equals&value0-0-10=%208444&field0-0-11=bug_id&type0-0-11=equals&value0-0-11=%207772&field0-0-12=bug_id&type0-0-12=equals&value0-0-12=%208663&field0-0-13=bug_id&type0-0-13=equals&value0-0-13=%208453&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

---

8028<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8028>

Garbage in SDK manifest file

Medium+

Paul Eggleton

Bogdan Alexandru Voiculescu

2.0.1

IN PROGRESS REVIEW

---

2015-07-17

OE-Core

8444<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8444>

WORKDIR/installed_pkgs.txt should be deleted after use

Medium+

Mariano Lopez

Costin

2.1 M2

IN PROGRESS REVIEW

---

2015-10-05

New (Never tested)

8448<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8448>

Audio via HDMI doesn't work

Medium

Jussi Kukkonen

Cristina Agurida

2.1

NEW

New (Never tested)

2015-10-06

Regression (Found by QA test)

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMax

Medium

Saul Wold

Cristina Agurida

2.1

IN PROGRESS DESIGN

Regression (Found by QA test)

2014-07-28

Regression (Used to work)

8308<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8308>

[ADT] Fail to install adt-installer

Medium

Juro Bystricky

2.0

IN PROGRESS IMPLEMENTATION

Regression (Used to work)

2015-09-16

BSPs

8312<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8312>

Bad video quality during playback on media player

Medium

Saul Wold

Cristina Agurida

2.1

REOPENED

Regression (Used to work)

2015-09-16

Eclipse Plugin

8453<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8453>

[eclipse] Eclipse is not responding when i try to create a BB Commander project

Medium

Jose Lamego

Valentin Hangan

Future

NEW

Regression (Used to work)

2015-10-07

8579<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8579>

[eclipse-mars] Errors appear when debug a GTK project

Medium

Todor Minchev

Valentin Hangan

2.1

NEW

Regression (Used to work)

2015-10-26

OE-Core

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

OprofileUI needs to be updated to reflect new oprofile functionality

Medium

Ross Burton

Mihail Stanciu

2.1

ACCEPTED

Regression (Used to work)

2014-12-09

Toaster

7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>

Hiding a sorted column does not revert to default sorting

Medium

Michael Wood

Mihail Stanciu

2.1

IN PROGRESS REVIEW

Regression (Used to work)

2015-01-20

8125<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8125>

Filter does not work as expected after clearing the search results

Medium

Michael Wood

Cristina Agurida

2.1

NEW

Regression (Used to work)

2015-08-07

8148<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8148>

Sorting the content of the Layer/Machines table doesn't work

Medium

Michael Wood

Cristina Agurida

2.1

NEW

Regression (Used to work)

2015-08-11

Unknown (Hard to categorize)

7772<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7772>

bitbake -w option triggers FetchError

Medium+

Richard Purdie

Daniel Istrate

2.1 M1

NEW

Unknown (Hard to categorize)

2015-05-16

OE-Core

8303<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8303>

dpkg-native incorrectly parsed build_alias during configure task

Medium+

Maxin B. John

Mihail Stanciu

2.1

NEW

Unknown (Hard to categorize)

2015-09-15

8663<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8663>

Kernel oops on qemuarm boot

Undecided

Ross Burton

Mihail Stanciu

---

NEW

Unknown (Hard to categorize)

2015-11-06

pTest open bugs
ID

Summary (7 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=8172&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%208171&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%208146&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%208064&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%208471&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%208656&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%208655&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

Automated Runtime Testing

8146<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8146>

ptest - some test cases are failing for acl

Medium

Alexandru Georgescu

Ross Burton

2.1

NEW

---

2015-08-11

8171<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8171>

ptest: testxlate test case failed for apr-util

Medium

Lucian Musat

2.1

NEW

---

2015-08-17

8172<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8172>

ptest: parted test cases failed.

Medium

Ajay Kumar

Alexandru Georgescu

2.1

REOPENED

---

2015-08-17

8471<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8471>

ptest - some valgrind ptests fail on 2.0.rc1

Medium

Ross Burton

Alexandru Georgescu

2.1

NEW

Regression (Used to work)

2015-10-09

8064<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8064>

ptest fails tracker bug

Medium+

Ross Burton

Alexandru Georgescu

2.1 M3

NEW

---

2015-07-28

8655<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8655>

ptest - two openssl ptests fail on 2.0.rc3

Undecided

Ross Burton

Cristina Agurida

---

NEW

Regression (Used to work)

2015-11-06

8656<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8656>

ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3

Undecided

Armin Kuster

Cristina Agurida

---

NEW

Regression (Used to work)

2015-11-06

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones
ID

P

Summary (2 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=target_milestone&type0-0-0=equals&value0-0-0=1.9&field0-0-1=target_milestone&type0-0-1=equals&value0-0-1=1.9%20M1&field0-0-2=target_milestone&type0-0-2=equals&value0-0-2=1.9%20M2&field0-0-3=target_milestone&type0-0-3=equals&value0-0-3=1.9%20M3&field0-0-4=target_milestone&type0-0-4=equals&value0-0-4=2.0&field0-1-0=priority&type0-1-0=equals&value0-1-0=high&field0-1-1=priority&type0-1-1=equals&value0-1-1=Medium%2B&field0-2-0=bug_severity&type0-2-0=notequals&value0-2-0=enhancement&field0-3-0=bug_status&type0-3-0=notequals&value0-3-0=RESOLVED&field0-4-0=bug_status&type0-4-0=notequals&value0-4-0=VERIFIED>

Assignee

QA

Milestone

Status

cf_regression_type

Created

0

Kernel

8486<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8486>

Medium+

Failed to do_patch for linux-yocto after add a patch by yocto-kernel tool

Leonardo Sandoval Gonzalez

Yi Zhao

2.0

IN PROGRESS REVIEW

Regression (Used to work)

2015-10-12

1

Regards,
AlexG
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20151106/963b14aa/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 5872 bytes
Desc: image003.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20151106/963b14aa/attachment.jpg>