[yocto] Yocto 1.9_M1.rc1 Full Pass Test report

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Thu Jul 2 10:07:03 PDT 2015 

Hello,
Here is the Full Pass test report for YP 1.9_M1.rc1. The full report is available here: https://wiki.yoctoproject.org/wiki/WW26_-_2015-06-25_-_Full_Pass_1.9_M1.rc1.

Highlights:

  *   The BSP testing matrix have been adjusted, we now test on MMAX and NUC boards for genericx86 and genericx86-64. Testing on LSB images was blocked due to no ssh available in the image #7948<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7948>.
  *   New tests have been added for qemuarm64 and qemumips64 for testing  qemu.
  *   BA have been tested, though HOB isn’t supported anymore. One highlight is that it cannot be created a qemuarm64 BSP for example using HOB atm.
  *   Regarding build performance test, we have maintained the same performance against 1.8_M4.
  *   Part of Eclipse-plugin testing  have been blocked due to bug no: 7930. There is a conflict in the plug-in component's versions which prevents the ADT Plug-in from installing correctly. This leads to the yocto menu not appearing so none of the yocto tools can be accessed.
  *   Iptables failed to be built with toolchain sdk - #7889
  *   On Ubuntu, do_package_write_ipk failured on AB for gperf package #7933


Testing data
Test type:  Full Pass Release Test
Branch: master
Build name: 1.9_M1.rc1
poky commit: 18e902b2dc17746af453869bcc1fba4dbae7c94f
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.9_M1.rc1/
Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit
Test Run Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

4068<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4068> 4071<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4071>

ADT: master branch

Fedora 22 i686

64.9%

none

10.1%

7943<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7943> 7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>

25.0%

7943<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7943>

100.0%

4074<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4074> 4075<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4075>

ADT: master branch

Ubuntu 14.04 x86_64

94.0%

none

6.0%

7889<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7889> 7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>

0.0%

none

100.0%

4105<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4105> 4106<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4106>

BSP/QEMU: master branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

4072<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4072> 4073<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4073>

BSP/QEMU: master branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

4057<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4057> 4112<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4112> 4117<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4117>

BSP/QEMU: master branch

genericx86 - on MMAX32bit

59.6%

none

0.7%

7948<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7948>

39.7%

7948<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7948>

100.0%

4113<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4113> 4116<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4116>

BSP/QEMU: master branch

genericx86-64 on MMAX64

100.0%

none

0.0%

none

0.0%

none

100.0%

4058<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4058> 4115<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4115> 4114<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4114>

BSP/QEMU: master branch

genericx86-64 on NUC

63.0%

none

0.6%

7948<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7948>

36.4%

7948<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7948>

100.0%

4069<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4069> 4070<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4070>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

4103<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4103> 4104<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4104>

BSP/QEMU: master branch

P1022ds

98.4%

none

1.6%

7929<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7929>

0.0%

none

100.0%

4053<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4053> 4110<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4110>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

4090<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4090> 4100<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4100>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

4097<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4097> 4098<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4098>

BSP/QEMU: master branch

qemuarm64

100.0%

none

0.0%

none

0.0%

none

100.0%

4092<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4092> 4101<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4101>

BSP/QEMU: master branch

qemumips

100.0%

7896<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7896>

0.0%

none

0.0%

none

100.0%

4095<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4095> 4096<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4096>

BSP/QEMU: master branch

qemumips64

100.0%

7896<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7896>

0.0%

none

0.0%

none

100.0%

4094<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4094> 4102<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4102>

BSP/QEMU: master branch

qemuppc

100.0%

7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236> 7896<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7896>

0.0%

none

0.0%

none

100.0%

4054<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4054> 4111<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4111>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

4052<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4052>

Eclipse Plugin: master branch

Ubuntu 14.10 x86_64

52.9%

none

2.9%

7930<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7930>

44.1%

7930<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7930>

100.0%

4077<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4077> 4078<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4078>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

0.0%

none

100.0%

4048<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4048> 4049<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4049> 4050<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4050> 4051<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4051>

Toaster: master branch

Ubuntu 14.10 x86_64

94.0%

none

6.0%

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 7124<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7124> 5192<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5192> 7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>

0.0%

none

100.0%

4067<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4067>

OE-Core: master branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4062<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4062> 4063<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4063> 4062<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4062>

BitBake: master branch

Ubuntu 14.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4082<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4082>

Automated Build Testing: master branch

CentOS 7 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4080<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4080>

Automated Build Testing: master branch

Fedora 21 x86_64

88.2%

none

11.8%

7934<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7934>

0.0%

none

100.0%

4081<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4081>

Automated Build Testing: master branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4079<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4079>

Automated Build Testing: master branch

Ubuntu 14.10 x86_64

94.1%

none

5.9%

7933<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7933>

0.0%

none

100.0%

4099<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4099>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

4076<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4076>

Build Appliance: master branch

VMWare Player on Ubuntu

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 27




Test Case Status Report

Status

Count

BLOCKED

173

FAILED

41

PASSED

1722

Total: 1936


[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,1722&chxt=y&chxr=0,0,1722,287&chd=t:&chd=t:173,41,1722&chco=FFFF66|FF9933|00FF00&chdl=BLOCKED(173)+9%25|FAILED(41)+2%25|PASSED(1722)+89%25]



Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID

Summary (5 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=7930&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%207933&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%207934&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%207889&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207948&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

ADT

7889<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7889>

Fail to build iptables with toolchain sdk

Medium+

Richard Purdie

Yi Zhao

1.9 M2

NEW

Regression (Used to work)

2015-06-15

BSPs

7948<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7948>

LSB images don't have sshd installed on the image

Undecided

Ross Burton



---

NEW

Regression (Used to work)

2015-07-02

Eclipse Plugin

7930<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7930>

AB-built eclipse-plugin install failure

High

Aníbal Limón

Mihail Stanciu

1.9 M2

IN PROGRESS DESIGN

Regression (Used to work)

2015-06-29

OE-Core

7933<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7933>

do_package_write_ipk failure on AB for gperf package

High

Alejandro Hernandez

Mihail Stanciu

1.9 M2

NEW

Regression (Used to work)

2015-06-30

7934<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7934>

Builds failed due to fetcher failure on AB

High

Ross Burton

Mihail Stanciu

1.9 M2

IN PROGRESS REVIEW

Regression (Used to work)

2015-06-30


Other Bugs found during QA Test (including regressions)
ID

Summary (10 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=7943&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%207896&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%207929&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%205187&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%205192&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%206156&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%207124&field0-0-7=bug_id&type0-0-7=equals&value0-0-7=%207198&field0-0-8=bug_id&type0-0-8=equals&value0-0-8=%207236&field0-0-9=bug_id&type0-0-9=equals&value0-0-9=%207545&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

---

5192<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5192>

non-existent URLs listed in the "Layer index URL" column

Medium

Alexandru Damian



Future

WaitForUpstream

---

2013-09-13

New (Never tested)

7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>

Installing extensible SDK as root should fail earlier with a proper error

Medium

Randy Witt

Yi Zhao

1.9 M1

NEW

New (Never tested)

2015-03-31

Toaster

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>

same cooker log file name used for several builds

Medium

Richard Purdie



1.9

ACCEPTED

New (Never tested)

2013-09-13

Regression (Used to work)

7929<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7929>

[p1022ds] dmesg error: wm8776 1-001a: Unable to configure MCLK ratio 12288000/44100

Medium

Chunrong Guo

Yi Zhao

1.9

NEW

Regression (Used to work)

2015-06-29

OE-Core

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

[crosstap] no trace message output on qemuarm

Medium

Kevin Hao



1.9

ACCEPTED

Regression (Used to work)

2014-04-14

7943<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7943>

Fail to build subversion-native on Fedora 22

Undecided

Richard Purdie

Yi Zhao

---

RESOLVED

FIXED

Regression (Used to work)

2015-07-02

Runtime

7896<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7896>

Weird color for matchbox desktop on qemumips and qemuppc

Medium

Kai Kang

Yi Zhao

1.9 M2

NEW

Regression (Used to work)

2015-06-17

System Startup

7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>

The color of splash screen for qemuppc is strange

Medium

Kevin Hao

Yi Zhao

1.9

NEW

Regression (Used to work)

2015-01-23

Toaster

7124<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7124>

warnings no from build table doesn't match the no of warnings entries in logmessage table for one build

Medium

Alexandru Damian

Ionut Chisanovici

1.9 M1

IN PROGRESS REVIEW

Regression (Used to work)

2015-01-08

7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>

Hiding a sorted column does not revert to default sorting

Medium

Michael Wood

Mihail Stanciu

1.9 M1

IN PROGRESS REVIEW

Regression (Used to work)

2015-01-20



--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150702/9a235471/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 11072 bytes
Desc: image003.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150702/9a235471/attachment.jpg>

More information about the yocto mailing list