[yocto] Yocto 1.9_M2.rc2 Full Pass test report

Wed Aug 12 08:39:19 PDT 2015

Hello,
Here is the full pass test report for YP 1.9_M2.rc2 release.

*        There are several issues opened against Toaster (see all the Bugs section below) like 7992, 8010, 8011, 8013, 7810.

*        #8033 which asks for root passwd in the bsp images has been fixed, therefore Runtime teting (LTP, POSIX, LSB) could be run.

*        Running Ptest on 32bit MinnowMax  is being blocked by #7971 (In progress review) which prevents installation of the pTest image using EFI based boards. The current opened listed bugs against pTest testing are: 8063, 8062, 8057, 8059, 8021. During this test campaign, no new issues compared with rc1 appeared when running pTest

*        The build performance tests shows no degradations during buildtime.

The full report can be accessed here<https://wiki.yoctoproject.org/wiki/WW33_-_2015-08-10_-_Full_Pass_1.9_M2.rc2>.

Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 1.9_M2.rc2

 poky commit: c75cefe8a382a63f625123c156137782db118f64

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-yocto-1.9_M2.rc2/

 Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit

Test Run Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

4268<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4268>

ADT: master branch

Fedora 22 i686

99.1%

none

0.9%

8123<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8123>

0.0%

none

100.0%

4267<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4267>

ADT: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4285<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4285>

BSP/QEMU: master branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

4280<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4280>

BSP/QEMU: master branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

4274<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4274> 4277<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4277>

BSP/QEMU: master branch

genericx86 - on MMAX32bit

97.2%

none

2.8%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897> 8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012>

0.0%

none

100.0%

4273<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4273>

BSP/QEMU: master branch

genericx86-64 on MMAX64

96.4%

none

3.6%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897>

0.0%

none

100.0%

4275<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4275> 4276<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4276>

BSP/QEMU: master branch

genericx86-64 on NUC

97.2%

none

2.8%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012>

0.0%

none

100.0%

4281<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4281>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

4284<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4284>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

4256<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4256>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

4260<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4260>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

4283<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4283>

BSP/QEMU: master branch

qemuarm64

100.0%

none

0.0%

none

0.0%

none

100.0%

4262<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4262>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

4282<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4282>

BSP/QEMU: master branch

qemumips64

100.0%

none

0.0%

none

0.0%

none

100.0%

4264<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4264>

BSP/QEMU: master branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

4258<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4258>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

4249<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4249>

Eclipse Plugin: master branch

Kepler - Fedora 22 x86_64

93.9%

none

6.1%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>

0.0%

none

100.0%

4266<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4266>

Eclipse Plugin: master branch

Luna on Ubuntu 15.04

93.9%

none

6.1%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>

0.0%

none

100.0%

4239<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4239>

Eclipse Plugin: master branch

Mars on Fedora 22 x86_64

93.9%

none

6.1%

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054> 7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>

0.0%

none

100.0%

4278<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4278> 4279<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4279>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

0.0%

none

100.0%

4241<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4241> 4242<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4242> 4243<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4243> 4244<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4244>

Toaster: master branch

Ubuntu 15.04 x86_64

85.2%

none

10.2%

8011<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8011> 8131<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8131> 7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198> 7992<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7992> 7810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7810> 8148<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8148> 8125<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8125> 8126<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8126>

4.6%

none

100.0%

4238<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4238> 4250<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4250>

OE-Core: master branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4240<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4240>

BitBake: master branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4269<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4269>

Automated Build Testing: master branch

CentOS 7 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4270<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4270>

Automated Build Testing: master branch

Fedora 22 x86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

4272<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4272>

Automated Build Testing: master branch

OpenSuse 13.2 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4271<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4271>

Automated Build Testing: master branch

Ubuntu 15.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

4265<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=4265>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 28

[Bug Status]

Test Case Status Report

Status

Count

BLOCKED

5

FAILED

26

PASSED

1453

Total: 1484

[http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,1453&chxt=y&chxr=0,0,1453,242&chd=t:&chd=t:5,26,1453&chco=FFFF66|FF9933|00FF00&chdl=BLOCKED(5)+0%25|FAILED(26)+2%25|PASSED(1453)+98%25]

Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID

Summary (5 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=7810&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%207992&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%207996&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%208011&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%208012&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

BSPs

8012<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8012>

connection errors on genericx86-64-lsb on NUC

Medium+

Darren Hart

Cristina Agurida

1.9 M2

NEW

New (Never tested)

2015-07-15

Eclipse Plugin

7996<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7996>

Create a new BitBake commander project failed

Medium+

Todor Minchev

Valentin Hangan

1.9 M3

NEW

---

2015-07-14

Toaster

7992<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7992>

Package details page throws an error

High

Alexandru Damian

Cristina Agurida

1.9 M2

IN PROGRESS REVIEW

---

2015-07-14

7810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7810>

The Toaster directory structure does not expand / collapse

Medium+

Michael Wood

Cristina Agurida

1.9 M2

ACCEPTED

---

2015-05-27

8011<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8011>

Sorting columns breaks Toaster

Medium+

Alexandru Damian

Mihail Stanciu

1.9 M2

NEW

Regression (Used to work)

2015-07-15

Other Bugs found during QA Test (including regressions)
ID

Summary (15 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=8021&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%208057&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%208059&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%208062&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%208063&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%206156&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%206584&field0-0-7=bug_id&type0-0-7=equals&value0-0-7=%207054&field0-0-8=bug_id&type0-0-8=equals&value0-0-8=%207198&field0-0-9=bug_id&type0-0-9=equals&value0-0-9=%207897&field0-0-10=bug_id&type0-0-10=equals&value0-0-10=%208123&field0-0-11=bug_id&type0-0-11=equals&value0-0-11=%208125&field0-0-12=bug_id&type0-0-12=equals&value0-0-12=%208126&field0-0-13=bug_id&type0-0-13=equals&value0-0-13=%208131&field0-0-14=bug_id&type0-0-14=equals&value0-0-14=%208148&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>

P

Assignee

QA

Milestone

Status

Resolution

cf_regression_type

Created

---

8021<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8021>

Ptest-runner hangs on certain step

High

Lucian Musat

Cristina Agurida

1.9 M3

NEW

---

2015-07-16

Automated Runtime Testing

8057<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8057>

ptest - E2fsprogs Oprofile Openssh Bash and Kmod ptest packages are skipped

Medium

Ross Burton

Lucian Musat

1.9 M3

NEW

---

2015-07-28

8059<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8059>

ptest - some openssl ptests fail

Medium

Ross Burton

Lucian Musat

1.9

NEW

---

2015-07-28

8062<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8062>

ptest - quilt ptest is broken - has many failures

Medium

Ross Burton

Lucian Musat

1.9

NEW

---

2015-07-28

8063<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8063>

ptest - Valgrind ptest is broken - has many failures

Medium

Dave Lerner

Lucian Musat

1.9

IN PROGRESS IMPLEMENTATION

---

2015-07-28

New (Never tested)

7897<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7897>

Dmesg error BAR 14 and BAR 15 failed to assign in Minnow Max

Low

Cristina Agurida

Cristina Agurida

1.9

IN PROGRESS REVIEW

New (Never tested)

2015-06-17

Regression (Found by QA test)

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMax

Medium

Saul Wold

1.9 M3

REOPENED

Regression (Found by QA test)

2014-07-28

Regression (Used to work)

8123<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8123>

the aarch64 toolchain can not build iptables on i686 host

Undecided

Jessica

---

NEW

Regression (Used to work)

2015-08-07

OE-Core

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

[crosstap] no trace message output on qemuarm

Medium

Kevin Hao

1.9

ACCEPTED

Regression (Used to work)

2014-04-14

7054<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7054>

OprofileUI needs to be updated to reflect new oprofile functionality

Medium

Ross Burton

Mihail Stanciu

1.9 M2

ACCEPTED

Regression (Used to work)

2014-12-09

Toaster

7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>

Hiding a sorted column does not revert to default sorting

Medium

Michael Wood

Mihail Stanciu

1.9 M2

IN PROGRESS REVIEW

Regression (Used to work)

2015-01-20

8125<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8125>

Filter does not work as expected after clearing the search results

Undecided

Alexandru Damian

Cristina Agurida

---

NEW

Regression (Used to work)

2015-08-07

8126<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8126>

Messages are missing when "IMAGE_FSTYPES" field is not properly edited

Undecided

David Reyna

Cristina Agurida

1.9 M4

NEW

Regression (Used to work)

2015-08-07

8131<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8131>

All builds page "Errors"/"Warnings" filters doesn't work

Undecided

Alexandru Damian

Cristina Agurida

---

NEW

Regression (Used to work)

2015-08-10

8148<https://bugzilla.yoctoproject.org/show_bug.cgi?id=8148>

Sorting the content of the Layer/Machines table doesn't work

Undecided

Alexandru Damian

Cristina Agurida

---

NEW

Regression (Used to work)

2015-08-11

pTest results for genericx86-64 on NUC
§  Commit 1.9_M2.rc2: c75cefe8a382a63f625123c156137782db118f64
§  Previous Commit 1.9_M2.rc1: f9ea480e6c26fea46c3011c4e9d0e2de3d5c81b4

Results

Package Name

Tests ran

Passed

Failed

Passrate

Last Passrate

Run difference

valgrind

561

351

210

63.0

63.0

No

lttng-tools

787

781

6

99.0

99.0

No

beecrypt

21

21

0

100.0

100.0

No

diffstat

439

439

0

100.0

100.0

No

strace

30

24

6

80.0

80.0

No

acl

211

197

14

93.0

93.0

No

glib-2.0

215

214

1

100.0

100.0

No

libpcre

3

3

0

100.0

100.0

No

quilt

55

3

52

5.0

5.0

No

pango

11

10

1

91.0

91.0

No

gdbm

11

11

0

100.0

100.0

No

busybox

487

473

14

97.0

97.0

No

dbus-test

15

15

0

100.0

100.0

No

openssl

48

19

29

40.0

40.0

No

libxml2

85

85

0

100.0

100.0

No

udev

139

139

0

100.0

100.0

No

diffutils

12

12

0

100.0

100.0

No

gdk-pixbuf

9

9

0

100.0

100.0

No

tcl

148

145

3

98.0

98.0

No

python

14187

14131

56

100.0

100.0

No

e2fsprogs

1

0

1

0.0

0.0

No

attr

108

108

0

100.0

100.0

No

gawk

282

281

1

100.0

100.0

No

perl

2266

2257

9

100.0

100.0

No

bzip2

6

6

0

100.0

100.0

No

zlib

2

2

0

100.0

100.0

No

Regards,
AlexG
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150812/9e5979c4/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 7789 bytes
Desc: image002.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150812/9e5979c4/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 6092 bytes
Desc: image004.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20150812/9e5979c4/attachment-0001.jpg>