[yocto] Yocto Full Pass test report for 1.7_M1.rc1

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Thu Jul 3 07:50:07 PDT 2014 

Hello,
Here is the Yocto 1.7_M1.rc1 test report. During this test run we have added two no sets of test runs, focusing on testing the profiling tools on qemuarm<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2557> and qemuppc<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2558>. Among the tests, lttng, latency top, powertop, perf and crosstap are tested.

New issues found during this build:

  *   compiling with the ppc cross toolchain fails #6409<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6409>
  *   building qemux86_64 and qemuppc BSPs created with yocto-bsp fails at parsing: #6482<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6482>
  *   Cannot build a core-image-minimal in Build Appliance: #6495<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6495>
  *   Genericx86-64 cannot mount an USB stick: #6492<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6492>
  *   mpc8315e-rdb BSP cannot mount the sata drive: #6489<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6489>
  *   no permissions when first deploying an app to QEMU and running it: #6500<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6500>

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2553<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2553>2555<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2555>

ADT: master branch

Fedora 20 i686

94.0%

none

6.0%

6490<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6490>

0.0%

none

100.0%

2552<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2552>2554<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2554>

ADT: master branch

Ubuntu 14.04 x86_64

94.0%

none

6.0%

6490<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6490>

0.0%

none

100.0%

2549<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2549>2550<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2550>

BSP/QEMU: master branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

2543<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2543>2544<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2544>

BSP/QEMU: master branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

2551<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2551>2556<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2556>

BSP/QEMU: master branch

generic-x86 on AtomPC

92.8%

none

7.2%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>6492<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6492>5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2512<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2512>2513<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2513>

BSP/QEMU: master branch

genericx86-64 on Sugarbay

92.8%

none

7.2%

6492<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6492>5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2547<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2547>2548<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2548>

BSP/QEMU: master branch

MPC8315e-rdb

96.1%

none

3.9%

6489<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6489>

0.0%

none

100.0%

2545<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2545>2546<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2546>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

2534<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2534>2535<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2535>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

2539<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2539>2541<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2541>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

2537<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2537>2538<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2538>

BSP/QEMU: master branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

2561<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2561>

Eclipse Plugin: master branch

Fedora 20 x86_64

100.0%

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>6500<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6500>

0.0%

none

0.0%

none

100.0%

2536<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2536>2540<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2540>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

92.0%

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>

8.0%

6482<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6482>6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

100.0%

2496<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2496>

Hob: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2506<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2506>

Toaster: master branch

Fedora 20 x86_64

89.2%

none

10.8%

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>6445<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6445>5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226>5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844>

0.0%

none

100.0%

2542<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2542>

Toaster: master branch

Ubuntu 12.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2510<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2510>2511<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2511>

OE-Core: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2508<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2508>2509<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2509>

BitBake: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2564<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2564>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2557<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2557>

Runtime: master branch

qemuarm

40.0%

none

60.0%

6498<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6498>6015<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6015>6016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6016>

0.0%

none

100.0%

2558<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2558>

Runtime: master branch

qemuppc

60.0%

none

40.0%

6498<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6498>6121<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6121>

0.0%

none

100.0%

2533<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2533>

Build Appliance: master branch

qemu-kvm on Ubuntu 12.04 libvirt

66.7%

none

33.3%

6495<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6495>

0.0%

none

100.0%

Total: 22



Test Case Status Report

Status

Count

FAILED

39

PASSED

927

RUNNING

3

Total: 969


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:39,927,3&chco=FF9933|00FF00|0000FF&chl=FAILED(39)+4%25|PASSED(927)+96%25|RUNNING(3)+0%25]



*
Bug Status Report


ID[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Priority[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Status[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Resolution[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Test Runs[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Description[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Version[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Target Milestone[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

Age (days)[↓]<https://wiki.yoctoproject.org/wiki/WW26_-_2014-06-25_-_Full_Pass_Release_1.7_M1.rc1>

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

2551<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2551>

dmesg log errors in Atom-PC

1.3.1

1.7

471

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>

Medium

ACCEPTED

2506<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2506>

same cooker log file name used for several builds

unspecified

1.7 M3

285

5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226>

Medium

NEW

2506<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2506>

in 'variables' API, the 'changed' field seems to return always 'FALSE'

1.5

Future

280

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>

Low

NEW

2561<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2561>

headless build takes took long

1.6

Future

149

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

Medium

NEW

2556<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2556> 2513<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2513>

Cannot wake from suspend state using the USB mouse or keyboard

1.6

1.6

128

5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844>

Medium

ACCEPTED

2506<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2506>

Wrong script_type when task is not executed.

unspecified

1.7 M4

127

6015<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6015>

Medium

WaitForUpstream

2557<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2557>

Lttng does not work on qemuarm due to lttng-tracer module not found

1.6

1.6 M5

97

6016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6016>

Medium

REOPENED

2557<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2557>

CrossTap has issues on running scheduler script against qemuppc

1.6

1.6 M5

97

6121<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6121>

Medium+

REOPENED

2558<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2558>

powertop --calibrate does not work on QemuPPC

1.6

1.6.1

82

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

Medium

ACCEPTED

2540<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2540>

[crosstap] no trace message output on qemuarm

1.6

1.7

72

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>

Medium+

NEEDINFO

2540<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2540>

linux-yocto failed to do_patch after add a patch by yocto-kernel tool

1.6

1.7

71

6445<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6445>

Medium

RESOLVED

NOTABUG

2506<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2506>

The value of the revision field from Package table doesn't start with 'r'

1.6.1

1.6.2

12

6482<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6482>

Medium

NEW

2540<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2540>

yocto-bsp tool: Wrong tune files for qemux86-64 and qemuppc

1.7

1.7

NEW

6489<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6489>

Undecided

NEW

2548<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2548> 2547<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2547>

SATA harddisk error on mpc8315e-rdb

1.7

---

NEW

6490<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6490>

Undecided

NEW

2552<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2552> 2555<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2555> 2554<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2554>2553<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2553>

[ADT-INSTALLER] build yocto-1.7_M1.rc1: ADT ppc cross compilation error

1.7

---

NEW

6492<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6492>

Undecided

NEW

2513<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2513> 2556<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2556>

[Generic x86_64] USB not mounted

1.7

---

NEW

6495<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6495>

Undecided

IN PROGRESS IMPLEMENTATION

2533<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2533>

[Build Appliance] qemu-native: do configure failed

1.7

---

NEW

6498<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6498>

Undecided

NEW

2557<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2557> 2558<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2558>

Latencytop -d does not work for qemuppc and qemuarm

1.7

---

NEW

6500<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6500>

Undecided

NEW

2561<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2561>

no permissions when first deploying an app to QEMU and running it

1.7

---

NEW

Total: 19



Distro Testing
Fedora 20 and Cent OS are all green. As well for Ubuntu with a fail on nightly-world bug #6467. The issue was fixed but wasn’t available for this release. For Opensuse distro all tests are green exepting the world and nightlyx86 which are still running (the 1.7 release overlapped with 1.6.1 point release tests so the tests were delayed by few days.

COMMIT

Poky: 68824d9b8f6e290da078383316b3f4b732585f2b

RELEASE

1.7 RC1

Ubuntu 14.04 LTS



* nighlty-world

FAIL - 6467

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS









Fedora 20



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS









CentOS 6.5



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS









OpenSuse 13.1



* nighlty-world

RUNNING

* buildtools

PASS

* nightly-arm



* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86



* nightly-x86-64



* nightly-x86-64-lsb





Performance Test
On the build performance side, 1.7_M1.rc1 is doing fairly well against 1.6 release.  We have an increase of 20 seconds on building with the rootfs for a core-image-sato. Also, building the actual image with rm_work set improved with an 1:30 minutes on average.
The kernel build time decreased a little bit for about 1 minute.

[cid:image003.png at 01CF96E6.9D824B00]

[cid:image004.png at 01CF96E6.9D824B00]

[cid:image005.png at 01CF96E6.9D824B00]



Regards,
--
AlexandruGeorgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140703/f3435f64/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 9934 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140703/f3435f64/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 462 bytes
Desc: image002.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140703/f3435f64/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 50222 bytes
Desc: image003.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140703/f3435f64/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 45612 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140703/f3435f64/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 48501 bytes
Desc: image005.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140703/f3435f64/attachment-0003.png>

More information about the yocto mailing list