[yocto] Full Pass test results for 1.4.2_rc1

Tue Aug 27 06:14:23 PDT 2013

Hello,

Here is the full pass for The Yocto Project, 1.4.2_rc1 build.

Issue summary:

-          For the adt-installer and toolchain sdk with ARM arch, The target arch is changed from armv5te to armv7a-vfp-neon. That make some test cases failed: If we use this cross-compiler to compile a C/C++ program, the program can not run on qemuarm. See bug #5039<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5039> for more details.

-          core-image-sato can not boot up on Fedora 19 due to the SDL issue (known issue in 1.5 too) - #5040<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5040>

-          HOB error when building packages #5053<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5053>. The issue does not reproduces constantly.

Testing data

 Test type: Full pass post release

 Branch: dylan

 Milestone: 1.4.2

 Build name: 2013-08-18

 poky commit: d734ab491a30078d43dee5440c03acce2d251425

 poky commit date:  Fri Aug 16 12:22:25 2013 +0100

 Eclipse Plugin commit: dc9a609c68fe4a6bbbf34d418fd6611489c1d6f7

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/dylan-1.4.2.rc1

 Distributions tested: Fedora 19 32bit, Fedora 18 64bit, Ubuntu 13.04 64bit, Ubuntu 12.04 64bit, CentOS 6.4 64bit, Opensuse 12.3 64bit, opensuse 12.2 64bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

1061<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1061>

ADT: dylan branch

Fedora 19 i686

79.3%

none

9.5%

5039<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5039> 5040<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5040>

11.2%

5039<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5039>

100.0%

1064<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1064>

ADT: dylan branch

Ubuntu 13.04 x86_64

87.1%

none

1.7%

5039<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5039>

11.2%

5039<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5039>

100.0%

1067<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1067>

BSP/QEMU: dylan branch

Atom PC

98.6%

none

1.4%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

0.0%

none

100.0%

1048<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1048>

BSP/QEMU: dylan branch

Beagleboard

97.0%

none

3.0%

3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936> 3937<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3937>

0.0%

none

100.0%

1075<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1075>

BSP/QEMU: dylan branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

1063<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1063>

BSP/QEMU: dylan branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

1051<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1051>

BSP/QEMU: dylan branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

1053<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1053> 1070<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1070>

BSP/QEMU: dylan branch

qemuarm

98.9%

none

1.1%

5036<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5036>

0.0%

none

100.0%

1071<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1071> 1073<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1073>

BSP/QEMU: dylan branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

1072<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1072> 1074<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1074>

BSP/QEMU: dylan branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

1052<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1052>

BSP/QEMU: dylan branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

1076<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1076>

BSP/QEMU: dylan branch

Routerstationpro

100.0%

none

0.0%

none

0.0%

none

100.0%

1078<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1078>

Eclipse Plugin: dylan branch

Ubuntu 13.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1054<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1054>

Meta-yocto: dylan branch

Ubuntu 13.04 x86-64

95.2%

none

4.8%

3908<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3908>

0.0%

none

100.0%

1065<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1065> 1068<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1068>

Hob: dylan branch

Ubuntu 13.04 x86_64

100.0%

5053<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5053>

0.0%

none

0.0%

none

100.0%

1060<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1060>

OE-Core: dylan branch

Multiple environments

100.0%

none

0.0%

none

0.0%

none

100.0%

1045<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1045>

BitBake: dylan branch

Ubuntu 12.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1066<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1066>

Runtime: dylan branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

1062<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1062>

Build Appliance: danny branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

5041<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5041>

0.0%

none

0.0%

none

100.0%

Total: 19

Test Case Status Report

Status

Count

BLOCKED

26

FAILED

18

PASSED

1001

RUNNING

1

Total: 1046

[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:26,18,1001,1&chco=FFFF66|FF9933|00FF00|0000FF&chl=BLOCKED(26)+2%25|FAILED(18)+2%25|PASSED(1001)+96%25|RUNNING(1)+0%25]

Bug Status Report

ID[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Priority[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Status[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Resolution[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Test Runs[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Description[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Version[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Target Milestone[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

Age (days)[↓]<https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4.2_RC1_2013-08-18_build>

3908<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3908>

Medium+

IN PROGRESS REVIEW

1054<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1054>

Kernel panic on qemux86-64 when using runqemu kvm and cpu host

1.4

1.5 M2

180

3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

Medium

ACCEPTED

1048<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1048>

[beagleobard xM] Some error message with usbhs_omap in dmesg

1.4

1.5

173

3937<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3937>

Medium

REOPENED

1048<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1048>

[beagleobard xM] Watchdog doesn't work

1.4

1.5

173

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

1067<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1067>

dmesg log errors in Atom-PC

1.3.1

1.5

160

5036<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5036>

Undecided

RESOLVED

NOTABUG

1053<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1053>

[Test Case 215] system dmesg log check

1.4

---

NEW

5039<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5039>

Undecided

NEW

1061<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1061> 1064<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1064>

[Yocot 1.4.2] [ADT] ARM: target arch change from armv5te to armv7a-vfp-neon

1.4.2

---

NEW

5040<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5040>

Undecided

NEW

1061<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1061>

[Yocto 1.4.2] runqemu: Could not initialize SDL(No available video device) for core-image-sato on Fedora 19

1.4.2

---

NEW

5041<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5041>

Medium+

RESOLVED

FIXED

1062<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1062>

[Yocto 1.4.2] [Build Appliance] An error message for make 3.8.2 when launch hob

1.4.2

1.4.2

NEW

5053<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5053>

Undecided

NEW

1068<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1068>

Error when building packages.

1.4.2

---

NEW

Total: 9

Below you can see the charts for the 1.4.2_rc1.

[cid:image001.png at 01CEA321.E4114B70]

I have extracted the table with the differences between the last two builds, 1.4.1 and 1.4.2 to see the actual numbers:

[cid:image003.png at 01CEA322.ADFD7E90]

-          the build time for core-image-sato improved for System 1 but slightly degraded for System 2.

-          building the kernel degraded for the both systems for a ~30 seconds average.

-          Build size increased with ~ 200MB with rm_work

-          Build size decreased a lot without rm_work, saving 2GB  of storage.

Overall I can say that the performance is stable for the 1.4.2 and we don’t have concerns regarding performance degradation.

I used the data from the performance_test wiki for 1.4.2: https://wiki.yoctoproject.org/wiki/Performance_Test#1.4.1_.26_1.4.2_Build_Time_results.

Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130827/8132c4be/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 11940 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130827/8132c4be/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 462 bytes
Desc: image002.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130827/8132c4be/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 130268 bytes
Desc: image003.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130827/8132c4be/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 20935 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130827/8132c4be/attachment-0002.png>