[yocto] Fullpass Test Report for Yocto 1.2 M4 RC4 Build

Tue Apr 24 00:51:28 PDT 2012

Hi all
This is the Fullpass Test Report for Yocto 1.2 M4 RC4 build. There are 7 new bugs found. The two critical bugs are pseudo-nativesdk not working correctly on FC16 32bit or OpenSuse 12.1 64bit(bug 2351), and another for hob that is could not launch Hob or run bitbake if sanity network check fail(bug 2361); 3 bugs for Core build system include 2 for multilib, which could not work with -sdk image and ipk buildl, PACKAGE_ARCHS cause wrong packages installed into image. Two new bugs for distribution testing, pseudo-native failed to compile on opensuse12.1 64bit and  core-image-sato-sdk failed to do do_rootfs on fedora17 64bit.
All BSPs and QEMU targets work well without major issue, there are 3 open bugs, CPU utilization is high level after standby on crownbay; I2C_transfer error on eMenlow and connman-property launch with Glib-Gobject-warning on qemux86-64 image.
For ADT, except clutter and the new issue of pseudo-nativesdk , all features work well except the old bug 32bit kernel generated oprofile data file can’t be read by remote 64bit operation.
For Hob, the only issue is bug 2361, which may cause Hob launch fail. For Core build system, all functions could work well except for Multilib.
For Distribution testing, N+1 testing is performed against CentOS/Ubuntu/Opensuse/Fedora. The build issue on Opensuse 12.2 Milestone 2 still exist. so until now, poky build fail on three distributions, they are opensuse12.1 64bit,  Opensuse 12.2 Milestone 2 and  Fedora 17 Alpha.
For Build performance, one qemux86 sato build on a Core i7 machine costs 111 minutes, which is almost the same as the result in 1.2 M4 RC3 build(110 minutes)
Note: The test report is archived @ https://wiki.yoctoproject.org/wiki/Yocto_1.2_Milestone_Test_Report.

Test Summary:
---------------------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

I2C_transfer error

Blacksand

GOOD

Everything runs well

Crownbay-emgd

GOOD

Xorg eat lots of cup's resource after standby;

Sugarbay

GOOD

Everything runs well

Jasperforest-lsb

GOOD

Everything runs well

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Glib-Gobject-warning when launch connman-properties

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

BUGGY

pseudo-nativesdk not working correctly; Glxgears run fail on qemux86/x86-64 block all cases about clutter;32bit kernel generated oprofile data file can not be read by remote 64bit operation

Distribution Support

BUGGY

m4-native do_compile task failed on Opensuse 12.2 Milestone 2;do_rootfs fail on fedora17 64bit;pseudo-native failed to compile on opensuse12.1 64bit

Compliance

GOOD

No regression issue with LTP and POSIX

Core build system

GOOD

lib64 core-sato-sdk build against qemux86 fails at qt4-x11-free;pseudo-native failed to compile on opensuse12.1 64bit

Power/Performance

GOOD

Power consumption of crownbay is 23.837W

Stress

GOOD

Both Crashme and Helltest on Jasperforest; LTP on Beagleboard could pass 24 hours stress testing.

HOB

GOOD

Everything runs well

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

65

0

64

1(bug 310)

0

n450 Sato-SDK

64

0

64

0

0

Crownbay-Sato-SDK

65

0

64

1(bug 1258)

0

Sugarbay Sato-SDK

69

0

69

0

0

Jasperforest lsb-SDK

32

0

32

0

0

Beagleboard Sato-SDK

40

0

40

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

31

0

30

1(bug 2282)

0

Qemux86-64 Sato-SDK

35

0

34

1(bug 2282)

0

Qemux86 Sato

31

0

31

0

0

Qemux86 Sato-SDK

35

0

35

0

0

Qemuarm Sato

30

0

30

0

0

Qemuarm Sato-SDK

35

0

35

0

0

Qemumips Sato

30

0

30

0

0

Qemumips Sato-SDK

35

0

35

0

0

Qemuppc Sato

30

0

30

0

0

Qemuppc Sato-SDK

35

0

35

0

0

ADT

49

0

39

4(bug 1452, 2351)

6(bug 2068 2069)

Core build system

68

2

63

3(bug 2362,2355 )

0

Power & Performance

4

0

4

0

0

Compliance

2

0

2

0

0

Stress

3

0

3

0

0

HOB

38

0

38

0

0

Total

895

2

876

11

6

* You can check the detailed test result in attachment for each target.
** The failed/blocked case number is listed with failed cases’ bug number.

Distribution test
--------------------------------------
Distribution

Host Arch

1.2 M4 rc4 Build

Fedora 16

x86_64

PASS

Fedora 17 Alpha

x86_64

Failed(bug2363)

Ubuntu 11.10

x86_64

PASS

Ubuntu 12.04 Beta 1

x86_64

PASS

Opensuse 12.1

x86_64

Failed(bug2362)

Opensuse 12.2 Milestone 2

x86_64

Failed(bug2201)

Centos 5.6

x86

PASS

Centos 6.2

x86_64

PASS

Commit Information
---------------------------------------
Tree/Branch: denzil
Commit id: 2c3d4f5beee8f57a74244495511b9294df1085ea

Meta branch: master
Commit id: f75f9b6f68473eb0efac802409608f8389be0030

Issue summary
--------------------------------------
Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

1.1 M4

Other

Bug 2282 - Glib-Gobject-warning when launch connman-properties on qemux86-64 sato/sato-sdk image

1.2 M4

Core build system

New! Bug 2355 [multilib] lib64 core-sato-sdk build against qemux86 fails at qt4-x11-free

New! Bug 2356 [multilib] fonts corrupted with ipk build for 32bit connman against qemux86-64

New! Bug 2360 PACKAGE_ARCHS cause wrong packages installed into image

New! Bug 2362 pseudo-native failed to compile on opensuse12.1 64bit

ADT

Bug 1452 32bit kernel generated oprofile data file can not be read by remote 64bit operation

1.3

Bug 2068 Clutter run failed in qemux86/x86-64 using toolchain

1.3

Bug 2069 Clutter run failed in qemux86/qemux86_64 on ubuntu 11.10 x86-64.

1.2 M4

Bug 2299 pseudo-nativesdk: libpseudo.so can not find GLIBC_2.14

1.2 M4

New! Bug 2351 pseudo-nativesdk not working correctly on FC16 32bit or OpenSuse 12.1 64bit

Power & Performance

Power consumption of crownbay is 23.837W.

Build time for a sato image on Core i7 860 machine is 111 minutes. Detailed result on

https://wiki.yoctoproject.org/wiki/Performance_Test

Compliance

LTP result: https://wiki.pokylinux.org/wiki/LTP_result<https://wiki.pokylinux.org/wiki/LTP_result>

POSIX result: https://wiki.pokylinux.org/wiki/Posix_result<https://wiki.pokylinux.org/wiki/Posix_result>

Stress

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing.LTP stress could pass 24 hours testing;Crushme on Beagleboard is not test.

Distribution Support

Bug 2201 m4-native do_compile task failed when building image on opensuse12.2 Milestone2

--

New! Bug 2363 core-image-sato-sdk failed to do do_rootfs on fedora17 64bit

HOB

New! Bug 2361 User could not launch Hob or run bitbake if sanity network check fail

Verified Bugs
-----------------------------------

1. [multilib] lib32/lib64 lsb build failed due to pam.conf missing for recipe at

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2224

2. gcc-cross-initial and libgcc fails to do_patch with x32 build

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2300

3. [yocto-bsp] fails to create bsp with json file

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2222

4. [multilib] core-image-sato ipk build failed due to dependency of lib32-ofono

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2216

5. [multilib] core-image-sato build pass but X not up

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2215

6. [multilib] lib32/lib64 sato build failed due to lack of libc6

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2214
7. No connman icon on top right corner

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2202

8. [routerstationpro] routerstationpro boot failed with 1.2 rc3
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2292
9. Glxgears failed in qemux86-64 on host FC16 x86
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2221

Best Regards,
Hongna
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120424/2d30af2b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.2M4  RC4 detail_testreport_Fullpass.ods
Type: application/oleobject
Size: 27727 bytes
Desc: Yocto 1.2M4  RC4 detail_testreport_Fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120424/2d30af2b/attachment.bin>