[yocto] Fullpass Test Report for Yocto 1.2 M2 RC1 Build

[Xu, Jiajun]

Hi all
This is the fullpass test report for Yocto 1.2 M2 RC1 build. There are 9 new bugs found for this build. A new crownbay image has been built out with Tom¡¯s fixing patches. QA has finished testing against the new image and included the test result for it in this report. There are 3 bugs found for HOB2 ¨C non-GPLv3 could not work; build will fail with a clean working dir; git based recipes could not show up in ¡°package view¡±. X server can not start up on beagleboard with kernel 3.0. x32 build is blocked by inconsistent architecture reported by insane.bbclass. non-GPLv3 image fails to boot up with no root filesystem found. Mulitilb could not work with ipk format while rpm could work. All BSPS and QEMU target could work well without major issue. For build performance, one qemux86 sato build on a Core i7 machine costs 124 minutes, which costs 19% time than the result in 1.2 M1 RC2 build(104 minutes).
Note: The test report is archived @ https://wiki.yoctoproject.org/wiki/Yocto_1.2_M2_RC1_Test_Report

Test Summary:
---------------------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

Beagleboard

BUGGY

X server can not startup; Segmentation fault when running reboot

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

eMenlow

GOOD

Everything runs well

Blacksand

GOOD

Everything runs well

sugarbay_sato-sdk

GOOD

Everything runs well

Jasperforest-lsb

GOOD

Everything runs well

Crownbay

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

¡¡

GOOD

Everything runs well

HOB2

¡¡

BUGGY

non-GPLv3 build not work;git based recipes could not show up in ¡°package view¡±; build will fail with a clean working dir.

Core build system

¡¡

BUGGY

multilib could not work with ipk format;non-GPLv3 image fails to boot up system; insane.bbclass reports error for x32 kernel

Power_&_Performance

¡¡

GOOD

Power consumption of sugarbay and crownbay are 43.74W and 25.89W respectively

Compliance

¡¡

in analysis

Develoeper and QA are working on LTP and POSIX result analysis

Stress

¡¡

GOOD

Both Crashme and Helltest on Jasperforest and both Crashme and LTP on Beagleboard could pass 24 hours stress testing.



¡¡

Critical bugs, more than 50% test cases are blocked

¡¡

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

¡¡

Normal, Major and Critical bugs, and more than 10% test cases failed


Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

64

0

63

1(bug 310)

0

n450 Sato-SDK

64

0

63

1(bug1840)

0

Sugarbay Sato-SDK

68

0

68

0

0

Crownbay Sato-SDK

65

0

64

1(bug 1258)

0

Jasperforest lsb-SDK

33

0

33

0

0

Beagleboard Sato-SDK

40

0

21

2(bug1898)

17

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

30

0

30

0

0

Qemux86-64 Sato-SDK

35

0

35

0

0

Qemux86 Sato

30

0

30

0

0

Qemux86 Sato-SDK

35

0

35

0

0

Qemuarm Sato

30

0

30

0

0

Qemuarm Sato-SDK

35

0

35

0

0

Qemumips Sato

30

0

30

0

0

Qemumips Sato-SDK

35

0

35

0

0

Qemuppc Sato

21

0

21

0

0

Qemuppc Sato-SDK

26

0

26

0

0

Compliance

2

0

2

0

0

Core build system

34

0

30

4(bug 1819
1917,1918)

0

Power_&_Performance

4

0

4

0

0

ADT

6

0

6

0

0

Stress

2

0

2

0

0

Hob2

28

0

27

1(bug 1911)

0

Total

786

0

759

10

17



Commit Information
---------------------------------------
Tree/Branch: Poky/1.2_M2
Commit id: 0f4d99d207b224bb9ce23de00a48f795ae20b3a0
Meta branch: 1.2_M2

Commit id: 9016be4d8005cfff3fedf4aded4600c6e110263a(The new crownbay is build with commit:4b6657ce65e3b15118c663f7b03249560d282cbd)

Issue summary
--------------------------------------
Component

Bug Number

Target

Milestone

System & Core OS

System Usage

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

Bug 1840 - glxgears fail to run on Blacksand

¡¡

Bug 1258 - [crownbay] Xorg eats lots of CPU time after standby

1.1M4

New! Bug 1906 -[QEMU] loses focus in qemux86-64 terminal When I press key [CTRL+L]

1.2 M3

New! Bug 1898-[beagleboard C4] X server can not startup with 3.0 kernel

1.2 M3

New! Bug 1912-[beagleboard C4] Segmentation fault when reboot the system with 3.0 kernel

1.2 M3

Core Build System

New! Bug 1917-[non-GPLv3] image fails to boot up with no root filesystem found

1.2 M3

New! Bug 1918-[x32] insane.bbclass reports error for x32 kernel

1.2 M3

New! Bug 1899-[multilib] do_rootfs failed for lib-connman-gnome with ipk

1.2 M3

Compliance

LTP result: https://wiki.yoctoproject.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

¡¡

HOB2

New! Bug 1903-[HOB] do_rootfs failed with dummy-image against a clean working dir

1.2 M3

New! Bug 1910-[HOB] git recipes not shown in package view due to inconsistent package name

1.2 M3

New! Bug 1911-[HOB] non-GPLv3 build not work

1.2 M3


Power & Performance

Power consumption of sugarbay and crownbay are 43.74W and 25.89W respectively.
Build time for a sato image on Core i7 machine is 124 minutes. Detailed result on https://wiki.yoctoproject.org/wiki/Performance_Test.

¡¡

Stress

Both Crashme and Helltest on Jasperforest and both Crashme and LTP on Beagleboard could pass 24 hours stress testing.

¡¡






Best Regards,

Jiajun


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120119/83570e62/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.2 M2 RC1 detail_testreport_fullpass.ods
Type: application/oleobject
Size: 25672 bytes
Desc: Yocto 1.2 M2 RC1 detail_testreport_fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120119/83570e62/attachment.bin>