[yocto] Full pass test results for 1.3 M4 RC3

[Serban, Laurentiu]

Hello,

Here are the results for 1.3 M4 RC3 full pass testing. The commit id is: e5c3513ca8abb21eb5e9b8c19d1b9199b14ae07c.
The following issue are encountered:

-          For the BSPs:

o   For e-menlow the X server is not starting (3091)

o   For FRI2 - connman does not provide a 3g configuration utility (2415), there is dmesg PowerButton error (2989) and the system cannot enter S3 standby mode (2037)

o   For qemu x86_64 images - the zypper refresh fails

o   For all the boards there is common issue with the Sudoku-savant application (2878) and with the warnings at boot time (2399)

-          For core build system:

o   There are still errors with the do_rootfs for RPM incremental build (3047), with multilib builds with ipk (2590), the do_rootfs fails for lib64-core-image-sato-sdk (2918) and there is a small issue with the sstate-cache-management.sh

-          For ADT

o   There are issues with the lttng (3100) and meta-toolchain-support.

The build for core-image-sato with pre-fetched sources takes 85 minutes


 　

Critical bugs, more than 50% test cases are blocked

　

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

　

Normal, Major and Critical bugs, and more than 10% test cases failed




Test Result Summary

Component

Target

Status

Comments

BSP

Beagleboard

GOOD

Sudoku-savant issue (2878)

Routerstationpro

GOOD

Sudoku-savant issue (2878)

Mpc8315e-rdb

GOOD

Sudoku-savant issue (2878)

eMenlow-sato-sdk

BUGGY

Sudoku-savant issue (2878)
X does not start on E-Menlow bsp (3091)

Blacksand-sato-sdk

GOOD

Sudoku-savant issue (2878)

Crownbay-emgd-sato-sdk

GOOD

Sudoku-savant issue (2878)

FRI2-sato

BUGGY

Live boot from USB fails (2399), standby issue (2037), Sudoku-savant build issue (2878), system dmesg log check issue (2989), 3G issues with connman (2415)

HuronRiver-sato

GOOD

Sudoku-savant issue (2878)

Jasperforest-lsb

GOOD

Sudoku-savant issue (2878), zypper is not installed in core-image-lsb-sdk (3098)

QEMU




Qemuarm

GOOD

Everything runs well

Qemuppc

GOOD

Everything runs well

Qemumips

GOOD

Everything runs well

qemux86

GOOD

Everything runs well

qemux86-64

BUGGY

Zypper issue (2694)

Core build system

　

BUGGY

incremental RPM generation (3047),
lib64-core-image-sato-sdk fails due to do_rootfs issue (2918)
[multilib]do_rootfs failed for lib32-connman-gnome with ipk (2590)
sstate-cache-management.sh prints some error message when running (3116)

HOB

　

GOOD

[HOB]toolchain arch in settings is not saved (2695)

ADT

　

GOOD

autoreconf run failed on x86-64 gmae-toolchain (3100)
Segmentation fault on qemuarm from /usr/lib/libust.so.0 (2577)

Stress Testing

GOOD

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing

Distribution Support

GOOD

Everything runs well for Ubuntu 12.04, Ubuntu 12.10 - nightly, OpenSuse 12.1, OpenSuse 12.2 RC2, Fedora 17, CentOs 6.3, Fedora 16

Power and Performance

GOOD

one qemux86 sato build on a Core i7 machine costs 85 minutes with the packages previously fetched.

Compliance

GOOD

Tests on Huron River and BlackSand passed


Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

42

0

41

1(2878)

0

Routerstationpro Sato-SDK

35

0

34

1(2878)

0

Mpc8315e-rdb Sato-SDK

37

0

36

1(2878)

0

eMenlow Sato-sdk

67

0

35

32(bug 2878,3091)

0

n450 Sato-sdk

67

0

66

1 (bug 2878)

0

Crownbay-Sato-sdk

65

0

62

1(2873)

2(hardware issues to be solved)

FRI2 Sato-sdk

86

0

40

45(2646,2867)

1(no e-sata port available)

HuronRiver Sato-sdk

68

0

67

1(2878)

0

Jasperforest lsb-sdk

34

0

26

8(2878,3098)

0

Qemuarm Sato

31

0

31

0

0

Qemuarm Sato-SDK

36

0

36

0

0

Qemumips Sato

31

0

31

0

0

Qemumips Sato-SDK

36

0

36

0

0

Qemuppc Sato

31

0

31

0

0

Qemuppc Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

30

0

27

3 (bug 2694)

0

Qemux86-64 Sato-SDK

36

0

32

4 (bug 2694)

0

Qemux86 Sato

30

0

30

0

0

Qemux86 Sato-SDK

36

0

36

0

0

Core build system

64

0

58

6 (2918,2590, 3116, 3047)

0

HOB

39

0

38

1(2695)

0

ADT

53

0

51

2(2577, 3100)

0

Total

990

0

880

107

3



Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2878 pkgconfig is missing from sato-sdk image - installing and then trying to removing it leads to rpm crashes/assertions

Bug 3091 X does not start on E-Menlow bsp

Bug 2037 [fri2] system cannot enter S3 standby mode
Bug 2399 gdk-pixbuf: hundreds of warnings on boot
Bug 2415 connman doesn't provide a 3g configuration utility
Bug 2989 [FRI2] dmesg PowerButton error
Bug 2694 [QEMU-X86_64]zypper refresh fail

Core build system

Bug 3047 do_rootfs: ERROR: tried running useradd command 10 times
Bug  3116 sstate-cache-management.sh prints some error message when running
Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk
Bug 2918  lib64-core-image-sato-sdk fails due to do_rootfs issue

ADT

Bug 3100 autoreconf run failed on x86-64 gmae-toolchain
Bug 2577 Segmentation fault on qemuarm from /usr/lib/libust.so.0

HOB

Bug 2695  [HOB]toolchain arch in settings is not saved






Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120924/a91d1525/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 1.3_M4_RC3_FullPass_TR.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 64557 bytes
Desc: 1.3_M4_RC3_FullPass_TR.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120924/a91d1525/attachment.xlsx>