[yocto] Full pass test results for 1.3 RC2

Tue Oct 2 09:04:17 PDT 2012

Hello,

Here are the results for 1.3 M4 RC3 full pass testing. The commit id is: 718eb85806e080d0b165344b272e531ef19421eb.
The following issue are encountered:

-          For the BSPs:

o   For e-menlow the X server is not starting (3091)

o   For FRI2 - connman does not provide a 3g configuration utility (2415), system cannot enter S3 standby mode (2037), there is dmesg PowerButton error (2989) and the system cannot enter S3 standby mode (2037), Windows switching failure (2646), [FRI2]No WiFi section available in connman (3202)

o   For qemu x86_64 images - the zypper refresh fails (2694),

o   For all the boards there is common issue with the Sudoku-savant application (2878) and with the warnings at boot time (2399)

-          For core build system:

o   There are still errors with the do_rootfs fails for lib64-core-image-sato-sdk (2918), there is a small issue with the sstate-cache-management.sh (3116) and there is a problem related to meta-intel BSP creation using yocto-bsp.

-          For ADT

o   There are issues with the lttng (3203) and meta-toolchain-support (3100).

o   There is an issue using the standalone toolchain for ARM and x86 (3201)

-          For HOB:

o   Choosing another toolchain host than x86_64 produces an hob-toolchain error (3199)

o   Improve bblayers-hob.conf (3007)

The build for core-image-sato with pre-fetched sources takes 84 minutes

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Test Result Summary

Component

Target

Status

Comments

p1022ds

GOOD

Sudoku-savant issue (2878)

BSP

Beagleboard

GOOD

Sudoku-savant issue (2878)

Routerstationpro

GOOD

Sudoku-savant issue (2878)

Mpc8315e-rdb

GOOD

Sudoku-savant issue (2878)

eMenlow-sato-sdk

BUGGY

Sudoku-savant issue (2878)
X does not start on E-Menlow bsp (3091)

Blacksand-sato-sdk

GOOD

Sudoku-savant issue (2878)

Sugarbay sato-sdk

GOOD

Sudoku-savant issue (2878)

Crownbay-emgd-sato-sdk

GOOD

Sudoku-savant issue (2878)

FRI2-sato

BUGGY

Live boot from USB fails (2399),
standby issue (2037),
Sudoku-savant build issue (2878),
system dmesg log check issue (2989),
3G issues with connman (2415)
[FRI2]No WiFi section available in connman (3202)

HuronRiver-sato

GOOD

Sudoku-savant issue (2878)

Jasperforest-lsb

GOOD

Sudoku-savant issue (2878), zypper is not installed in core-image-lsb-sdk (3098)

QEMU

Qemuarm

GOOD

Everything runs well

Qemuppc

GOOD

Everything runs well

Qemumips

GOOD

Everything runs well

qemux86

GOOD

Everything runs well

qemux86-64

BUGGY

Zypper issue (2694)

Core build system

BUGGY

incremental RPM generation (3047),
lib64-core-image-sato-sdk fails due to do_rootfs issue (2918)
[multilib]do_rootfs failed for lib32-connman-gnome with ipk (2590)
sstate-cache-management.sh prints some error message when running (3116)

HOB

GOOD

[HOB]toolchain arch in settings is not saved (3199)
Improve bblayers-hob.conf (3007)

ADT

BUGGY

autoreconf run failed on x86-64 gmae-toolchain (3100)
cannot build Hello World Ansi C project using standalone Toolchain for ARM and X86 (3201)
kernel trace type not available in the lttng project (3023)

Stress Testing

GOOD

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing

Distribution Support

GOOD

Everything runs well for Ubuntu 12.04, Ubuntu 12.10 - nightly, OpenSuse 12.1, OpenSuse 12.2 RC2, Fedora 17, CentOs 6.3, Fedora 16

Power and Performance

GOOD

one qemux86 sato build on a Core i7 machine costs 84 minutes with the packages previously fetched.

Compliance

GOOD

Tests on Huron River and BlackSand passed

Build Appliance

GOOD

Everything runs well on VMWare Player (on Ubuntu). The relevant tests were performed also for qemu-kvm on Fedora 17 libvirt and
VMWare Workstation.(Ubuntu)

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

42

0

37

5(2878, 3186, 3159)

0

Routerstationpro Sato-SDK

35

0

34

1(2878)

0

p1022ds-sato-sdk

37

0

36

1(2878)

0

Mpc8315e-rdb Sato-SDK

37

0

36

1(2878)

0

eMenlow Sato-sdk

67

0

35

32(bug 2878,3091)

0

n450 Sato-sdk

67

0

66

1 (bug 2878)

0

Crownbay-Sato-sdk

65

0

62

1(2878)

2(hardware issues to be solved)

FRI2 Sato-sdk

86

0

67

19(2646,2867)

0

HuronRiver Sato-sdk

68

0

67

1(2878)

0

Sugarbay sato-sdk

68

0

67

1(2878)

0

Jasperforest lsb-sdk

34

0

26

8(2878,3098)

0

Qemuarm Sato

31

0

31

0

0

Qemuarm Sato-SDK

36

0

36

0

0

Qemumips Sato

31

0

31

0

0

Qemumips Sato-SDK

36

0

36

0

0

Qemuppc Sato

31

0

31

0

0

Qemuppc Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

30

0

27

3 (bug 2694)

0

Qemux86-64 Sato-SDK

36

0

32

4 (bug 2694)

0

Qemux86 Sato

30

0

30

0

0

Qemux86 Sato-SDK

36

0

36

0

0

Core build system

64

0

59

5 (2918, 3116,3178)

0

HOB

39

0

37

2(3199,3007 )

0

ADT

53

0

30

23(3201, 3203, 3100)

0

Build Appliance

14

0

14

0

0

Total

1109

0

999

108

2

Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2878 pkgconfig is missing from sato-sdk image - installing and then trying to removing it leads to rpm crashes/assertions

Bug 3091 X does not start on E-Menlow bsp

Bug 2037 [fri2] system cannot enter S3 standby mode
Bug 2399 gdk-pixbuf: hundreds of warnings on boot
Bug 2415 connman doesn't provide a 3g configuration utility
Bug 2989 [FRI2] dmesg PowerButton error
Bug 2694 [QEMU-X86_64]zypper refresh fail
Bug 2646 Windows switching failure
Bug 3202 No WiFi section available in connman

Core build system

Bug  3116 sstate-cache-management.sh prints some error message when running
Bug 3178 building a power pc image with a layer created using yocto-bsp fails due to cfg/vfat not available
Bug 2918  lib64-core-image-sato-sdk fails due to do_rootfs issue

ADT

Bug 3100 autoreconf run failed on x86-64 gmae-toolchain
Bug 3201 cannot build Hello World Ansi C project using standalone Toolchain for ARM and X86
Bug 3203 kernel trace type not available in the lttng project

HOB

Bug 3199 Choosing another toolchain host than x86_64 produces an hob-toolchain error
Bug 3007 Improve bblayers-hob.conf

Best regards,
Laurentiu Serban

Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20121002/d11549f7/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 1.3_RC2_FullPass_TR.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 69660 bytes
Desc: 1.3_RC2_FullPass_TR.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20121002/d11549f7/attachment.xlsx>