[yocto] Fullpass Test Report for Yocto 1.3_M1 20120613 Build

Wed Jun 20 11:58:12 PDT 2012

Hello all,

This is the Fullpass test report for Yocto 1.3 M1 20120613 build on meta-intel platform. QA found one critical issue that is grub-efi-native fails due to help2man script which blocked all cases on FRI2, reported as bug 2527. For Hob, we found two minor issues, they are Incorrect total image size in "View Package" page and can’t delete layer in special situation. For core build system, self-hosted-image are still running, no new issue found till now, For Distribution Support, Yocto build on OpenSuse 12.1 64 bit and  Ubuntu 12.04 64 bit could pass, but beecrypt-native failed to compile on Fedora17(final) 64bit report as 2631.
Other features perform well and no new issue found except the syslog daemon can't startup on qemux86/x86-64 and meta-intel platforms.
For Build performance, one qemux86 sato build on a Core i7 machine costs 95 minutes.

Many thanks to Hongna and Yi for the reports.

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Test Result Summary

Component

Target

Status

Comments

BSP

Beagleboard

BUGGY

Syslogd can’t startup

Routerstationpro

BUGGY

Syslogd can’t startup

Mpc8315e-rdb

BUGGY

Syslogd can’t startup

eMenlow

BUGGY

X server could not successful start up to the Desktop; syslog is not started by default in background on bsps

Blacksand

GOOD

syslog is not started by default in background on bsps

Crownbay-emgd

GOOD

syslog is not started by default in background on bsps

Sugarbay

GOOD

syslog is not started by default in background on bsps

FRI2-sato-sdk

BLOCK

grub-efi-native fails due to help2man script

HuronRiver-sato-sdk

GOOD

syslog is not started by default in background on bsps

Jasperforest-lsb

GOOD

Everything runs well

QEMU

Qemuarm

BUGGY

Syslogd can’t startup

Qemuppc

BUGGY

Syslogd can’t startup

Qemumips

BUGGY

Syslogd can’t startup

qemux86

GOOD

syslog is not started by default in background on bsps

qemux86-64

GOOD

syslog is not started by default in background on bsps

Core build system

BUGGY

three issues for multilib, do_rootfs failed for lib32-connman-gnome with ipk;no provider for lib32/lib64-lsbinitscripts;  failed dependency for util-linux with multilib build;  For yocto-bsp/kernel tools, fail to build core-image-sato when add patch into the kernel; X can't start in sato image built by yocto-bsp tool

HOB

GOOD

Everything runs well

Compliance

GOOD

No regression issue with LTP and POSIX on sugarbay and n450

Stress

GOOD

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing

Distribution Support

BUGGY

beecrypt-native failed to compile on Fedora17(final) 64bit

Power and Performance

GOOD

one qemux86 sato build on a Core i7 machine costs 115 minutes

ADT

BUGGY

32bit kernel generated oprofile data file can not be read by remote 64bit opreport;Segmentation fault on qemuarm from /usr/lib/libust.so.0; glxgears blocked all clutter template cases.

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

42

0

40

2 (bug 2533)

0

Routerstationpro Sato-SDK

35

0

33

2 (bug 2533)

0

Mpc8315e-rdb Sato-SDK

38

0

36

2 (bug 2533)

0

eMenlow Sato-SDK

67

0

41

6 (bug 2507)

20 (bug 2507)

n450 Sato-SDK

66

0

64

2 (bug 2535)

0

Crownbay-Sato-SDK

      67

0

65

2 (bug 2535)

0

FRI2 Sato-SDK

86

0

0

0

86 (bug 2527)

HuronRiver Sato-SDK

70

0

68

2 (bug 2535)

0

Sugarbay Sato-SDK

70

0

68

2 (bug 2535)

0

Jasperforest lsb-SDK

34

0

34

0

0

Qemuarm Sato

32

0

30

2 (bug 2533)

0

Qemuarm Sato-SDK

37

0

35

2 (bug 2533)

0

Qemumips Sato

32

0

30

2 (bug 2533)

0

Qemumips Sato-SDK

37

0

35

2 (bug 2533)

0

Qemuppc Sato

32

0

30

2 (bug 2533)

0

Qemuppc Sato-SDK

37

0

35

2 (bug 2533)

0

Qemux86-64 Sato

32

0

30

2 (bug 2535)

0

Qemux86-64 Sato-SDK

37

0

35

2 (bug 2535)

0

Qemux86 Sato

32

0

30

2 (bug 2535)

0

Qemux86 Sato-SDK

37

0

35

2 (bug 2535)

0

Core build system

51

3

36

11 (2571, 2572, 2589, 2590, 2617, 2619, 2559)

1 (bug 2589)

HOB

38

0

37

1 (bug 2613)

0

ADT

51

0

43

2 (bug 1452  2577)

6(bug 2543)

Compliance

2

0

2

0

0

Stress

2

0

2

0

0

Distribution Support

3

0

2

1(2631)

0

Total

1067

3

896

55

113

Commit Information
---------------------------------------
Tree/Branch: poky/master
Commit id: 7f017cab0b3e4d5a4fc356eccd8eb8429b0531d0

Meta branch: master

Commit id: bd00e28dd54b06a1f01f186be168d3af872f96d4

Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2535 syslog is not started by default in background on bsps

1.3 M2

Bug 2507 X server could not successful start up to the Desktop

1.3 M2

Bug 2509 The 'About' option with connman-properties doesn't display the picture.

1.3 M2

Bug 2508 Fotowall icons appear abnormal on qemumips sato-sdk images with nightly build (20120523-2)

1.3 M2

Other

New! Bug 2527 grub-efi-native fails due to help2man script

Core build system

Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool

1.3 M2

Bug 2587 [yocto-bsp]the default branch is not in remote branch

1.3 M2

Bug 2589 [yocto-kernel] fail to build core-image-sato when add patch into the kernel

1.3 M3

Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk

1.3 M3

Bug 2571 [multilib] no provider for lib32/lib64-lsbinitscripts

1.3 M2

Bug 2572 [multilib] failed dependency for util-linux with multilib build

1.3 M2

New Bug 2617 Incremental RPM image generation fails

New Bug 2619 Archive work directory and export source package fails

ADT

Bug 1452 32bit kernel generated oprofile data file can not be read by remote 64bit operation

1.3

Bug 2577 Segmentation fault on qemuarm from /usr/lib/libust.so.0

1.3

HOB

Bug 2576 [Hob2] wrong image profile selected after template load

1.3 M2

Bug 2581 [Hob2] 'HobNotebook' no attribute 'tabbar' when build failure

1.3 M2

New! Bug 2618[Hob2] Incorrect total image size in "View Package" page

New! Bug 2613[Hob2] Delete layer failed

Distro

New! Bug 2631 beecrypt-native failed to compile on Fedora17(final) 64bit

Best regards,
Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120620/319d2cad/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.3M1 RC1 detail_testreport_FullPass_consolidated.ods
Type: application/oleobject
Size: 32261 bytes
Desc: Yocto 1.3M1 RC1 detail_testreport_FullPass_consolidated.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120620/319d2cad/attachment.bin>