[yocto] Fullpass Test Report for Yocto 1.3_M2 20120712 Build

Thu Jul 19 14:28:46 PDT 2012

Hello,
Here are the results for the Full Pass testing on 1.3 M2 build with commit id: eb0cb7e8234f5d2e5623406e9660be91cf52f65e
For HOB testing the commit id is: 4bd0338972a1a64829734c43501a3a74c510421a
The link for tested images is: http://autobuilder.yoctoproject.org/pub/nightly/20120712-1

Summary: Everything looks ok on qemu (both x86 and non-x86), mpc8315e-rdb-sato-sdk tests are blocked by bug 2775, FRI2 has 4 tests cases failing. For Core Build System there are 16 test cases failed (6 bugs) and 2 test cases blocked (by 2 bugs) - most of the tests cases fail due  to multilb issues. In ADT there are 10 test cases failed (4 bugs)

The build time for sato image on an i7 processor increased to 127m37.820s (aprox 10%)

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Test Result Summary

Component

Target

Status

Comments

BSP

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

BLOCK

System can’t bootup

eMenlow

GOOD

Everything runs well

Blacksand

GOOD

Everything runs well, except for bug 2646 - switch among multi applications and desktop issue

Crownbay-emgd

GOOD

Everything runs well

Sugarbay

GOOD

Everything runs well

FRI2-sato-sdk

BUGGY

Networking issues block 6 test cases. 4 test cases fail

HuronRiver-sato-sdk

GOOD

syslog is not started by default in background on bsps

Jasperforest-lsb

GOOD

Everything runs well

QEMU

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

qemux86

GOOD

Everything runs well except for zypper bug 2694 for sato-sdk image

qemux86-64

GOOD

Everything runs well except for zypper bug 2694 for sato-sdk image

Core build system

BUGGY

Issues for multilib 2571, 2572, 2752, 2771 and 2772. x32 issue 2751. Btrfs image creation fails (2780). BSP creation via JSON file fails (2693). QEMU BSP creation fails (2559)

HOB

GOOD

Everything runs well except for deploying images with HOB and toolchain build (2802 and 2696)

Compliance

GOOD

Sugarbay: Pass; HuronRiver: Pass; Blacksand: Blocked

Stress

GOOD

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing

Distribution Support

GOOD

Everything runs well

Power and Performance

GOOD

one qemux86 sato build on a Core i7 machine costs127m37.820s

ADT

BUGGY

Bug 1908 is reopened - pkg.m4 is missing in package pkgconfig-nativesdk and also 2534 (Glxgears failed on qemuarm/mips/ppc on Ubuntu 11.10 64bit)..
32bit kernel generated oprofile data file can not be read by remote 64bit opreport
Segmentation fault on qemuarm from /usr/lib/libust.so.0

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

42

0

42

0

0

Routerstationpro Sato-SDK

35

0

35

0

0

Mpc8315e-rdb Sato-SDK

37

0

0

0

37

eMenlow Sato-SDK

67

0

67

0

0

n450 Sato-SDK

56

0

55

1(bug 2646)

0

Crownbay-noemgdSato-SDK

      67

0

65

2 (bugs 2364 and 2754)

0

FRI2 Sato-SDK

86

0

76

4 (bugs 2646,2791, 2415 and 2037)

6(bugs 2415 and 2037)

HuronRiver Sato-SDK

70

0

69

1(bug 2791)

0

Sugarbay Sato-SDK

70

0

70

0

0

Jasperforest lsb-SDK

34

0

34

0

0

Qemuarm Sato

32

0

32

0

0

Qemuarm Sato-SDK

37

0

37

0

0

Qemumips Sato

32

0

32

0

0

Qemumips Sato-SDK

37

0

37

0

0

Qemuppc Sato

32

0

32

0

0

Qemuppc Sato-SDK

37

0

37

0

0

Qemux86-64 Sato

32

0

32

0

0

Qemux86-64 Sato-SDK

37

0

37

0

0

Qemux86 Sato

32

0

32

0

0

Qemux86 Sato-SDK

37

0

37

0

0

Core build system

51

0

33

16 (bugs 2571, 2572, 2589, 2780, 2559,2783)

2 (bugs 2780 and 2751)

HOB

38

0

36

2 (bugs 2695 adn2802)

0

ADT

51

0

41

10(bugs  1908 2534,2577,1452)

0

Compliance

3

0

2

0

1 (n-450 image not available)

Stress

2

0

2

0

0

Distribution Support

3

0

3

0

0

Total

1060

0

978

36

56

Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2646 Windows switching failure

Bug 2364 crownbay: bad_page_state with BLDK2 boot

Bug 2754 Cannot boot crownbay image from usb using the hddimg image

Bug 2791 Mpeg video is supported in sugarbay image although it shouldn't

Bug  2415  connman doesn't provide a 3g configuration utility

Bug 2037 [fri2] system cannot enter S3 standby mode

Core build system

Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool

Bug 2783 do_bootdirectdisk fail when build build-appliance-image on Ubuntu11.10 X86_64 platform

Bug 2589 [yocto-kernel] fail to build core-image-sato when add patch into the kernel

Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk

Bug 2571 [multilib] no provider for lib32/lib64-lsbinitscripts

Bug 2572 [multilib] failed dependency for util-linux with multilib build

Bug 2780 btrfs format image build fails due to kernel do_patch failure

ADT

Bug 1452 32bit kernel generated oprofile data file can not be read by remote 64bit operation

Bug 1908 pkg.m4 is missing in package pkgconfig-nativesdk again

Bug 2534 [Regression]Glxgears failed on qemuarm/mips/ppc on Ubuntu 11.10 64bit

Bug 2577 Segmentation fault on qemuarm from /usr/lib/libust.so.0

HOB

Bug 2802 [Hob]Deploy image button not available

Bug 2695 [HOB]Settings are not saved

Best regards,

Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120719/d03a8489/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.3M2 RC1 detail_testreport_FullPass_consolidated.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 458796 bytes
Desc: Yocto 1.3M2 RC1 detail_testreport_FullPass_consolidated.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120719/d03a8489/attachment.xlsx>