[yocto] 1.1.2 Full Pass consolidated Test Report

[Serban, Laurentiu]

Hello,
Here are the results for the full pass testing on 1.1.2 release.

Issues:
Crownbay image was copied to the wrong folder which we didn’t find and had no response from anybody, so all cases on crownbay are blocked. LTP on sugarbay is still running.
                FRI2 sato image was not created so FRI2 tests were blocked.

Summary:
There were 5 open bugs, three of them  were for core build system , they are lib64 sato image build failed due to non-existent tasks, core-image-sato ipk build failed due to dependency of lib32-ofono and mklibs-native failed to compile fedora17 64bit.  one issue for ADT, qemu launch failed due to not finding GLIBC_2.14, reported as bug 2748 and another is Ioatdma error found in dmesg log on Jasperforest. All these 5 bugs are also in Yocto 1.2  test cycle. For build performance, one qemux86 sato build on a Core i7 machine takes 115 minutes.
For non-intel platforms there is a new bug found for build image with PAM support, reported as bug 2743. This issue has been fixed in master branch but the patches aren't merged into edison.

Commit information
--------------------------------
Tree/Branch: poky/edison
Poky Commit: 8886aee5b9741c05886994967d9ecf420331c600


 　

Critical bugs, more than 50% test cases are blocked

　

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

　

Normal, Major and Critical bugs, and more than 10% test cases failed



Test Result Summary

Component

Target

Status

Comments

BSP

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

eMenlow

GOOD

Vnc server issue (2700)

Blacksand

GOOD

syslog is not started by default in background on bsps

Crownbay-emgd

BLOCK

No image

Sugarbay

GOOD

Everything runs well

FRI2-sato-sdk

BLOCK

No image

HuronRiver-sato-sdk

GOOD

Everything runs well

Jasperforest-lsb

GOOD

Bug 2742 - system dmesg log check issue

QEMU

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

qemux86

BUGGY

Zypper issue (2694)

qemux86-64

BUGGY

Zypper issue (2694)

Core build system

　

BUGGY

Build image with PAM support failed.
Multilib issues (2744, 2747), mklibs compile failure (2746)

HOB

　

GOOD

Everything runs well

Compliance

GOOD

LTP result: https://wiki.pokylinux.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Stress

GOOD

Everything runs well

Distribution Support

GOOD

beecrypt-native failed to compile on Fedora17(final) 64bit

ADT

　

BUGGY

2748 (qemu launch failure)




Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

40

0

40

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

eMenlow Sato-SDK

67

0

66

1(bug 2700)

0

n450 Sato-SDK

71

0

70

1 (bug 2646)

0

Crownbay-Sato-SDK

67

0

0

0

67

FRI2 Sato-SDK

86

0

0

0

86 (bug 2527)

HuronRiver Sato-SDK

61

0

61

0

0

Sugarbay Sato-SDK

68

0

68

0

0

Jasperforest lsb-SDK

32

0

31

1 (2742)

0

Qemuarm Sato

30

0

30

0

0

Qemuarm Sato-SDK

35

0

35

0

0

Qemumips Sato

30

0

30

0

0

Qemumips Sato-SDK

35

0

35

0

0

Qemuppc Sato

30

0

30

0

0

Qemuppc Sato-SDK

35

0

35

0

0

Qemux86-64 Sato

37

0

31

5 (bug 2694)

1 (2694)

Qemux86-64 Sato-SDK

37

0

31

5 (bug 2694)

1 (2694)

Qemux86 Sato

37

0

31

5 (bug 2694)

1 (2694)

Qemux86 Sato-SDK

37

0

31

5 (bug 2694)

1 (2694)

Core build system

20

0

17

3 (2746, 2744, 2747)

0

HOB

26

0

26

0

0

ADT

6

0

5

1 (2748)

0

Total

956



839

27

90



Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2694 [QEMU-X86_64]zypper refresh fail

Bug 2700 cannot reconnect to x11vnc

Bug 2742 ioatdma error happened on jasperforest platform with edison branch

Bug 2646 Windows switching failure

Core build system

Bug 2747  core-image-sato ipk build failed due to dependency of lib32-bluez4/lib32-bluez4/lib32-bluez4

Bug 2746 mklibs-native failed to compile fedora17-X86_64

Bug 2744  lib64 sato image build failed due to nonexistant task
Bug 2743 Useradd command fails after 10 retries with 1.1.2 20120630 build

ADT

Bug 2748 qemu cannot be started



Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120713/01e4db49/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.1.2 detailed_testreport_Full_Pass.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 68760 bytes
Desc: Yocto 1.1.2 detailed_testreport_Full_Pass.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20120713/01e4db49/attachment.xlsx>