[yocto] Yocto 1.4.4 QA status report

Mon May 19 08:27:00 PDT 2014

Hello,
Here is the 1.4.4 test report. As 1.4.4 has small updates over 1.4.3, the validation didn’t go through the usual process and was focused on the changes only.
The changes are new BA versions, an eglibc update and OpenSSL updates. So we did  do a FP on Build Appliance, run the ADT tests, run the weekly against Eclipse Plugin and run the Distro Tests against Dylan. There were also some HOB changes so we did run the Weekly for HOB too. Since as mentioned 1.4.4 contains the OpenSSL updates (fixing Hearbleed), we extended our test by running  an exploit to make sure that the fixes work. They were confirmed immediately after.

Issue summary
                - 6344<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6344> - ADT installer - failed to mount proc for QEMU x86 and arm. This basically blocks booting QEMU installed using ADT.
                - 6346<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6346> - ADT installer downloads the toolchain for arm7a instead of the one for arm5a on 1.4.4 build

Distro testing issues
                - #6321<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6321> - fetch failure for xf86-video-omapfb_git.bb - encountered in our Fedora 20.
                - #6323<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6323> - qemu_1.4.0.bb, do_compile task failed on OpenSuse 13.1 distro - this is marked as wontfix and will be mentioned in the release notes. For more details, please see the issue description
                - #6324<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6324> - gcc-cross-initial_4.7.bb, do_compile task failed on OpenSuse 13.1 distro for the same reasons as #6323. Marked as wontfix due to the same reasons mentioned in 6323 body.

The full report is available at: https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4

Testing data
Test type:  Point Release Test
Branch: master
Build name: 1.4.4
 poky commit: 42a5b0cbd1fc316e8b8e3ef1629271619c74b2d3
Eclipse Plugin commit Juno:   dc9a609c68fe4a6bbbf34d418fd6611489c1d6f7
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.4.4/
Distributions tested: Ubuntu 14.04 64bit, Fedora 20 32bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit
Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2360<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2360>2362<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2362>

ADT: dylan branch

Fedora 20 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

2359<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2359>2361<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2361>

ADT: dylan branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2350<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2350>

Eclipse Plugin: dylan branch

Ubuntu 13.10 x86_64

77.8%

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>5763<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5763>5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

0.0%

none

22.2%

6344<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6344>6346<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6346>

100.0%

2373<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2373>

Hob: dylan branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2363<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2363>

Build Appliance: dylan branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 5

Test Case Status Report

Status

Count

BLOCKED

2

PASSED

263

Total: 265

[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:2,263&chco=FFFF66|00FF00&chl=BLOCKED(2)+1%25|PASSED(263)+99%25]

Bug Status Report

[Bug Status]

ID[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Priority[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Status[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Resolution[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Test Runs[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Description[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Version[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Target Milestone[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

Age (days)[↓]<https://wiki.yoctoproject.org/wiki/WW20_-_2014-05-12_-_Dylan_1.4.4>

5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

Medium

ACCEPTED

2350<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2350>

no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2)

1.5

1.7

243

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>

Low

NEW

2350<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2350>

headless build takes took long

1.6

1.6

105

5763<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5763>

Medium

VERIFIED

FIXED

2350<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2350>

Not available outcome when task is not executed.

unspecified

1.6 M4

104

6344<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6344>

Undecided

ACCEPTED

2350<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2350>

ADT installer - failed to mount proc for QEMU x86 and arm

1.4.4

---

NEW

6346<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6346>

Undecided

NEW

2350<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2350>

ADT installer downloads the toolchain for arm7a instead of the one for arm5a

1.4.4

---

NEW

Total: 5

Distro Testing results:
We have run the following distro tests against 1.4.4. The issues found were explained in the issue summary:

BRANCH

dylan

COMMIT

42a5b0cbd1fc316e8b8e3ef1629271619c74b2d3

RELEASE

1.4.4

Ubuntu 14.04 LTS

* nighlty-world

Not run, since will fail due to 6321 (initially ron on Fedora 20)

* buildtools

Failed - ERROR: Nothing PROVIDES 'buildtools-tarball'

* nightly-arm

Failed - 6321

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

Fedora 20

* nighlty-world

Failed - 6321

* buildtools

Failed - ERROR: Nothing PROVIDES 'buildtools-tarball'

* nightly-arm

Failed - 6321

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

CentOS 6.5

* nighlty-world

Not run, since will fail due to 6321 (initially ron on Fedora 20)

* buildtools

Failed - ERROR: Nothing PROVIDES 'buildtools-tarball'

* nightly-arm

Failed - 6321

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

OpenSuse 13.1

* nighlty-world

Not run, since will fail due to 6321 (initially ron on Fedora 20)

* buildtools

Failed - ERROR: Nothing PROVIDES 'buildtools-tarball'

* nightly-arm

Failed - 6323, 6321

* nightly-multilib

Failed - 6324

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140519/8a0c056d/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image007.jpg
Type: image/jpeg
Size: 9011 bytes
Desc: image007.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140519/8a0c056d/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image008.jpg
Type: image/jpeg
Size: 11796 bytes
Desc: image008.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140519/8a0c056d/attachment-0001.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image009.png
Type: image/png
Size: 520 bytes
Desc: image009.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140519/8a0c056d/attachment.png>