1.5 Beta 2 (1.4.93) Test Results

Fri May 16 14:42:28 PDT 2014

::Scope::

These test results only cover the Wayland and Weston Beta 2 1.5 (1.4.93) compositor on the DRM (w/libinput) and X11 Backends and the Desktop Shell (w/cairo-glesv2).  They were executed only on specific Intel-based hardware (listed below).  The issues listed in this report are only those that were observed during this testing and do not represent all known Wayland and Weston issues (see <http://bugs.freedesktop.org> for a full list).

::Summary::

Automated test pass rate was 100%.  Automated tests were executed on Fedora 20 OS with systemd 212 from rawhide and kernel 3.13.6 with a software stack composed of all "stable" released dependencies (w/ the exception of libinput).  The automated test suites executed are Wayland Check, Weston Check, and Wayland-fits (core and efl).

Manual test pass rate (85%) improved +1% over Beta 1 (1.4.92).  Manual tests were executed on two (2) different software stacks for this testing cycle.  Both stacks were executed on Fedora 20 OS with systemd 212 from rawhide and kernel 3.13.6.  In both stacks, libinput from the master branch was used due to its recent debut and lack of sufficient "stable" releases.  The first stack was composed of all "stable" released dependencies and was used to execute the majority of test cases.  The second stack was similar to the first with the exception of unstable Mesa in order to test the new per-output pixel format feature in Weston.

::Platforms::

Sandy Bridge (B810 @ 1.60GHz) Fedora 20 64-bit (for Manual Testing)
Haswell (i7-4770K @ 3.50GHz) Fedora 20 64-bit (for Manual Testing)
Baytrail (E3827 @ 1.74GHz) Fedora 20 64-bit (for Manual Testing)

Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 20 32-bit (for Automated Testing)
Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 20 64-bit (for Automated Testing)
Ivy Bridge (i5-3317U @ 1.7 GHz) Fedora 20 64-bit (for Automated Testing)
Haswell (i7-4500U @ 1.8 GHz) Fedora 20 32-bit (for Automated Testing)
Haswell (i7-4500U @ 1.8 GHz) Fedora 20 64-bit (for Automated Testing)

::Software Stacks::

:::Stable:::

kernel: 3.13.6-200.fc20.x86_64
systemd: 212 (rawhide)
wayland (HEAD) 1.4.93-0-g8511544
drm (HEAD) libdrm-2.4.52-0-g46d451c
mesa (HEAD) remotes/origin/10.1-0-g9e1eb6f
libva (HEAD) libva-1.2.1-0-g88ed1eb
intel-driver (HEAD) 1.2.2-0-g121e70d
cairo (HEAD) heads/1.12-0-g59e2a93
libinput (HEAD) remotes/origin/HEAD-0-g97af5c3
weston (HEAD) 1.4.93-0-g7098948
gstreamer (HEAD) remotes/origin/1.2-0-gf8c6552
gst-plugins-base (HEAD) remotes/origin/1.2-0-g83b075a
gst-plugins-good (HEAD) remotes/origin/1.2-0-g5169918
gst-plugins-bad (HEAD) remotes/origin/1.2-0-g4f01875
gst-ffmpeg (HEAD) remotes/origin/1.2-0-g701a833
gstreamer-vaapi (HEAD) tags/0.5.8-0-gc9af9a8
efl (HEAD) remotes/origin/HEAD-0-gd34466c
elementary (HEAD) remotes/origin/HEAD-0-ge070ce6
wayland-fits (HEAD) remotes/origin/HEAD-0-gf5cb4d2

:::Stable + Mesa Unstable (v10.2+):::

kernel: 3.13.6
systemd: 212 (rawhide)
wayland (1.5) 1.4.93-0-g8511544
drm (master) libdrm-2.4.52-0-g46d451c
mesa (10.2) heads/10.2-0-g0b3126b
libva (master) libva-1.2.1-0-g88ed1eb
intel-driver (master) 1.2.2-0-g121e70d
cairo (1.12) heads/1.12-0-g59e2a93
libinput (master) heads/master-0-g97af5c3
weston (1.5) 1.4.93-0-g7098948
gstreamer (1.2) heads/1.2-0-gf8c6552
gst-plugins-base (1.2) heads/1.2-0-g83b075a
gst-plugins-good (1.2) heads/1.2-0-g5169918
gst-plugins-bad (1.2) heads/1.2-0-g4f01875
gst-ffmpeg (1.2) heads/1.2-0-g701a833
gstreamer-vaapi (master) tags/0.5.8-0-gc9af9a8
efl (efl-1.9) heads/efl-1.9-0-gd34466c
elementary (elementary-1.9) heads/elementary-1.9-0-ge070ce6
wayland-fits (master) heads/master-0-gf5cb4d2

::Manual Test Results::

Passed: 85% (173/204)
Failed: 10% (20/204)
NotRun/Blocked: 5% (11/204)

::Automated Test Results::

Passed: 100% (2140/2140)
Failed: 0% (0/2140)

::Issues Encountered (new and pre-existing)::

LibVA h.264 capture/encoding causes Weston to hang (SandyBridge):
	<https://bugs.freedesktop.org/show_bug.cgi?id=69330>
weston-calibrator always pops up on primary display in multi-head setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=69780>
Application always launches on seated output:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73715>
Desktop shell crashes when background-image does not exist:
	<https://bugs.freedesktop.org/show_bug.cgi?id=74689>
Missing desktop-shell toolbar in multi-display:
	<https://bugs.freedesktop.org/show_bug.cgi?id=76761>
[BYT] link training fails with active HDMI->DisplayPort adapter:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77648>
Exit fullscreen, weston client does not redraw window decorations:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78409>
SIGABRT during shutdown in multi-head when primary is hot unplugged:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78415>
Multiple issues with weston-stacking:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78511>
SIGSEGV in Weston during exit animation:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78706>

::Issues Resolved and Verified Since Beta 1::

H.264 libva capture corrupted results in rgb565 format:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78199>
Touching launcher tooltip activates launcher icons:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78207>
Touch-drag moves maximized weston client:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78208>
Zoom and touch does not work correctly together with output transform:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78211>
SIGSEGV during change_workspace when output seat is defined:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78349>
Rendering issues when client is dragged to below workspace:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78363>
weston-simple-touch touch does not work when output seated:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78365>
Cursor does not follow mouse/touch:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78411>
Repaint problems when toggle between fullscreen and other clients:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78501>

----
Regards,

U. Artie Eoff
Intel Open Source Technology Center

-------------- next part --------------
A non-text attachment was scrubbed...
Name: Wayland 1.5 Beta 2 Manual Test Results.pdf
Type: application/pdf
Size: 127250 bytes
Desc: Wayland 1.5 Beta 2 Manual Test Results.pdf
URL: <http://lists.freedesktop.org/archives/wayland-devel/attachments/20140516/e6ec71ff/attachment-0001.pdf>