1.5 Beta 1 (1.4.92) Test Results

Thu May 8 10:38:38 PDT 2014

::Scope::

These test results only cover the Wayland and Weston Beta 1.5 (1.4.92) compositor on the DRM (w/libinput) and X11 Backends and the Desktop Shell (w/cairo-glesv2).  They were executed only on specific Intel-based hardware (listed below).  The issues listed in this report are only those that were observed during this testing and do not represent all known Wayland and Weston issues (see <http://bugs.freedesktop.org> for a full list).

::Summary::

Automated test pass rate was 100%.  Automated tests were executed on Fedora 20 OS with systemd 212 from rawhide and kernel 3.13.6 with a software stack composed of all "stable" released dependencies (w/ the exception of libinput).  The automated test suites executed are Wayland Check, Weston Check, and Wayland-fits (core and efl).

Manual test pass rate (84%) improved +15% over Alpha (1.4.91).  Manual tests were executed on two (2) different software stacks for this testing cycle.  Both stacks were executed on Fedora 20 OS with systemd 212 from rawhide and kernel 3.13.6.  In both stacks, libinput from the master branch was used due to its recent debut and lack of sufficient "stable" releases.  The first stack was composed of all "stable" released dependencies and was used to execute the majority of test cases.  The second stack was similar to the first with the exception of unstable Mesa in order to test the new per-output pixel format feature in Weston.

::Platforms::

Sandy Bridge (B810 @ 1.60GHz) Fedora 20 64-bit (for Manual Testing)
Haswell (i7-4770K @ 3.50GHz) Fedora 20 64-bit (for Manual Testing)
Baytrail (E3827 @ 1.74GHz) Fedora 20 64-bit (for Manual Testing)

Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 20 32-bit (for Automated Testing)
Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 20 64-bit (for Automated Testing)
Ivy Bridge (i5-3317U @ 1.7 GHz) Fedora 20 64-bit (for Automated Testing)
Haswell (i7-4500U @ 1.8 GHz) Fedora 20 32-bit (for Automated Testing)
Haswell (i7-4500U @ 1.8 GHz) Fedora 20 64-bit (for Automated Testing)

::Software Stacks::

:::Stable:::

kernel: 3.13.6-200.fc20.x86_64
systemd: 212 (rawhide)
wayland (HEAD) 1.4.92-0-g4a4523f
drm (HEAD) libdrm-2.4.52-0-g46d451c
mesa (HEAD) remotes/origin/10.1-0-g340ebdb
libva (HEAD) libva-1.2.1-0-g88ed1eb
intel-driver (HEAD) 1.2.2-0-g121e70d
cairo (HEAD) heads/1.12-0-g59e2a93
libinput (HEAD) remotes/origin/HEAD-0-g97af5c3
weston (HEAD) 1.4.92-0-gd7d71e8
gstreamer (HEAD) remotes/origin/1.2-0-gf8c6552
gst-plugins-base (HEAD) remotes/origin/1.2-0-gcf5f7cf
gst-plugins-good (HEAD) remotes/origin/1.2-0-g28d65fb
gst-plugins-bad (HEAD) remotes/origin/1.2-0-g4f01875
gst-ffmpeg (HEAD) 1.2.4-0-g72f6cb6
gstreamer-vaapi (HEAD) tags/0.5.8-0-gc9af9a8
efl (HEAD) remotes/origin/HEAD-0-g35c9fb8
elementary (HEAD) remotes/origin/HEAD-0-ge070ce6
wayland-fits (HEAD) remotes/origin/HEAD-0-gf5cb4d2

:::Stable + Mesa Unstable (v10.2+):::

kernel: 3.13.6
systemd: 212 (rawhide)
wayland (master) 1.4.92-0-g4a4523f
drm (master) libdrm-2.4.52-0-g46d451c
mesa (master) heads/master-0-gd55e5a3
libva (master) libva-1.2.1-0-g88ed1eb
intel-driver (master) 1.2.2-0-g121e70d
cairo (1.12) heads/1.12-0-g59e2a93
libinput (master) heads/master-0-g97af5c3
weston (master) 1.4.92-0-gd7d71e8
gstreamer (1.2) heads/1.2-0-gf8c6552
gst-plugins-base (1.2) heads/1.2-0-gcf5f7cf
gst-plugins-good (1.2) heads/1.2-0-g28d65fb
gst-plugins-bad (1.2) heads/1.2-0-g4f01875
gst-ffmpeg (1.2) 1.2.4-0-g72f6cb6
gstreamer-vaapi (master) tags/0.5.8-0-gc9af9a8
efl (efl-1.9) heads/efl-1.9-0-g35c9fb8
elementary (elementary-1.9) heads/elementary-1.9-0-ge070ce6
wayland-fits (master) heads/master-0-gf5cb4d2

::Manual Test Results::

Passed: 84% (167/200)
Failed: 11% (22/200)
NotRun/Blocked: 6% (11/200)

::Automated Test Results::

Passed: 100% (2135/2135)
Failed: 0% (0/2135)

::Issues Encountered (new and pre-existing)::

LibVA h.264 capture/encoding causes Weston to hang (SandyBridge):
	<https://bugs.freedesktop.org/show_bug.cgi?id=69330>
weston-calibrator always pops up on primary display in multi-head setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=69780>
Application always launches on seated output:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73715>
Desktop shell crashes when background-image does not exist:
	<https://bugs.freedesktop.org/show_bug.cgi?id=74689>
Missing desktop-shell toolbar in multi-display:
	<https://bugs.freedesktop.org/show_bug.cgi?id=76761>
[BYT] link training fails with active HDMI->DisplayPort adapter:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77648>
H.264 libva capture corrupted results in rgb565 format:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78199>
Touching launcher tooltip activates launcher icons:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78207>
Touch-drag moves maximized weston client:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78208>
Zoom and touch does not work correctly together with output transform:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78211>
SIGSEGV during change_workspace when output seat is defined:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78349>
Rendering issues when client is dragged to below workspace:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78363>
weston-simple-touch touch does not work when output seated:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78365>
Exit fullscreen, weston client does not redraw window decorations:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78409>
Cursor does not follow mouse/touch:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78411>
SIGABRT during shutdown in multi-head when primary is hot unplugged:
	<https://bugs.freedesktop.org/show_bug.cgi?id=78415>

::Issues Resolved and Verified Since Alpha::

Zoom and touch don't work correctly together (0 transform):
	<https://bugs.freedesktop.org/show_bug.cgi?id=68620>
weston-keyboard always pops-up on primary display in multi-head setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=71015>
Unable to enter numeric chars using weston-keyboard:
	<https://bugs.freedesktop.org/show_bug.cgi?id=71757>
Clients render incorrectly when output is reassigned after original output unplugged:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72946>
Clients receive key events while Weston is locked:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73905>
Weston aborts on touching secondary output after primary unplugged:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73950>
Launching a client when there's a fullscreen surface doesn't show the new client:
	<https://bugs.freedesktop.org/show_bug.cgi?id=74219>
Cropped context menu in multiple workspaces:
	<https://bugs.freedesktop.org/show_bug.cgi?id=76973>
SIGSEGV in handle_output_move:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77290>
SIGSEGV in handle_touch_with_coords:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77341>
Context menu lingers on loosing focus:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77345>
weston-keyboard does not appear until mouse move:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77347>
Weston does not handle LIBINPUT_EVENT_TOUCH_FRAME:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77353>
TTY corruption on SIGQUIT, SIGABRT, SIGKILL, SIGSEGV weston-launch:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77455>
h264 libva capture corrupted results:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77495>
Enter and Tab keys on weston-keyboard does not work:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77496>
SIGSEGV when output seat is specified in weston.ini:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77503>
weston-keyboard applied text styles disappear:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77505>
Weston claims LIBINPUT_EVENT_TOUCH_UP is an unknown event:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77577>

----
Regards,

U. Artie Eoff
Intel Open Source Technology Center

-------------- next part --------------
A non-text attachment was scrubbed...
Name: Wayland 1.5 Beta 1 Manual Test Results.pdf
Type: application/pdf
Size: 129110 bytes
Desc: Wayland 1.5 Beta 1 Manual Test Results.pdf
URL: <http://lists.freedesktop.org/archives/wayland-devel/attachments/20140508/7927578a/attachment-0001.pdf>