1.5 Alpha 1 (1.4.91) Test Results

Wed Apr 16 10:26:29 PDT 2014

::Scope::

These test results only cover the Wayland and Weston Alpha 1.5 (1.4.91) compositor on the DRM (w/libinput) and X11 Backends and the Desktop Shell (w/cairo-glesv2).  They were executed only on specific Intel-based hardware (listed below).  The issues listed in this report are only those that were observed during this testing and do not represent all known Wayland and Weston issues (see <http://bugs.freedesktop.org> for a full list).

::Summary::

Automated test pass rate was 100%.  Automated tests were executed on Fedora 20 OS with systemd 212 from rawhide and kernel 3.13.6 with a software stack composed of all "stable" released dependencies (w/ the exception of libinput).  The automated test suites executed are Wayland Check, Weston Check, and Wayland-fits (core and efl).

Manual test pass rate was 69%.   Manual tests were executed on two (2) different software stacks for this testing cycle.  Both stacks were executed on Fedora 20 OS with systemd 212 from rawhide and kernel 3.13.6.  In both stacks, libinput from the master branch was used due to its recent debut and lack of sufficient "stable" releases.  The first stack was composed of all "stable" released dependencies and was used to execute the majority of test cases.  The second stack was similar to the first with the exception of unstable Mesa in order to test the new per-output pixel format feature in Weston.

::Platforms::

Sandy Bridge (B810 @ 1.60GHz) Fedora 20 64-bit (for Manual Testing)
Haswell (i7-4770K @ 3.50GHz) Fedora 20 64-bit (for Manual Testing)
Baytrail (E3827 @ 1.74GHz) Fedora 20 64-bit (for Manual Testing)

Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 20 32-bit (for Automated Testing)
Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 20 64-bit (for Automated Testing)
Ivy Bridge (i5-3317U @ 1.7 GHz) Fedora 20 64-bit (for Automated Testing)
Haswell (i7-4500U @ 1.8 GHz) Fedora 20 32-bit (for Automated Testing)
Haswell (i7-4500U @ 1.8 GHz) Fedora 20 64-bit (for Automated Testing)

::Software Stacks::

:::Stable:::

Kernel: 3.13.6
Systemd: 212 (rawhide)
wayland (HEAD) 1.4.91-0-g5e2cfd2
drm (HEAD) libdrm-2.4.52-0-g46d451c
mesa (HEAD) mesa-10.1-0-g4a86465
libva (HEAD) libva-1.2.1-0-g88ed1eb
intel-driver (HEAD) 1.2.2-0-g121e70d
cairo (HEAD) heads/1.12-0-g59e2a93
libinput (HEAD) remotes/origin/HEAD-0-gc5c503c
weston (HEAD) 1.4.91-0-g79d5a6e
gstreamer (HEAD) remotes/origin/1.2-0-g4494f03
gst-plugins-base (HEAD) remotes/origin/1.2-0-gf749519
gst-plugins-good (HEAD) remotes/origin/1.2-0-ga0334e5
gst-plugins-bad (HEAD) remotes/origin/1.2-0-g09b7ee1
gst-ffmpeg (HEAD) heads/1.2-0-gd1ddcb0
gstreamer-vaapi (HEAD) tags/0.5.8-0-gc9af9a8
efl (HEAD) remotes/origin/HEAD-0-g3851769
elementary (HEAD) remotes/origin/HEAD-0-gae8fa54
wayland-fits (HEAD) remotes/origin/HEAD-0-g2a48b9b

:::Stable + Mesa Unstable (v10.2+):::

Kernel: 3.13.6
Systemd: 212 (rawhide)
wayland (master) 1.4.91-0-g5e2cfd2
drm (master) libdrm-2.4.52-0-g46d451c
mesa (master) heads/master-0-g26ae030
libva (master) libva-1.2.1-0-g88ed1eb
intel-driver (master) 1.2.2-0-g121e70d
cairo (1.12) heads/1.12-0-g59e2a93
libinput (master) heads/master-0-gc5c503c
weston (master) 1.4.91-0-g79d5a6e
gstreamer (1.2) heads/1.2-0-g4494f03
gst-plugins-base (1.2) heads/1.2-0-gf749519
gst-plugins-good (1.2) heads/1.2-0-ga0334e5
gst-plugins-bad (1.2) heads/1.2-0-g09b7ee1
gst-ffmpeg (1.2) heads/1.2-0-gd1ddcb0
gstreamer-vaapi (master) tags/0.5.8-0-gc9af9a8
efl (efl-1.9) heads/efl-1.9-0-g3851769
elementary (elementary-1.9) heads/elementary-1.9-0-gae8fa54
wayland-fits (master) heads/master-0-g2a48b9b

::Manual Test Results::

Passed: 69% (141/203)
Failed: 23% (47/203)
NotRun/Blocked: 7% (15/203)

::Automated Test Results::

Passed: 100% (2125/2125)
Failed: 0% (0/2125)

::Issues Encountered (new and pre-existing)::

Zoom and touch don't work correctly together:
	<https://bugs.freedesktop.org/show_bug.cgi?id=68620>
LibVA h.264 capture/encoding causes Weston to hang:
	<https://bugs.freedesktop.org/show_bug.cgi?id=69330>
weston-calibrator always pops up on primary display in multi-head setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=69780>
weston-keyboard always pops-up on primary display in multi-head setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=71015>
Unable to enter numeric chars using weston-keyboard:
	<https://bugs.freedesktop.org/show_bug.cgi?id=71757>
Clients render incorrectly when output is reassigned after original output unplugged:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72946>
Application always displays up on seated output:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73715>
Clients receive key events while Weston is locked:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73905>
Weston aborts on touching secondary output after primary unplugged:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73950>
Launching a client when there's a fullscreen surface doesn't show the new client:
	<https://bugs.freedesktop.org/show_bug.cgi?id=74219>
Missing desktop-shell toolbar in multi-display:
	<https://bugs.freedesktop.org/show_bug.cgi?id=76761>
Cropped context menu in multiple workspaces:
	<https://bugs.freedesktop.org/show_bug.cgi?id=76973>
SIGSEGV in handle_output_move:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77290>
SIGSEGV in handle_touch_with_coords:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77341>
Context menu lingers on loosing focus:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77345>
weston-keyboard does not appear until mouse move:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77347>
Weston does not handle LIBINPUT_EVENT_TOUCH_FRAME:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77353>
TTY corruption on SIGQUIT, SIGABRT, SIGKILL, SIGSEGV weston-launch:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77455>
h264 libva capture corrupted results:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77495>
Enter and Tab keys on weston-keyboard does not work:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77496>
SIGSEGV when output seat is specified in weston.ini:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77503>
weston-keyboard applied text styles disappear:
	<https://bugs.freedesktop.org/show_bug.cgi?id=77505>

----
Regards,

U. Artie Eoff
Intel Open Source Technology Center
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Wayland 1.5 Alpha 1 Test Results.pdf
Type: application/pdf
Size: 137948 bytes
Desc: Wayland 1.5 Alpha 1 Test Results.pdf
URL: <http://lists.freedesktop.org/archives/wayland-devel/attachments/20140416/c0569586/attachment-0001.pdf>