1.4 Alpha 1 Test Results

[Eoff, Ullysses A]

The following Wayland/Weston 1.4 Alpha 1 (1.3.91) testing was done prior to the recent US holidays.  Apologies for the delay in reporting.  Better late than never ;-).

Manual tests were executed on two (2) different stacks for this testing cycle.  The first stack was composed of all "stable" released components and was used to execute the majority of test cases on a Fedora 19 OS.  The second stack was similar to the first with the exception of unstable Mesa and unstable Systemd components... these unstable parts were necessary to test the new logind, buffer pass-through, and egl swap interval 0 features and executed on a Fedora 20 OS.

Attached is an overview of the manual tests executed and their results.

::Platforms::

Sandy Bridge (B810 @ 1.60GHz) Fedora 19 64-bit
Sandy Bridge (B810 @ 1.60GHz) Fedora 20 64-bit
Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 19 32-bit
Sandy Bridge (i5-2467M CPU @ 1.60GHz) Fedora 19 64-bit
Ivy Bridge (i5-3317U @ 1.7 GHz) Fedora 19 64-bit

::Software Stacks::

:::Stable:::

wayland (HEAD) 1.3.91-0-g01bde63
drm (HEAD) libdrm-2.4.50-0-g4c5de72
mesa (HEAD) remotes/origin/10.0-0-g6f7da01
libva (HEAD) libva-1.2.1-0-g88ed1eb
intel-driver (HEAD) 1.2.1-0-g8f306e3
weston (HEAD) remotes/origin/master-0-gdf42a80
efl (HEAD) remotes/origin/efl-1.8-0-g90c2320
elementary (HEAD) remotes/origin/elementary-1.8-0-ge077db6
wayland-fits (HEAD) remotes/origin/HEAD-0-gcd75d94

:::Stable + Systemd Unstable (v209+) + Mesa Unstable (v10.1+):::

systemd (master) heads/master-0-g63966da
wayland (master) 1.3.91-0-g01bde63
drm (master) libdrm-2.4.50-0-g4c5de72
mesa (master) heads/master-0-ga9bf599
libva (master) libva-1.2.1-0-g88ed1eb
intel-driver (master) 1.2.1-0-g8f306e3
weston (master) heads/master-0-gdf42a80
efl (efl-1.8) heads/efl-1.8-0-g90c2320
elementary (elementary-1.8) heads/elementary-1.8-0-ge077db6
wayland-fits (master) heads/master-0-gcd75d94

::Manual Test Results::

Passed: 73% (105/143)
Failed: 22% (32/143)
NotRun/Blocked: 4% (6/143)

All tests executed on Weston DRM and Desktop Shell (w/cairo-glesv2)
unless otherwise noted.

::Automated Test Results::

Passed: 98% (1248/1272)
Failed: 2% (24/1272)

::Associated Issues Verified (New and Pre-existing)::

Zoom and touch don't work correctly together:
	<https://bugs.freedesktop.org/show_bug.cgi?id=68620>
LibVA h.264 capture/encoding causes Weston to hang:
	<https://bugs.freedesktop.org/show_bug.cgi?id=69330>
weston-calibrator always pops up on primary display in multi-head setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=69780>
weston-keyboard always pops-up on primary display in multi-head setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=71015>
Weston always records from primary display on Multi Head:
	<https://bugs.freedesktop.org/show_bug.cgi?id=71401>
weston-keyboard disappears during text entry:
	<https://bugs.freedesktop.org/show_bug.cgi?id=71750>
desktop-shell dies when closing unlock dialog:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72544>
gcc: fatal error: no input files for weston-simple-im and --disable-clients:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72812>
buffer-count Weston test failing:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72835>
SIGSEGV in Weston run_touch_binding:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72839>
Unable to map touch device to output:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72841>
Weston SEGV or SIGILL while hot-unplug output with actively rendering client:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72845>
weston-subsurfaces flicker on window resize:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72854>
weston-simple-egl fullscreening causes client application flicker:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72863>
Weston crashes on zooming in and out events:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72885>
deskop-shell tooltips should be destroyed when their output is removed (SEGV triggered):
	<https://bugs.freedesktop.org/show_bug.cgi?id=72931>
Incorrect secondary display when primary display is hot unplugged:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72946>
weston-editor entry fields do not respond to touch:
	<https://bugs.freedesktop.org/show_bug.cgi?id=72996>
Weston clients warp between outputs with multiple touch device setup:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73003>
Arrow keys on weston-keyboard do not respond to touch:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73169>
Weston assumes touch device is in touch up state at startup...:
	<https://bugs.freedesktop.org/show_bug.cgi?id=73367>

----
Regards,

U. Artie Eoff
Intel Open Source Technology Center

-------------- next part --------------
A non-text attachment was scrubbed...
Name: Wayland_1.4_alpha1_manual_test_results.pdf
Type: application/pdf
Size: 106714 bytes
Desc: Wayland_1.4_alpha1_manual_test_results.pdf
URL: <http://lists.freedesktop.org/archives/wayland-devel/attachments/20140107/9991b70e/attachment-0001.pdf>