[Wayland-bugs] [Bug 83987] New: Add screenshooting based testing

[bugzilla-daemon at freedesktop.org]

https://bugs.freedesktop.org/show_bug.cgi?id=83987

          Priority: medium
            Bug ID: 83987
          Assignee: wayland-bugs at lists.freedesktop.org
            Blocks: 83980
           Summary: Add screenshooting based testing
          Severity: enhancement
    Classification: Unclassified
                OS: All
          Reporter: ppaalanen at gmail.com
          Hardware: All
            Status: NEW
           Version: unspecified
         Component: weston
        Depends on: 83981
           Product: Wayland

This has several steps:
- add screenshooting to the wl_test extension
- implement it in the test plugin
- make sure it works with the headless backend

In the test framework:
- add a way to fetch screenshots
- add a function to compute a checksum from the screen capture
- add an environment variable, that when set to a directory, all screenshots
will be written there as image files, named based on the test where they came
from

In the applicable tests, mainly those that test that the Pixman and the flavors
of the GL renderer work with the headless backend:
- take a screenshot at the end
- manually check that the recorded image is correct
- hardcode the expected checksum into the code, and make the test fail if the
computed checksum from the screenshot differs

You also needs to make sure that Weston's rendering is completely
deterministic:
- disable random window placement
- ensure the wallpaper is always the same
- ensure the pointer cursors are always the same
- show a fake time in the weston-desktop-shell panel
- ...

The end goal is, that we will be able to easily write more tests, that check
the real output on screen. That tests the whole path from client rendering to
compositor, through compositing, and onto the (fake) screen.

We will also be able to run these tests reliably without any particular
hardware requirements.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freedesktop.org/archives/wayland-bugs/attachments/20140917/e6fde397/attachment.html>