[igt-dev] [PATCH i-g-t] tests/vkms: Create a testlist to the vkms DRM driver

[Petri Latvala]

On Tue, Jan 17, 2023 at 07:03:22PM -0300, Maíra Canal wrote:
> The vkms DRM driver is a software-only model of a KMS driver and its
> development is highly based on the current status of the IGT tests. So,
> create a list of the tests that are supported by the vkms DRM driver, in
> order to have a baseline of the tests that should pass when using vkms.
> 
> This way, it will easier to track regressions on the vkms DRM driver, as
> the testlist for the driver will be publicly available.
> 
> Signed-off-by: Maíra Canal <mcanal at igalia.com>
> ---
>  tests/vkms_ci/README        |  20 ++++
>  tests/vkms_ci/vkms.testlist | 231 ++++++++++++++++++++++++++++++++++++
>  2 files changed, 251 insertions(+)
>  create mode 100644 tests/vkms_ci/README
>  create mode 100644 tests/vkms_ci/vkms.testlist
> 
> diff --git a/tests/vkms_ci/README b/tests/vkms_ci/README
> new file mode 100644
> index 00000000..4b0265bf
> --- /dev/null
> +++ b/tests/vkms_ci/README
> @@ -0,0 +1,20 @@
> +This directory contains test lists to be used for vkms's DRM support. The files
> +are passed to piglit with the --test-list|-T parameter directly.
> +
> +The test lists are contained in the IGT repository for several
> +reasons:
> +
> +- The lists stay synchronized with the IGT codebase.
> +- Public availability. Kernel developers can see what tests are run,
> +  and can see what changes are done to the set, when, and why.
> +- Keep track of the features implemented by the vkms DRM driver.

Is this text copied from intel-ci's README? Note to self: Change the
preamble in there...

I don't know how you guys are running tests on vkms, but if you're
using piglit to launch tests, please consider using igt_runner
instead. As for the patch, please make that

 are passed to igt_runner/piglit with the --test-list parameter directly.


Another consideration, if you plan to use "ninja install" tarballs for
deployment the testlist needs to be installed. See
tests/intel-ci/meson.build for examples of that.

With or without the above suggestions, this is
Acked-by: Petri Latvala <petri.latvala at intel.com>


-- 
Petri Latvala

> +
> +=============
> +vkms.testlist
> +=============
> +
> +This test list is meant as a general test suite for the vkms DRM driver,
> +gathering all must-pass tests for the driver.
> +
> +As more features are implemented to the vkms DRM driver, the correspondent
> +tests should be added to this list.
> diff --git a/tests/vkms_ci/vkms.testlist b/tests/vkms_ci/vkms.testlist
> new file mode 100644
> index 00000000..9065d318
> --- /dev/null
> +++ b/tests/vkms_ci/vkms.testlist
> @@ -0,0 +1,231 @@
> +igt at kms_atomic@atomic-invalid-params
> +igt at kms_atomic@crtc-invalid-params
> +igt at kms_atomic@plane-cursor-legacy
> +igt at kms_atomic@plane-immutable-zpos
> +igt at kms_atomic@plane-invalid-params
> +igt at kms_atomic@plane-primary-legacy
> +igt at kms_atomic@test-only
> +igt at kms_atomic_transition@modeset-transition
> +igt at kms_atomic_transition@modeset-transition-fencing
> +igt at kms_atomic_transition@modeset-transition-nonblocking
> +igt at kms_atomic_transition@modeset-transition-nonblocking-fencing
> +igt at kms_atomic_transition@plane-all-modeset-transition
> +igt at kms_atomic_transition@plane-all-transition
> +igt at kms_atomic_transition@plane-all-transition-nonblocking
> +igt at kms_atomic_transition@plane-primary-toggle-with-vblank-wait
> +igt at kms_atomic_transition@plane-use-after-nonblocking-unbind
> +igt at kms_bw@linear-tiling-1-displays-1920x1080p
> +igt at kms_bw@linear-tiling-1-displays-2560x1440p
> +igt at kms_bw@linear-tiling-1-displays-3840x2160p
> +igt at kms_bw@linear-tiling-2-displays-1920x1080p
> +igt at kms_bw@linear-tiling-2-displays-2560x1440p
> +igt at kms_bw@linear-tiling-2-displays-3840x2160p
> +igt at kms_concurrent@pipe-a
> +igt at kms_cursor_crc@cursor-alpha-opaque
> +igt at kms_cursor_crc@cursor-alpha-transparent
> +igt at kms_cursor_crc@cursor-dpms
> +igt at kms_cursor_crc@cursor-offscreen-128x128
> +igt at kms_cursor_crc@cursor-offscreen-128x42
> +igt at kms_cursor_crc@cursor-offscreen-256x256
> +igt at kms_cursor_crc@cursor-offscreen-256x85
> +igt at kms_cursor_crc@cursor-offscreen-32x10
> +igt at kms_cursor_crc@cursor-offscreen-32x32
> +igt at kms_cursor_crc@cursor-offscreen-512x170
> +igt at kms_cursor_crc@cursor-offscreen-512x512
> +igt at kms_cursor_crc@cursor-offscreen-64x21
> +igt at kms_cursor_crc@cursor-offscreen-64x64
> +igt at kms_cursor_crc@cursor-onscreen-128x128
> +igt at kms_cursor_crc@cursor-onscreen-128x42
> +igt at kms_cursor_crc@cursor-onscreen-256x256
> +igt at kms_cursor_crc@cursor-onscreen-256x85
> +igt at kms_cursor_crc@cursor-onscreen-32x10
> +igt at kms_cursor_crc@cursor-onscreen-32x32
> +igt at kms_cursor_crc@cursor-onscreen-512x170
> +igt at kms_cursor_crc@cursor-onscreen-512x512
> +igt at kms_cursor_crc@cursor-onscreen-64x21
> +igt at kms_cursor_crc@cursor-onscreen-64x64
> +igt at kms_cursor_crc@cursor-random-128x128
> +igt at kms_cursor_crc@cursor-random-128x42
> +igt at kms_cursor_crc@cursor-random-256x256
> +igt at kms_cursor_crc@cursor-random-256x85
> +igt at kms_cursor_crc@cursor-random-32x10
> +igt at kms_cursor_crc@cursor-random-32x32
> +igt at kms_cursor_crc@cursor-random-512x170
> +igt at kms_cursor_crc@cursor-random-512x512
> +igt at kms_cursor_crc@cursor-random-64x21
> +igt at kms_cursor_crc@cursor-random-64x64
> +igt at kms_cursor_crc@cursor-rapid-movement-128x128
> +igt at kms_cursor_crc@cursor-rapid-movement-128x42
> +igt at kms_cursor_crc@cursor-rapid-movement-256x256
> +igt at kms_cursor_crc@cursor-rapid-movement-256x85
> +igt at kms_cursor_crc@cursor-rapid-movement-32x10
> +igt at kms_cursor_crc@cursor-rapid-movement-32x32
> +igt at kms_cursor_crc@cursor-rapid-movement-512x170
> +igt at kms_cursor_crc@cursor-rapid-movement-512x512
> +igt at kms_cursor_crc@cursor-rapid-movement-64x21
> +igt at kms_cursor_crc@cursor-rapid-movement-64x64
> +igt at kms_cursor_crc@cursor-size-change
> +igt at kms_cursor_crc@cursor-sliding-128x128
> +igt at kms_cursor_crc@cursor-sliding-128x42
> +igt at kms_cursor_crc@cursor-sliding-256x256
> +igt at kms_cursor_crc@cursor-sliding-256x85
> +igt at kms_cursor_crc@cursor-sliding-32x10
> +igt at kms_cursor_crc@cursor-sliding-32x32
> +igt at kms_cursor_crc@cursor-sliding-512x170
> +igt at kms_cursor_crc@cursor-sliding-512x512
> +igt at kms_cursor_crc@cursor-sliding-64x21
> +igt at kms_cursor_crc@cursor-sliding-64x64
> +igt at kms_cursor_crc@cursor-suspend
> +igt at kms_cursor_edge_walk@left-edge
> +igt at kms_cursor_edge_walk@right-edge
> +igt at kms_cursor_edge_walk@top-bottom
> +igt at kms_cursor_edge_walk@top-edge
> +igt at kms_flip@absolute-wf_vblank
> +igt at kms_flip@absolute-wf_vblank-interruptible
> +igt at kms_flip@basic-flip-vs-dpms
> +igt at kms_flip@basic-flip-vs-modeset
> +igt at kms_flip@basic-flip-vs-wf_vblank
> +igt at kms_flip@basic-plain-flip
> +igt at kms_flip@blocking-absolute-wf_vblank
> +igt at kms_flip@blocking-absolute-wf_vblank-interruptible
> +igt at kms_flip@blocking-wf_vblank
> +igt at kms_flip@busy-flip
> +igt at kms_flip@dpms-off-confusion
> +igt at kms_flip@dpms-off-confusion-interruptible
> +igt at kms_flip@dpms-vs-vblank-race
> +igt at kms_flip@dpms-vs-vblank-race-interruptible
> +igt at kms_flip@flip-vs-absolute-wf_vblank
> +igt at kms_flip@flip-vs-absolute-wf_vblank-interruptible
> +igt at kms_flip@flip-vs-blocking-wf-vblank
> +igt at kms_flip@flip-vs-dpms-off-vs-modeset
> +igt at kms_flip@flip-vs-dpms-off-vs-modeset-interruptible
> +igt at kms_flip@flip-vs-expired-vblank
> +igt at kms_flip@flip-vs-expired-vblank-interruptible
> +igt at kms_flip@flip-vs-panning
> +igt at kms_flip@flip-vs-panning-interruptible
> +igt at kms_flip@flip-vs-rmfb
> +igt at kms_flip@flip-vs-rmfb-interruptible
> +igt at kms_flip@flip-vs-suspend
> +igt at kms_flip@flip-vs-suspend-interruptible
> +igt at kms_flip@flip-vs-wf_vblank-interruptible
> +igt at kms_flip@modeset-vs-vblank-race
> +igt at kms_flip@modeset-vs-vblank-race-interruptible
> +igt at kms_flip@nonblocking-read
> +igt at kms_flip@nonexisting-fb
> +igt at kms_flip@nonexisting-fb-interruptible
> +igt at kms_flip@plain-flip-fb-recreate
> +igt at kms_flip@plain-flip-fb-recreate-interruptible
> +igt at kms_flip@plain-flip-interruptible
> +igt at kms_flip@plain-flip-ts-check
> +igt at kms_flip@plain-flip-ts-check-interruptible
> +igt at kms_flip@single-buffer-flip-vs-dpms-off-vs-modeset
> +igt at kms_flip@single-buffer-flip-vs-dpms-off-vs-modeset-interruptible
> +igt at kms_flip@wf_vblank-ts-check
> +igt at kms_flip@wf_vblank-ts-check-interruptible
> +igt at kms_flip_event_leak@basic
> +igt at kms_getfb@getfb-addfb-different-handles
> +igt at kms_getfb@getfb-handle-closed
> +igt at kms_getfb@getfb-handle-not-fb
> +igt at kms_getfb@getfb-handle-protection
> +igt at kms_getfb@getfb-handle-valid
> +igt at kms_getfb@getfb-handle-zero
> +igt at kms_getfb@getfb-repeated-different-handles
> +igt at kms_getfb@getfb2-handle-closed
> +igt at kms_getfb@getfb2-handle-not-fb
> +igt at kms_getfb@getfb2-handle-protection
> +igt at kms_getfb@getfb2-handle-zero
> +igt at kms_getfb@getfb2-into-addfb2
> +igt at kms_lease@cursor_implicit_plane
> +igt at kms_lease@empty_lease
> +igt at kms_lease@implicit-plane-lease
> +igt at kms_lease@invalid-create-leases
> +igt at kms_lease@lease-uevent
> +igt at kms_lease@lease_again
> +igt at kms_lease@lease_get
> +igt at kms_lease@lease_invalid_connector
> +igt at kms_lease@lease_invalid_crtc
> +igt at kms_lease@lease_invalid_plane
> +igt at kms_lease@lease_revoke
> +igt at kms_lease@lessee_list
> +igt at kms_lease@master-vs-lease
> +igt at kms_lease@multimaster-lease
> +igt at kms_lease@page_flip_implicit_plane
> +igt at kms_lease@possible-crtcs-filtering
> +igt at kms_lease@setcrtc_implicit_plane
> +igt at kms_lease@simple_lease
> +igt at kms_multipipe_modeset@basic-max-pipe-crc-check
> +igt at kms_pipe_crc_basic@bad-source
> +igt at kms_pipe_crc_basic@compare-crc-sanitycheck
> +igt at kms_pipe_crc_basic@disable-crc-after-crtc
> +igt at kms_pipe_crc_basic@nonblocking-crc
> +igt at kms_pipe_crc_basic@nonblocking-crc-frame-sequence
> +igt at kms_pipe_crc_basic@read-crc
> +igt at kms_pipe_crc_basic@read-crc-frame-sequence
> +igt at kms_pipe_crc_basic@suspend-read-crc
> +igt at kms_plane@plane-panning-bottom-right
> +igt at kms_plane@plane-panning-bottom-right-suspend
> +igt at kms_plane@plane-panning-top-left
> +igt at kms_plane@plane-position-covered
> +igt at kms_plane@plane-position-hole
> +igt at kms_plane@plane-position-hole-dpms
> +igt at kms_plane_multiple@tiling-none
> +igt at kms_plane_scaling@planes-downscale-factor-0-25
> +igt at kms_plane_scaling@planes-downscale-factor-0-5
> +igt at kms_plane_scaling@planes-downscale-factor-0-75
> +igt at kms_plane_scaling@planes-scaler-unity-scaling
> +igt at kms_plane_scaling@planes-unity-scaling-downscale-factor-0-25
> +igt at kms_plane_scaling@planes-unity-scaling-downscale-factor-0-5
> +igt at kms_plane_scaling@planes-unity-scaling-downscale-factor-0-75
> +igt at kms_plane_scaling@planes-upscale-20x20
> +igt at kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25
> +igt at kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5
> +igt at kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75
> +igt at kms_plane_scaling@planes-upscale-factor-0-25
> +igt at kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-25
> +igt at kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-5
> +igt at kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-75
> +igt at kms_prop_blob@basic
> +igt at kms_prop_blob@blob-multiple
> +igt at kms_prop_blob@blob-prop-core
> +igt at kms_prop_blob@blob-prop-lifetime
> +igt at kms_prop_blob@blob-prop-validate
> +igt at kms_prop_blob@invalid-get-prop
> +igt at kms_prop_blob@invalid-get-prop-any
> +igt at kms_prop_blob@invalid-set-prop
> +igt at kms_prop_blob@invalid-set-prop-any
> +igt at kms_properties@connector-properties-atomic
> +igt at kms_properties@connector-properties-legacy
> +igt at kms_properties@crtc-properties-atomic
> +igt at kms_properties@crtc-properties-legacy
> +igt at kms_properties@get_properties-sanity-atomic
> +igt at kms_properties@get_properties-sanity-non-atomic
> +igt at kms_properties@invalid-properties-atomic
> +igt at kms_properties@invalid-properties-legacy
> +igt at kms_properties@plane-properties-atomic
> +igt at kms_properties@plane-properties-legacy
> +igt at kms_rmfb@close-fd
> +igt at kms_rmfb@rmfb-ioctl
> +igt at kms_sequence@get-busy
> +igt at kms_sequence@get-forked
> +igt at kms_sequence@get-forked-busy
> +igt at kms_sequence@get-idle
> +igt at kms_sequence@queue-busy
> +igt at kms_sequence@queue-idle
> +igt at kms_vblank@crtc-id
> +igt at kms_vblank@invalid
> +igt at kms_vblank@pipe-a-accuracy-idle
> +igt at kms_vblank@pipe-a-query-busy
> +igt at kms_vblank@pipe-a-query-forked
> +igt at kms_vblank@pipe-a-query-forked-busy
> +igt at kms_vblank@pipe-a-query-idle
> +igt at kms_vblank@pipe-a-ts-continuation-dpms-suspend
> +igt at kms_vblank@pipe-a-ts-continuation-idle
> +igt at kms_vblank@pipe-a-ts-continuation-suspend
> +igt at kms_vblank@pipe-a-wait-busy
> +igt at kms_vblank@pipe-a-wait-forked
> +igt at kms_vblank@pipe-a-wait-forked-busy
> +igt at kms_vblank@pipe-a-wait-idle
> +igt at kms_writeback@writeback-check-output
> +igt at kms_writeback@writeback-fb-id
> +igt at kms_writeback@writeback-invalid-parameters
> +igt at kms_writeback@writeback-pixel-formats
> -- 
> 2.39.0
>