Mandatory Test Suite for KMS Drivers?

[Rodrigo Vivi]

On Thu, Mar 03, 2022 at 10:05:07AM +0100, Maxime Ripard wrote:
> Hi,
> 
> Back at XDC we floated the idea of creating a test suite for IGT that we
> expect any KMS driver to pass, similar to what v4l2-compliance and
> cec-compliance provide for v4l2 and CEC respectively.
> 
> I was looking at the list of tests, and it's fairly massive, so it's not
> clear to me what tests we could start this suite with. I can only assume
> all the KMS (but the chamelium ones) and fbdev related ones would be a
> good start?
> 
> What do you think?

I believe we should start with the group of the tests that we know that
are reliably passing today on most of the platforms and then increase
the list as the tests and drivers become more reliable.

For instance, many of these would be candidate to be filtered out for now
https://intel-gfx-ci.01.org/tree/drm-next/index.html?testfilter=kms

compared to the whole view of kms tests:
https://intel-gfx-ci.01.org/tree/drm-next/shards-all.html?testfilter=kms

Thanks,
Rodrigo.

> Maxime