Must-Pass Test Suite for KMS drivers

[Maxime Ripard]

Hi Thomas,

On Fri, Oct 28, 2022 at 09:31:38AM +0200, Thomas Zimmermann wrote:
> Am 24.10.22 um 14:43 schrieb maxime at cerno.tech:
> > I've discussing the idea for the past year to add an IGT test suite that
> > all well-behaved KMS drivers must pass.
> > 
> > The main idea behind it comes from v4l2-compliance and cec-compliance,
> > that are being used to validate that the drivers are sane.
> > 
> > We should probably start building up the test list, and eventually
> > mandate that all tests pass for all the new KMS drivers we would merge
> > in the kernel, and be run by KCi or similar.
> > 
> > I did a first pass to create a draft of such a test-suite, which would
> > contain:
> > 
> > igt at core_auth@basic-auth
> > igt at core_auth@getclient-master-drop
> > igt at core_auth@getclient-simple
> > igt at core_auth@many-magics
> > igt at core_getclient
> > igt at core_getstats
> > igt at core_getversion
> > igt at core_hotunplug@hotrebind-lateclose
> > igt at core_hotunplug@hotunbind-rebind
> > igt at core_hotunplug@unbind-rebind
> > igt at core_setmaster
> > igt at core_setmaster_vs_auth
> > igt at device_reset@unbind-reset-rebind
> > igt at drm_read
> > igt at dumb_buffer
> > igt at fbdev
> 
> Maybe we make this test optional? At least sprd decided to not support fbdev
> at all.

I'm not sure we need to make that test optional, or at least, we should
run it all the time, but skip it if there's no fbdev emulation, and not
report it as a failure?

Maxime