drm-ci: flaky tests for i915 driver testing

[Vignesh Raman]

Hi Maintainers,

On 12/07/24 11:22, Vignesh Raman wrote:
> Hi Maintainers,
> 
> On 28/05/24 12:07, Vignesh Raman wrote:
>> Hi Maintainers,
>>
>> There are some flaky tests reported for i915 driver testing in drm-ci 
>> for the below boards.
>>
>> *)
>> # Board Name: asus-C523NA-A20057-coral
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> kms_fb_coherency at memset-crc
>>
>> *)
>> # Board Name: asus-C436FA-Flip-hatch
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> kms_plane_alpha_blend at constant-alpha-min
>>
>> *)
>> # Board Name: hp-x360-12b-ca0010nr-n4020-octopus
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> core_hotunplug at unplug-rescan
>> kms_fb_coherency at memset-crc
>>
>> *)
>> # Board Name: hp-x360-14-G1-sona
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> prime_busy at hang
>>
>> *)
>> # Board Name: dell-latitude-5400-8665U-sarien
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> kms_pm_rpm at modeset-lpsp-stress
>>
>> *)
>> # Board Name: asus-C433TA-AJ0005-rammus
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> i915_hangman at engine-engine-error
>> i915_hangman at gt-engine-hang
>> kms_async_flips at crc
>> kms_universal_plane at cursor-fb-leak
>>
>> Will add these tests in,
>> drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
>> drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt
>> drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt
>> drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt
>> drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt
>> drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt
>>
>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/tree/Documentation/gpu/automated_testing.rst#n70
>>
>> Please could you have a look at these test results and let us know if 
>> you need more information. Thank you.
> 
> There are some flaky tests reported for i915 driver testing in drm-ci 
> with the recent IGT uprev in drm-ci 
> (https://gitlab.freedesktop.org/drm/misc/kernel/-/commit/0e7f4e6a20d550252c4f355d5a303b1d9c8ff052)
> 
> *)
> # Board Name: asus-C433TA-AJ0005-rammus
> # Bug Report: 
> https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
> # Failure Rate: 50
> # IGT Version: 1.28-gf13702b8e
> # Linux Version: 6.10.0-rc5
> kms_sysfs_edid_timing
> i915_hangman at engine-engine-hang
> kms_pm_rpm at modeset-lpsp-stress
> 
> *)
> # Board Name: asus-C436FA-Flip-hatch
> # Bug Report: 
> https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
> # Failure Rate: 50
> # IGT Version: 1.28-gf13702b8e
> # Linux Version: 6.10.0-rc5
> kms_atomic_transition at plane-all-modeset-transition-internal-panels
> 
> The expectation files have been updated with these tests,
> https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
> 
> https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt

There are some flaky tests reported for i915 driver testing in drm-ci 
with the recent IGT uprev in drm-ci.

*)
# Board Name: asus-C433TA-AJ0005-rammus
# Failure Rate: 50
# IGT Version: 1.28-ga73311079
# Linux Version: 6.11.0-rc2
kms_pm_rpm at drm-resources-equal

*)
# Board Name: asus-C523NA-A20057-coral
# Failure Rate: 100
# IGT Version: 1.28-ga73311079
# Linux Version: 6.11.0-rc2
kms_universal_plane at cursor-fb-leak

*)
# Board Name: asus-C436FA-Flip-hatch
# Failure Rate: 100
# IGT Version: 1.28-ga73311079
# Linux Version: 6.11.0-rc2
kms_plane_alpha_blend at constant-alpha-min

# Board Name: asus-C436FA-Flip-hatch
# Failure Rate: 50
# IGT Version: 1.28-ga73311079
# Linux Version: 6.11.0-rc2
kms_async_flips at crc

The expectation files have been updated with these tests,
https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt

https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt

https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt

Please could you have a look at these test results and let us know if 
you need more information. Thank you.

Regards,
Vignesh