drm-ci: flaky tests for msm driver testing

[Dmitry Baryshkov]

On Tue, Sep 10, 2024 at 08:48:09AM GMT, Vignesh Raman wrote:
> Hi Maintainers,
> 
> On 12/07/24 11:35, Vignesh Raman wrote:
> > Hi Maintainers,
> > 
> > On 28/05/24 11:39, Vignesh Raman wrote:
> > > Hi Maintainers,
> > > 
> > > There are some flaky tests reported for msm driver testing in drm-ci
> > > for the below boards.
> > > 
> > > *)
> > > # Board Name: apq8096-db820c
> > > # IGT Version: 1.28-g0df7b9b97
> > > # Linux Version: 6.9.0-rc7
> > > # Failure Rate: 50
> > > dumb_buffer at create-clear
> > > 
> > > *)
> > > # Board Name: sc7180-trogdor-kingoftown
> > > # IGT Version: 1.28-g0df7b9b97
> > > # Linux Version: 6.9.0-rc7
> > > # Failure Rate: 50
> > > msm_mapping at shadow
> > > msm_shrink at copy-gpu-oom-32
> > > msm_shrink at copy-gpu-oom-8
> > > 
> > > *)
> > > # Board Name: sc7180-trogdor-lazor-limozeen-nots-r5
> > > # IGT Version: 1.28-g0df7b9b97
> > > # Linux Version: 6.9.0-rc7
> > > # Failure Rate: 50
> > > msm_mapping at shadow
> > > 
> > > *)
> > > # Board Name: sdm845-cheza-r3
> > > # IGT Version: 1.28-g0df7b9b97
> > > # Linux Version: 6.9.0-rc7
> > > # Failure Rate: 50
> > > kms_cursor_legacy at basic-flip-after-cursor-atomic
> > > kms_cursor_legacy at basic-flip-after-cursor-legacy
> > > kms_cursor_legacy at basic-flip-after-cursor-varying-size
> > > kms_cursor_legacy at basic-flip-before-cursor-varying-size
> > > kms_cursor_legacy at flip-vs-cursor-atomic-transitions
> > > kms_cursor_legacy at flip-vs-cursor-atomic-transitions-varying-size
> > > kms_cursor_legacy at flip-vs-cursor-varying-size
> > > kms_cursor_legacy at short-flip-after-cursor-atomic-transitions
> > > kms_cursor_legacy at short-flip-after-cursor-atomic-transitions-varying-size
> > > kms_cursor_legacy at short-flip-after-cursor-toggle
> > > kms_cursor_legacy at short-flip-before-cursor-atomic-transitions
> > > kms_cursor_legacy at short-flip-before-cursor-atomic-transitions-varying-size
> > > msm_shrink at copy-gpu-32
> > > msm_shrink at copy-gpu-oom-32
> > > 
> > > Will add these tests in,
> > > drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
> > > drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
> > > drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
> > > drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt
> > > 
> > > (https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/tree/Documentation/gpu/automated_testing.rst#n70)
> > > 
> > > Please could you have a look at these test results and let us know
> > > if you need more information. Thank you.
> > 
> > There are some flaky tests reported for msm driver testing in drm-ci
> > with the recent IGT uprev (https://gitlab.freedesktop.org/drm/misc/kernel/-/commit/0e7f4e6a20d550252c4f355d5a303b1d9c8ff052)
> > 
> > *)
> > # Board Name: sc7180-trogdor-lazor-limozeen-nots-r5
> > # Bug Report: https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
> > # Failure Rate: 100
> > # IGT Version: 1.28-gf13702b8e
> > # Linux Version: 6.10.0-rc5
> > kms_lease at page-flip-implicit-plane
> > 
> > *)
> > # Board Name: sdm845-cheza-r3
> > # Bug Report: https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
> > # Failure Rate: 50
> > # IGT Version: 1.28-gf13702b8e
> > # Linux Version: 6.10.0-rc5
> > kms_cursor_legacy at short-flip-before-cursor-toggle
> > kms_cursor_legacy at flip-vs-cursor-toggle
> > msm/msm_shrink at copy-mmap-oom-8s
> > 
> > The expectation files have been updated with these tests,
> > https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
> > 
> > https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt
> 
> There are some flaky tests reported for msm driver testing in drm-ci with
> the recent IGT uprev.
> 
> # Board Name: sdm845-cheza-r3
> # Failure Rate: 50
> # IGT Version: 1.28-ga73311079
> # Linux Version: 6.11.0-rc2
> kms_lease at page-flip-implicit-plane
> 
> # Board Name: sdm845-cheza-r3
> # Failure Rate: 50
> # IGT Version: 1.28-ga73311079
> # Linux Version: 6.11.0-rc5
> kms_flip at flip-vs-expired-vblank
> 
> The expectation files have been updated with these tests,
> 
> https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt
> 
> Please could you have a look at these test results and let us know if you
> need more information. Thank you.

Thanks for the info. We will discuss this internally.

-- 
With best wishes
Dmitry