RE: ✗ Fi.CI.IGT: failure for benchmarks: Add VKMS benchmark (rev3)

[Illipilli, TejasreeX]

Hi,

https://patchwork.freedesktop.org/series/129644/ - Re-reported.

Thanks,
Tejasree

-----Original Message-----
From: Kamil Konieczny <kamil.konieczny at linux.intel.com> 
Sent: Tuesday, February 13, 2024 11:38 PM
To: igt-dev at lists.freedesktop.org
Cc: Arthur Grillo <arthurgrillo at riseup.net>; I915-ci-infra at lists.freedesktop.org; LGCI Bug Filing <lgci.bug.filing at intel.com>; Illipilli, TejasreeX <tejasreex.illipilli at intel.com>
Subject: Re: ✗ Fi.CI.IGT: failure for benchmarks: Add VKMS benchmark (rev3)

Hi igt-dev,
On 2024-02-10 at 06:10:41 -0000, Patchwork wrote:
> == Series Details ==
> 
> Series: benchmarks: Add VKMS benchmark (rev3)
> URL   : https://patchwork.freedesktop.org/series/129644/
> State : failure
> 
> == Summary ==
> 
> CI Bug Log - changes from IGT_7709_full -> IGTPW_10660_full 
> ====================================================
> 
> Summary
> -------
> 
>   **FAILURE**
> 
>   Serious unknown changes coming with IGTPW_10660_full absolutely need to be
>   verified manually.
>   
>   If you think the reported changes have nothing to do with the changes
>   introduced in IGTPW_10660_full, please notify your bug team (I915-ci-infra at lists.freedesktop.org) to allow them
>   to document this new failure mode, which will reduce false positives in CI.
> 
>   External URL: 
> https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_10660/index.html
> 
> Participating hosts (8 -> 8)
> ------------------------------
> 
>   No changes in participating hosts
> 
> Possible new issues
> -------------------
> 
>   Here are the unknown changes that may have been introduced in IGTPW_10660_full:
> 
> ### IGT changes ###
> 
> #### Possible regressions ####
> 
>   * igt at kms_flip@absolute-wf_vblank-interruptible at b-hdmi-a2:
>     - shard-rkl:          NOTRUN -> [INCOMPLETE][1]
>    [1]: 
> https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_10660/shard-rkl-3/igt@k
> ms_flip at absolute-wf_vblank-interruptible@b-hdmi-a2.html
> 
>   
> New tests
> ---------
> 
>   New tests have been introduced between IGT_7709_full and IGTPW_10660_full:
> 
> ### New IGT tests (7) ###
> 
>   * igt at kms_plane_scaling@invalid-num-scalers at pipe-d-hdmi-a-1-invalid-num-scalers:
>     - Statuses : 1 pass(s)
>     - Exec time: [0.03] s
> 
>   * igt at kms_setmode@basic at pipe-a-hdmi-a-1-pipe-b-hdmi-a-2:
>     - Statuses : 1 pass(s)
>     - Exec time: [2.26] s
> 
>   * igt at kms_setmode@basic at pipe-b-hdmi-a-1-pipe-a-hdmi-a-2:
>     - Statuses : 1 pass(s)
>     - Exec time: [2.27] s
> 
>   * igt at kms_setmode@invalid-clone-single-crtc-stealing at pipe-a-hdmi-a-1-hdmi-a-2:
>     - Statuses : 1 pass(s)
>     - Exec time: [0.33] s
> 
>   * igt at kms_setmode@invalid-clone-single-crtc-stealing at pipe-b-hdmi-a-1-hdmi-a-2:
>     - Statuses : 1 pass(s)
>     - Exec time: [0.32] s
> 
>   * igt at kms_setmode@invalid-clone-single-crtc at pipe-a-hdmi-a-1-hdmi-a-2:
>     - Statuses : 1 pass(s)
>     - Exec time: [0.04] s
> 
>   * igt at kms_setmode@invalid-clone-single-crtc at pipe-b-hdmi-a-1-hdmi-a-2:
>     - Statuses : 1 pass(s)
>     - Exec time: [0.04] s
> 
>   

These are unrelated to new benchmark adedd, no need for respin.

Regards,
Kamil

> 
> Known issues
> ------------
> 
>   Here are the changes found in IGTPW_10660_full that come from known issues:
> 
> ### IGT changes ###
> 
> #### Issues hit ####
> 
>   * igt at api_intel_bb@object-reloc-keep-cache:
>     - shard-dg2:          NOTRUN -> [SKIP][2] ([i915#8411])
>    [2]: 
> https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_10660/shard-dg2-6/igt@a
> pi_intel_bb at object-reloc-keep-cache.html
> 
> 

...cut...

> 
> Build changes
> -------------
> 
>   * CI: CI-20190529 -> None
>   * IGT: IGT_7709 -> IGTPW_10660
> 
>   CI-20190529: 20190529
>   CI_DRM_14248: c7d234dd2d329f223f56699636248a609dbe2267 @ git://anongit.freedesktop.org/gfx-ci/linux
>   IGTPW_10660: 10660
>   IGT_7709: 17a41dcf1ed551e7a5f2ca88cad055b3f6d67e7e @ 
> https://gitlab.freedesktop.org/drm/igt-gpu-tools.git
> 
> == Logs ==
> 
> For more details see: 
> https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_10660/index.html