[igt-dev] [PATCH i-g-t] .gitlab-ci: Verify undocumented tests in pipeline

[Petri Latvala]

On Wed, Apr 07, 2021 at 01:00:30AM +0300, Arkadiusz Hiler wrote:
> The previous approach involves Intel's CI system to compare testlists
> created as an artifacts from a post-merge pipeline and a pre-merge
> pipeline which proved to be prone to breaking (e.g. when post-merge
> pipeline randomly fails not generating the necessary artifacts).
> 
> This change introduces a list of "already undocumented" tests and checks
> if all the "currently undocumented" ones are present on it.
> 
> The list doesn't need to be updated in most cases as we care only for
> new additions. Renaming/moving test will require a manual edit though.
> 
> Cc: Tomi Sarvela <tomi.p.sarvela at intel.com>
> Cc: Petri Latvala <petri.latvala at intel.com>
> Issue: https://gitlab.freedesktop.org/drm/igt-gpu-tools/-/issues/99
> Signed-off-by: Arkadiusz Hiler <arek at hiler.eu>

Much more neat than the finicky script that needs postmerge pipelines
to always succeed, in the CI tags repository.

Acked-by: Petri Latvala <petri.latvala at intel.com>

I've prepared the necessary changes in intel CI pipeline relay. I
think we need to get that deployed first and having it reliably
running so we don't rely entirely on postmerge results for this.