[igt-dev] ✗ Fi.CI.IGT: warning for tests/perf_pmu: Use absolute tolerance in accuracy tests

[Tvrtko Ursulin]

On 07/03/2018 12:35, Patchwork wrote:
> == Series Details ==
> 
> Series: tests/perf_pmu: Use absolute tolerance in accuracy tests
> URL   : https://patchwork.freedesktop.org/series/39518/
> State : warning
> 
> == Summary ==
> 
> ---- Possible new issues:
> 
> Test gem_linear_blits:
>          Subgroup normal:
>                  pass       -> SKIP       (shard-apl)
> 
> ---- Known issues:
> 
> Test gem_softpin:
>          Subgroup noreloc-s3:
>                  skip       -> PASS       (shard-snb) fdo#103375
> Test kms_chv_cursor_fail:
>          Subgroup pipe-b-128x128-right-edge:
>                  pass       -> DMESG-WARN (shard-snb) fdo#105185 +4
> Test kms_flip:
>          Subgroup 2x-flip-vs-blocking-wf-vblank:
>                  pass       -> FAIL       (shard-hsw) fdo#100368 +2
> Test kms_rotation_crc:
>          Subgroup primary-rotation-180:
>                  fail       -> PASS       (shard-snb) fdo#103925
> Test perf:
>          Subgroup blocking:
>                  fail       -> PASS       (shard-hsw) fdo#102252 +1
> Test pm_lpsp:
>          Subgroup screens-disabled:
>                  fail       -> PASS       (shard-hsw) fdo#104941

It doesn't say here but 50% tests are failing on shards. By the look of 
it around 3-4% off the target. So strange.. I need to figure out why 
would 50% be so much worse than 2% and 98% loads.

Regards,

Tvrtko

> fdo#103375 https://bugs.freedesktop.org/show_bug.cgi?id=103375
> fdo#105185 https://bugs.freedesktop.org/show_bug.cgi?id=105185
> fdo#100368 https://bugs.freedesktop.org/show_bug.cgi?id=100368
> fdo#103925 https://bugs.freedesktop.org/show_bug.cgi?id=103925
> fdo#102252 https://bugs.freedesktop.org/show_bug.cgi?id=102252
> fdo#104941 https://bugs.freedesktop.org/show_bug.cgi?id=104941
> 
> shard-apl        total:3467 pass:1822 dwarn:1   dfail:0   fail:10  skip:1633 time:12344s
> shard-hsw        total:3467 pass:1772 dwarn:1   dfail:0   fail:2   skip:1691 time:11981s
> shard-snb        total:3467 pass:1363 dwarn:3   dfail:0   fail:1   skip:2100 time:7138s
> Blacklisted hosts:
> shard-kbl        total:3365 pass:1880 dwarn:1   dfail:0   fail:9   skip:1472 time:8609s
> 
> == Logs ==
> 
> For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1074/shards.html
> _______________________________________________
> igt-dev mailing list
> igt-dev at lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/igt-dev
>