[Intel-gfx] [QA 2015-12-04 ww50] Testing report for `drm-intel-testing`

Tue Dec 15 07:38:24 PST 2015

Hello,

We launched Intel GPU Tools on 7 platforms: Skylake-Y, Braswell-M,
Broadwell-U, Baytrail-M, Haswell-U, Ivy Bridge and Sandy Bridge to
validate tag drm-intel-testing-2015-12-04 (kernel 4.4-rc3).

Unusual numbers of tests are fail on BSW and SKL, they must be executed
again (managed as not run at the moment).
On the other platforms, we have 33 progress and 15 regressions when
comparing the results from kernel tag drm-intel-testing-2015-11-20. We
reproduced a lot of known bugs.

Results:
``````````````````````````````````````````
	| Avail	| Black	| Skip	| Not	|Exec	| Exec		| Pass of	| Pass of
	| able	| listed|	| Run	| 	| %		| Total %	| executed %
------------------------------------------------------------------------------------------------------
SKL-Y
Basic	| 131	| 0	| 2	| 24	| 105	| 80.15%	| 80.15%	| 100%
Others	| 5566	| 3780	| 194	| 620	| 1093	| 19.64%	| 12.22%	| 62.21%
------------------------------------------------------------------------------------------------------
BSW-M
Basic	| 131	| 0	| 4	| 0	| 127	| 96.95%	| 90.84%	| 93.70%
Others	| 5566	| 3780	| 435	| 250	| 786	| 14.12%	| 12.85%	| 90.97%
------------------------------------------------------------------------------------------------------
BDW-U
Basic	| 131	| 0	| 4	| 0	| 127	| 96.95%	| 92.37%	| 92.28%
Others	| 5566	| 3780	| 595	| 0	| 1191	| 21.40%	| 19.83%	| 92.70%
------------------------------------------------------------------------------------------------------
HSW-U
Basic	| 131	| 0	| 11	| 0	| 120	| 91.60%	| 87.02%	| 95.00%
Others	| 5566	| 3780	| 690	| 0	| 1096	| 19.69%	| 17.79%	| 90.33%
------------------------------------------------------------------------------------------------------
IVB
Basic	| 131	| 0	| 6	| 0	| 125	| 95.42%	| 95.42%	| 100.00%
Others	| 5566	| 3780	| 922	| 0	| 864	| 15.52%	| 14.66%	| 94.44%
------------------------------------------------------------------------------------------------------
SNB
Basic	| 131	| 0	| 12	| 0	| 119	| 90.83%	| 90.84%	| 100.00%
Others	| 5566	| 3780	| 916	| 0	| 870	| 15.63%	| 14.86%	| 95.06%
------------------------------------------------------------------------------------------------------
BYT-M
Basic	| 131	| 122	| 7	| 1	| 123	| 93.89%	| 93.13%	| 99.19%
Others	| 5566	| 3780	| 736	| 0	| 1182	| 21.23%	| 19.67%	| 92.64%
------------------------------------------------------------------------------------------------------

Tag drm-intel-testing-2015-11-20 results:
``````````````````````````````````````````
	| Avail	| Black	| Skip	| Not	|Exec	| Exec		| Pass of	| Pass of
	| able	| listed|	| Run	| 	| %		| Total %	| executed %
------------------------------------------------------------------------------------------------------
SKL-Y
Basic	| 131	| 0	| 2	| 0	| 129	| 98.47%	| 93.89%	| 95.35%
Others	| 5542	| 3780	| 271	| 0	| 1491	| 26.90%	| 24.11%	| 89.60%
------------------------------------------------------------------------------------------------------
BSW-M
Basic	| 131	| 0	| 4	| 0	| 127	| 96.95%	| 90.84%	| 93.70%
Others	| 5542	| 3780	| 380	| 340	| 1042	| 18.80%	| 12.94%	| 68.81%
------------------------------------------------------------------------------------------------------
BDW-U
Basic	| 131	| 0	| 4	| 0	| 127	| 96.95%	| 92.37%	| 95.28%
Others	| 5542	| 3780	| 574	| 0	| 1188	| 21.44%	| 19.99%	| 93.27%
------------------------------------------------------------------------------------------------------
HSW-U
Basic	| 131	| 0	| 11	| 0	| 120	| 91.60%	| 87.02%	| 95.00%
Others	| 5542	| 3780	| 677	| 0	| 1085	| 19.58%	| 17.72%	| 90.51%
------------------------------------------------------------------------------------------------------
IVB
Basic	| 131	| 0	| 6	| 0	| 125	| 95.42%	| 94.66%	| 99.20%
Others	| 5542	| 3780	| 902	| 0	| 860	| 15.52%	| 14.71%	| 94.77%
------------------------------------------------------------------------------------------------------
SNB
Basic	| 131	| 0	| 13	| 0	| 118	| 90.08%	| 90.08%	| 100.00%
Others	| 5542	| 3780	| 895	| 0	| 867	| 15.64%	| 14.85%	| 94.93%
------------------------------------------------------------------------------------------------------
BYT-M
Basic	| 131	| 0	| 7	| 0	| 124	| 94.66%	| 93.89%	| 99.19%
Others	| 5673	| 3780	| 654	| 0	| 1239	| 21.84%	| 19.51%	| 89.35%
------------------------------------------------------------------------------------------------------

Test Environment:
````````````````````````````````````
Kernel: tag drm-intel-testing-2015-12-04
91587c722c28c4116dedbfbf08aa874377bc76f8 (4.4-rc3) from
git://anongit.freedesktop.org/drm-intel
Libdrm: libdrm-2.4.65 from http://cgit.freedesktop.org/mesa/drm
Intel-gpu-tools: 1.13 head from
http://cgit.freedesktop.org/xorg/app/intel-gpu

Regression:
````````````````````````````````````
We have x progress and x regression when comparing results from tag
2015-11-20 to tag 2015-12-04:

	| Progress	| Regression
----------------------------------------
BDW	| 2		| 5
HSW	| 6		| 7
BYT	| 21		| 2
SNB	| 2		| 0
IVB	| 2		| 1

Following tests were Pass with tag 2015-11-20 and are fail with tag
2015-12-04:
BDW-U
kms_flip at 2x-wf_vblank-interruptible
kms_flip at flip-vs-absolute-wf_vblank-interruptible
kms_frontbuffer_tracking at fbc-1p-primscrn-pri-shrfb-draw-pwrite
kms_frontbuffer_tracking at fbc-2p-primscrn-pri-indfb-draw-pwrite
kms_frontbuffer_tracking at fbc-farfromfence

HSW-ULT
gem_cs_tlb at bsd
gem_cs_tlb at render
kms_flip at flip-vs-absolute-wf_vblank-interruptible
kms_flip_tiling at flip-x-tiled
kms_frontbuffer_tracking at fbc-1p-primscrn-pri-shrfb-draw-pwrite
kms_frontbuffer_tracking at fbc-farfromfence
kms_frontbuffer_tracking at fbc-stridechange

IVB
pm_rc6_residency at rc6-accuracy

BYT
drm_import_export at import-close-race-prime
gem_reset_stats at close-pending-fork-blt

New bugs reported:
````````````````````````````````````
None

Closed bugs:
````````````````````````````````````
None

Reproduced bugs:
``````````````````````````````````````````
BDW
https://bugs.freedesktop.org/show_bug.cgi?id=92602 [HSW BDW SKL BSW] [IGT
Basic] kms_pipe_crc_basic is epic fail
https://bugs.freedesktop.org/show_bug.cgi?id=92222 [BDW HSW]
drm_import_export / import-close-race-prime fails
https://bugs.freedesktop.org/show_bug.cgi?id=88437
[BDW/SKL/BYT]igt/drv_missed_irq_hang fails
https://bugs.freedesktop.org/show_bug.cgi?id=92699 [BDW SKL BXT] IGT
gem_bad_reloc at negative-reloc-blt is failing
https://bugs.freedesktop.org/show_bug.cgi?id=89602 [SNB BYT SKL BDW BXT
BSW] igt/gem_ctx_bad_destroy/invalid-pad fails
https://bugs.freedesktop.org/show_bug.cgi?id=91349 [BSW-BYT-M-SKL-BDW-U
BXT] igt/gem_eio/throttle fails
https://bugs.freedesktop.org/show_bug.cgi?id=92224 [All] igt/gem_eio/wait
fails
https://bugs.freedesktop.org/show_bug.cgi?id=80079 [SNB BDW SKL BXT
BSW]igt/gem_fence_upload some subcases fail
https://bugs.freedesktop.org/show_bug.cgi?id=90400 [BDW SKL
BSW]igt/gem_ppgtt/flink-and-close-vma-leak fails
https://bugs.freedesktop.org/show_bug.cgi?id=90546 [HSW/BDW/BSW/SKL
bisected]igt/pm_rpm/drm-resources-equal fails
https://bugs.freedesktop.org/show_bug.cgi?id=92503 [BDW HSW] pm_rpm
subtests gem-execbuf-stress-pc8 fails
https://bugs.freedesktop.org/show_bug.cgi?id=89728 [HSW/BDW/BSW/SKL
bisected] igt / pm_rps / reset fails

BYT
https://bugs.freedesktop.org/show_bug.cgi?id=92599 [BAT SNB BDW SKL]
drv_module_reload_basic is failing
https://bugs.freedesktop.org/show_bug.cgi?id=91349 [BSW-BYT-M-SKL-BDW-U
BXT] igt/gem_eio/throttle fails
https://bugs.freedesktop.org/show_bug.cgi?id=80079 [SNB BDW SKL BXT
BSW]igt/gem_fence_upload some subcases fail
https://bugs.freedesktop.org/show_bug.cgi?id=92845 [BSW clflush]
igt/gem_partial_pwrite_pread subtests fail
https://bugs.freedesktop.org/show_bug.cgi?id=88358
[all]igt/gem_reloc_vs_gpu/*hang subcases xfail
https://bugs.freedesktop.org/show_bug.cgi?id=92715 [BYT-M] igt /
gem_reset_stats sub tests fail
https://bugs.freedesktop.org/show_bug.cgi?id=93014 [SKL BSW BYT]
igt/kms_atomic test fail
https://bugs.freedesktop.org/show_bug.cgi?id=79052
[PNV/IVB/BSW/HSW/BDW]igt/kms_flip subcases vblank-vs-suspend and
vblank-vs-suspend-interruptible fail
https://bugs.freedesktop.org/show_bug.cgi?id=87480 [SNB/IVB/HSW/BYT
bisected]igt/kms_force_connector/force-edid fails on -nightly kernel

HSW
https://bugs.freedesktop.org/show_bug.cgi?id=92602 [HSW BDW SKL BSW] [IGT
Basic] kms_pipe_crc_basic is epic fail
https://bugs.freedesktop.org/show_bug.cgi?id=92222 [BDW HSW IVB]
drm_import_export / import-close-race-prime fails
https://bugs.freedesktop.org/show_bug.cgi?id=92477 [HSW/BYT] IGT
gem_cs_tlb some sub-tests fails
https://bugs.freedesktop.org/show_bug.cgi?id=89602 [SNB BYT SKL BDW BXT
BSW HSW] igt/gem_ctx_bad_destroy/invalid-pad fails
https://bugs.freedesktop.org/show_bug.cgi?id=91349 [BSW BYT-M SKL BDW-U
BXT HSW] igt/gem_eio/throttle fails
https://bugs.freedesktop.org/show_bug.cgi?id=92224 [All] igt/gem_eio/wait
fails
https://bugs.freedesktop.org/show_bug.cgi?id=80079 [SNB BDW SKL BXT BSW
HSW] igt / gem_fence_upload some subcases fail
https://bugs.freedesktop.org/show_bug.cgi?id=90412 [BXT HSW BSW SKL IVB
SNB]igt/gem_mmap_gtt/big-copy fails
https://bugs.freedesktop.org/show_bug.cgi?id=88358
[all]igt/gem_reloc_vs_gpu/*hang subcases xfail
https://bugs.freedesktop.org/show_bug.cgi?id=93014 [SKL BSW BYT HSW]
igt/kms_atomic test fail
https://bugs.freedesktop.org/show_bug.cgi?id=86767 [BSW SKL HSW] igt /
kms_rotation_crc subcases fail
https://bugs.freedesktop.org/show_bug.cgi?id=89638 [BSW SKL BXT HSW] igt
kms_universal_plane subcases fail
https://bugs.freedesktop.org/show_bug.cgi?id=92503 [BDW HSW] pm_rpm
subtests gem-execbuf-stress-pc8 fails
https://bugs.freedesktop.org/show_bug.cgi?id=89728 [HSW/BDW/BSW/SKL
bisected] igt / pm_rps / reset fails

SNB
https://bugs.freedesktop.org/show_bug.cgi?id=92222 [BDW HSW IVB]
drm_import_export / import-close-race-prime fails
https://bugs.freedesktop.org/show_bug.cgi?id=89602 [All]
igt/gem_ctx_bad_destroy/invalid-pad fails
https://bugs.freedesktop.org/show_bug.cgi?id=91349 [All]
igt/gem_eio/throttle fails
https://bugs.freedesktop.org/show_bug.cgi?id=92224 [All] igt/gem_eio/wait
fails
https://bugs.freedesktop.org/show_bug.cgi?id=80079 [All] igt /
gem_fence_upload some subcases fail
https://bugs.freedesktop.org/show_bug.cgi?id=90412 [BXT HSW BSW SKL IVB
SNB]igt/gem_mmap_gtt/big-copy fails
https://bugs.freedesktop.org/show_bug.cgi?id=88358
[all]igt/gem_reloc_vs_gpu/*hang subcases xfail
https://bugs.freedesktop.org/show_bug.cgi?id=93014 [SKL BSW BYT HSW IVB
SNB] igt/kms_atomic test fail
https://bugs.freedesktop.org/show_bug.cgi?id=87480 [SNB/IVB/HSW/BYT
bisected]igt/kms_force_connector/force-edid fails on -nightly kernel
https://bugs.freedesktop.org/show_bug.cgi?id=89728 [HSW/BDW/BSW/SKL
bisected] igt / pm_rps / reset fails

IVB
https://bugs.freedesktop.org/show_bug.cgi?id=92222 [BDW HSW IVB]
drm_import_export / import-close-race-prime fails
https://bugs.freedesktop.org/show_bug.cgi?id=89602 [All]
igt/gem_ctx_bad_destroy/invalid-pad fails
https://bugs.freedesktop.org/show_bug.cgi?id=91349 [BSW BYT-M SKL BDW-U
BXT HSW IVB] igt/gem_eio/throttle fails
https://bugs.freedesktop.org/show_bug.cgi?id=92224 [All] igt/gem_eio/wait
fails
https://bugs.freedesktop.org/show_bug.cgi?id=80079 [SNB BDW SKL BXT BSW
HSW IVB] igt / gem_fence_upload some subcases fail
https://bugs.freedesktop.org/show_bug.cgi?id=90412 [BXT HSW BSW SKL IVB
SNB]igt/gem_mmap_gtt/big-copy fails
https://bugs.freedesktop.org/show_bug.cgi?id=89051 [SNB IVB BSW SKL] igt /
gem_reloc_vs_gpu / faulting-reloc-interruptible-hang fail
https://bugs.freedesktop.org/show_bug.cgi?id=93014 [SKL BSW BYT HSW IVB]
igt/kms_atomic test fail
https://bugs.freedesktop.org/show_bug.cgi?id=87480 [SNB/IVB/HSW/BYT
bisected]igt/kms_force_connector/force-edid fails on -nightly kernel

Tests blacklisted:
````````````````````````````````````
gem_concurrent_all.*

Platforms:
````````````````````````````````````
Skylake-Y
Motherboard: Skylake Y
cpu model name	: Intel(R) Core(TM) m5-6Y57 CPU @ 1.10GHz
cpu model : 78
cpu family : 6
Graphic card: Device 191e (rev 07)
Software:
Ubuntu 14.04.2 LTS
Bios: SKLSE2R1.R00.B104.B01.1511110114

Braswell-M
Hardware:
Motherboard: Braswell CRB
cpu model name : Intel(R) Celeron(R) CPU N3060 @ 1.60GHz
cpu model : 76
cpu family : 6
Graphic card: Device 22b1 (rev 31)
Software:
Ubuntu 14.04.1 LTS
Bios: BRAS.X64.B088.R00.1510270350

Broadwell-U
Hardware
Motherboard: SawTooth Peak
cpu model name : Intel(R) Core(TM) i5-5300U CPU @ 2.30GHz
cpu model : 61
cpu family : 6
Graphic card: Broadwell-U Integrated Graphics (rev 09)
Software:
Ubuntu 14.04.1 LTS
Bios: BDW-E1R1.86C.0126.R02.1507080301

Baytrail-M
Hardware
Platform: Toshiba Satellite C55t
Processor Intel(R) Celeron(R) CPU  N2820  @ 2.13GHz
Software
Linux distribution: Ubuntu 14.04 LTS 64Bits
BIOS: 1.10

Haswell-ULT
Hardware:
Motherboard: SawTooth Peak
cpu model name : Intel(R) Core(TM) i7-4550U CPU @ 1.50GHz
cpu model : 69
cpu family : 6
Graphic card: Haswell-ULT Integrated Graphics Controller (rev 09)
Software:
Ubuntu 14.04.1 LTS
Bios: HSWLPTU1.86C.0135.R01.1311020052

Sandy Bridge
Hardware:
Motherboard: DQ67SW
cpu model name : Intel(R) Core(TM) i5-2400S CPU @ 2.50GHz
cpu model : 42
cpu family : 6
Graphic card: 2nd Generation Core Processor Family Integrated Graphics
Software:
Ubuntu 14.04.1 LTS
Bios: SWQ6710H.86A.0060.2011.1220.1805

Ivy Bridge
Hardware:
Motherboard: DH77EB
cpu model name : Intel(R) Core(TM) i7-3770K CPU @ 3.50GHz
cpu model : 58
cpu family : 6
Graphic card: Xeon E3-1200 v2/3rd Gen Core processor Graphics
Software:
Ubuntu 14.04.1 LTS
Bios: EBH7710H.86A.0096.2012.1012.1645