[Intel-gfx] [PATCH igt] intel-ci: Add gem_exec_reloc/basic-range to BAT

[Daniel Vetter]

On Mon, May 22, 2017 at 10:40:13AM +0100, Chris Wilson wrote:
> On Mon, May 15, 2017 at 04:03:50PM +0200, Daniel Vetter wrote:
> > What would probably help the CI folks is a gem testcase list that includes
> > all the important stuff (so much more than BAT), but also completes in a
> > reasonable amount of time (2h as a goal might be good). Atm not even
> > excluding gem_concurrent_* (which really is a shame, since it has lots of
> > correctness tests among all the combinatorial stress) doesn't get us
> > there, with Mexico reporting it takes over 10h to just run that.
> 
> To reiterate myself, such a constrained test suite can and should be
> generated automatically.

But how do you generate that test list to make sure it does actually
include the stuff you really want to have tested? Random or semi-random
selection adds noise, and noise in CI is not cool.

The other issue is that since no one runs full igt, the survival pressure
on tests died, and we're piling up tons of stuff. That's imo not good at
all.
-Daniel
-- 
Daniel Vetter
Software Engineer, Intel Corporation
http://blog.ffwll.ch