[Bug 69838] [HSW ULT]igt/pc8 skipped

[bugzilla-daemon at freedesktop.org]

https://bugs.freedesktop.org/show_bug.cgi?id=69838

--- Comment #6 from Daniel Vetter <daniel at ffwll.ch> ---
(In reply to comment #5)
> If we replace the SKIP with FAIL on machines that are not properly
> configured we'll start getting bug reports that are not really bugs and we
> won't be able to fix. We'll also have to always analyze the logs to check if
> the report is really a regression or if it's just a badly configured machine.

And I absolutely want these bug reports. You're right that misconfigured test
machines isn't our bug, but we need to notice such issues, track and fix them.
I think adding a QA component in our internal JIRA would be good for that, I'll
chat with Gavin about this.

So yes, if a test can't work because the machine is misconfigured it should
fail, not skip. That's how all the other testcase already work, and
occasionally we get a bug report which isn't a kernel issue but a setup issue.
The other option of silently not testing features (which is currently the case,
at least according to QA's nightly test db there's not a single machine where
the pc8 tests are executed).

-- 
You are receiving this mail because:
You are the QA Contact for the bug.
You are on the CC list for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freedesktop.org/archives/intel-gfx-bugs/attachments/20130926/faa2cc70/attachment.html>