<html> <head> <base href="https://bugs.freedesktop.org/"> </head> <body> <div> <a class="bz_bug_link bz_status_NEW " title="NEW - When testlist contains non-existing (removed) test, piglit excepts out" href="https://bugs.freedesktop.org/show_bug.cgi?id=99649#c2">Comment # 2</a> on <a class="bz_bug_link bz_status_NEW " title="NEW - When testlist contains non-existing (removed) test, piglit excepts out" href="https://bugs.freedesktop.org/show_bug.cgi?id=99649">bug 99649</a> from <a class="email" href="mailto:tomi.p.sarvela@intel.com" title="Tomi Sarvela <tomi.p.sarvela@intel.com>"> Tomi Sarvela</a> <pre>The exception is (as far as I see) before the 'tests' is written out. If you want to see the deterministic, *correct* order the tests have (or would have been without crash) run, the incomplete results have to be read in anyway. So I'm thinking that test regex and testlist are just hints what user would want to run, and thus, user input that might be incorrect. Correct list is in testfiles or result.json. It's always so with regex, why not use same idea with testlist. On this note: I have also patches to keep the correctness of 'tests' order in testrun. These change 'tests' dict to ordereddict on couple of places, adds sorting to os.listdir() and changes internal copying from dict comprehension to OrderedDict comprehension.</pre> </div> <hr> You are receiving this mail because: <ul> <li>You are the QA Contact for the bug.</li> </ul> </body> </html>