<html>
<head>
<base href="https://bugs.freedesktop.org/">
</head>
<body>
<p>
<div>
<b><a class="bz_bug_link
bz_status_NEW "
title="NEW - Crashing tests with subtests no longer show in a list of regressions"
href="https://bugs.freedesktop.org/show_bug.cgi?id=104700#c1">Comment # 1</a>
on <a class="bz_bug_link
bz_status_NEW "
title="NEW - Crashing tests with subtests no longer show in a list of regressions"
href="https://bugs.freedesktop.org/show_bug.cgi?id=104700">bug 104700</a>
from <span class="vcard"><a class="email" href="mailto:fabianbieler@fastmail.fm" title="Fabian Bieler <fabianbieler@fastmail.fm>"> <span class="fn">Fabian Bieler</span></a>
</span></b>
<pre>Created <span class=""><a href="attachment.cgi?id=136858" name="attach_136858" title="Framework/summary: Include crashing subtests in fixes and regressions.">attachment 136858</a> <a href="attachment.cgi?id=136858&action=edit" title="Framework/summary: Include crashing subtests in fixes and regressions.">[details]</a></span> <a href='page.cgi?id=splinter.html&bug=104700&attachment=136858'>[review]</a>
Framework/summary: Include crashing subtests in fixes and regressions.
If a subtest crashed before 938ec48e2 no crash was recorded at all. A subtest
that regressed from pass to crash was recorded as pass and notrun,
respectively, too.
The commit in question attempts to improve on the situation by at least
recording some crash, albeit only of subtest "unknown". This is no proper fix
for <a class="bz_bug_link
bz_status_NEW "
title="NEW - crashes during subtests are unreported, as are all subsequent subtests in the same test"
href="show_bug.cgi?id=74642">bug #74642</a> as noted in the commit message.
Crashing subtests not showing up in the regressions tab of summaries is a
problem, but that has been the case since at least 2014 (see <a class="bz_bug_link
bz_status_NEW "
title="NEW - crashes during subtests are unreported, as are all subsequent subtests in the same test"
href="show_bug.cgi?id=74642">bug #74642</a>).
The attached test tries to remedy that by at least including the subtest named
"unknown" in the list of regressions (and fixes, if applicable).</pre>
</div>
</p>
<hr>
<span>You are receiving this mail because:</span>
<ul>
<li>You are the QA Contact for the bug.</li>
</ul>
</body>
</html>