<html>
<head>
<base href="https://bugs.freedesktop.org/" />
</head>
<body><span class="vcard"><a class="email" href="mailto:baker.dylan.c@gmail.com" title="Dylan <baker.dylan.c@gmail.com>"> <span class="fn">Dylan</span></a>
</span> changed
<a class="bz_bug_link
bz_status_RESOLVED bz_closed"
title="RESOLVED NOTABUG - Different stats in output reports"
href="https://bugs.freedesktop.org/show_bug.cgi?id=91680">bug 91680</a>
<br>
<table border="1" cellspacing="0" cellpadding="8">
<tr>
<th>What</th>
<th>Removed</th>
<th>Added</th>
</tr>
<tr>
<td style="text-align:right;">Status</td>
<td>NEW
</td>
<td>RESOLVED
</td>
</tr>
<tr>
<td style="text-align:right;">Resolution</td>
<td>---
</td>
<td>NOTABUG
</td>
</tr></table>
<p>
<div>
<b><a class="bz_bug_link
bz_status_RESOLVED bz_closed"
title="RESOLVED NOTABUG - Different stats in output reports"
href="https://bugs.freedesktop.org/show_bug.cgi?id=91680#c1">Comment # 1</a>
on <a class="bz_bug_link
bz_status_RESOLVED bz_closed"
title="RESOLVED NOTABUG - Different stats in output reports"
href="https://bugs.freedesktop.org/show_bug.cgi?id=91680">bug 91680</a>
from <span class="vcard"><a class="email" href="mailto:baker.dylan.c@gmail.com" title="Dylan <baker.dylan.c@gmail.com>"> <span class="fn">Dylan</span></a>
</span></b>
<pre>This isn't actually a bug. What's happening is that 'piglit run' and 'piglit
summary' are counting two different things.
Piglit run counts the number of tests as defined in the profile (in your case
tests/all.py), it counts them up and sees that there are 28030 Test derived
objects in the python file.
Piglit summary counts the number of tests + subtests as a total (tests with
subtests are treated as a group rather than as a test), so while there were
28030 Test.run() calls, there were actually 28904 test + subtest results
generated.
There is no way for the runner to know if a test has subtests or how many it
has until it has finished running that test; and I prefer to keep the number of
tests counted deterministic at start time (ie, not changing as the run goes,
which would be confusing when running a summary against two incomplete
results).
I've attached a very simple results file that hopefully will make it clearer
how this works. I'll also send a patch that updates the README file with this
information.
Sorry for the confusion.</pre>
</div>
</p>
<hr>
<span>You are receiving this mail because:</span>
<ul>
<li>You are the QA Contact for the bug.</li>
</ul>
</body>
</html>