[cairo] Re: Better coverage from cairo performance suite (and some results)

[Carl Worth]

On Fri, 06 Oct 2006 15:42:57 -0700, Carl Worth wrote:
> I just ran it and it took over 34 minutes.

Which is way too long for my impatience, (not to mention it was
several times slower on the 770). So I've just implemented an adaptive
mechanism for executing fewer iterations per test when possible.

The approach I took was to set a desired threshold value for the
standard deviation (I chose 3%) and to stop iterating as soon as that
threshold was reached by a consecutive number of iterations (I chose
5).

So on my x86 laptop with the XAA server that results in an average of
about 9.5 iterations per test (rather than the previous 100 iterations
per test). And the complete suite completes in about 3 minutes
compared to 34 minutes.

So I'm pretty happy with that. But if anybody has any suggested
refinements for determining when we can declare that we are getting
stable results, I would be glad to hear them.

-Carl
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: not available
Url : http://lists.freedesktop.org/archives/cairo/attachments/20061012/cec6e564/attachment.pgp