[poppler] RFC: patch: parallel testing
Adam Reichold
adamreichold at myopera.com
Mon Dec 3 22:45:00 PST 2012
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hello everyone,
I currently try to get myself acquainted with Poppler's regression
testing framework. Because my system has a rather low single-threaded
performance, I tried to implement parallel testing using Python's
Queue class.
Even though poppler-regtest currently uses two processes per test
file, rendering even and odd pages respectively, the test files
themselves are still handled sequentially and both process are joined
for each test file. This will yield suboptimal system utilization even
for a small three-core system like mine.
Using the "-t/--threads N" option in the patched poppler-regtest will
spawn N worker threads that handle all tests they can get from a
single queue for all known tests, allowing to heavily utilize also
large system if using a large set of test cases. But even for my
three-core system, this brought down the time to create references for
the complete test suite using the Splash backend from 4,5 hours to
2,75 hours.
IMHO, the necessary changes seem quite small especially since a lot of
them are connected to indentation handling. What are your thoughts on
the utility and implementation of this?
Best regards, Adam.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
iQEcBAEBAgAGBQJQvZvsAAoJEPSSjE3STU34o3IIALy0fNljhHM/6VDQ+sZkhsO1
qIZuNZYnL+JrDphSk0L8fwahjU3bHMBs0WTeP98b5NNiUPgtKixzBdFq0S5Ch03W
C/ysZiZXQgEK1yZgfWT+3mvTHYlPKTD7KgkubISW9qvyy5OHlwuaRcnQpDCO3ju0
ratVRjJ5x/TJIXNa5W6F335UTvu9eJu2v3f0PHh7fQRnX6e5e4lHUOQphaB9wfbJ
UvsI0PE9OGjhyEUc4Z92KeLw5Zp5NqQthbQLsGsxnZg6V/YmrzOFjuQJEsFZxEK7
JFKACLjj/41F3aTL8HaczOJ5oHWmbnq9VnetGSGJ5ClZZwXuhgeJxfW2TnGzpcs=
=ng+7
-----END PGP SIGNATURE-----
-------------- next part --------------
A non-text attachment was scrubbed...
Name: parallel_testing.patch
Type: text/x-patch
Size: 11449 bytes
Desc: not available
URL: <http://lists.freedesktop.org/archives/poppler/attachments/20121204/5cfb85e2/attachment.bin>
More information about the poppler
mailing list