parallelizing crashtest runs (was: minutes of ESC call ...)
lohmaier at googlemail.com
Fri Oct 31 06:45:40 PDT 2014
Hi Markus, *,
On Fri, Oct 31, 2014 at 2:38 PM, Markus Mohrhard
<markus.mohrhard at googlemail.com> wrote:
> The quick and ugly one is to partition the directories into 100 file
> directories. I have a script for that as I have done exactly that for
> the memcheck run on the 70 core Largo server. It is a quick and ugly
> The clean and much better solution is to move away from directory
> based invocation and partion by files on the fly.
Yeah, I also thought of keeping the per-directory/filetype processing,
but instead run multiple dirs at once, rather divide the set of files
of a given dir into the <number of workers> chunks.
> I have a
> proof-of-concept somewhere on my machine and will push a working
> version during the next days.
More information about the LibreOffice