parallelizing crashtest runs (was: minutes of ESC call ...)

[Christian Lohmaier]

Hi Markus, *,

On Fri, Oct 31, 2014 at 2:38 PM, Markus Mohrhard
<markus.mohrhard at googlemail.com> wrote:
>
> The quick and ugly one is to partition the directories into 100 file
> directories. I have a script for that as I have done exactly that for
> the memcheck run on the 70 core Largo server. It is a quick and ugly
> implementation.
> The clean and much better solution is to move away from directory
> based invocation and partion by files on the fly.

Yeah, I also thought of keeping the per-directory/filetype processing,
but instead run multiple dirs at once, rather divide the set of files
of a given dir into the <number of workers> chunks.

> I have a
> proof-of-concept somewhere on my machine and will push a working
> version during the next days.

nice :-)

ciao
Christian