> 2. A very serious problem (in addition to the raw number of jobs) is
> that Daniele's chain do not make use of a 'new' input format
> implemented weeks ago in both anaQA and anaRecoil: While chaining
> you can either specify just a filename or a filename and the number
> of events. If you do the former, ROOT will open the file, extract
> the number of events, close it. Go to the next file. Do that for
> all files in the chain. Multiply by 100, if all of your jobs start
> up at the same time in the long queue. (Or at least 125.) You
> will completely saturate and kill any server. On the other hand,
> if you do specify the number of events, ROOT opens the rootfiles
> only for processing, and then we have some CPU cycles to spend and
> the access is quickly becoming asynchronous. It might be beneficial
> to switch to the new chaining scheme. At least consider it.
how can I produce a list of files with the number of events? Do you have a
macro available? I see that you produced the new chains for data in
~ursl/macros/fsx/vub/chains/csx-*. Do you have the same for generic MC?
Thanks a lot,
Daniele
|