OK, I will try again with smaller tcl files.
Thanks for the tip,
sheila
On Tue, 7 Feb 2006, Roberto Sacco wrote:
> Hi Sheila,
>
> I also had problems with jobs dying some time ago. Eventually I traced
> it back to having too many events to process, as this may lead to the
> memory swap being too large. I notice from your log messages that you
> have run over more than 100000 events per job - in my jobs, I decided
> to limit the number of events to 70000 per tcl file for MC in the
> kanga queue. This was in analysis-23, but should help for analysis-30
> as well.
>
> Hope this helps,
>
> Roberto
>
> > I have been trying to produce some VubRecoilUser
> > ntuples. Unfortunately, a very large fraction
> > of my jobs crashed.
> >
> > My code is in the analysis-30 test release:
> >
> > ~penguin/vubrecoil/vub30
> >
> > I did edit VubXlnu.cc a bit to make it keep events
> > even if there was no best lepton, so that I could
> > study the breco sample before and after the lepton
> > requirement. However, the code did compile and link,
> > and SOME of my jobs ran OK, so I don't think that's the
> > problem.
> >
> > For SP-1235 and SP-1237, most of the errors were
> > exit code 134. This usually means "aborted and core dumped."
> > I have posted a sample of my core dump messages at:
> >
> > http://www.slac.stanford.edu/~penguin/cores.html
> >
> > The most common pre-core-dump message was:
> >
> > VubXlnu::VubRecoilHelper.cc(256):reco/recoil MC association is mixed
> >
> > However, this message appears frequently in the log files
> > for the successful jobs, as well.
> >
> > For SP-2575, SP-3037, SP-6333, SP-6334, SP-3429, and SP-1005,
> > the most common error was that the job simply exited without
> > processing any events. A ROOT file is produced, but it is empty.
> >
> > Most of the data jobs ran successfully.
> >
> > My log files are in:
> >
> > ~penguin/vubrecoil/vub30/workdir/log
> >
> > You can see the results of all the jobs in:
> >
> > ~penguin/vub30/workdir/chklog.txt
> >
> > which is the output of the chklog script in:
> >
> > /nfs/farm/babar/AWG11/PID/users/penguin/owl/workdir/chklog
> >
> > run over my log files.
> >
> > I tried debugging one of the core dumped jobs,
> > but as I had removed the actual core files this meant
> > running the job interactively in gdb, and after
> > two hours it still hadn't crashed, so I killed it.
> >
> > Does anyone know why so many of my jobs crashed?
> >
> > Thanks,
> >
> > sheila
> >
> >
> >
> >
> >
>
|