Yes, in the command line, like:
/path/to/java -Xmx2048m …whatever else…
I think the:
>>>>> <Memory space="2048" unit="MB”/>
in the auger xml just reserves a block of memory on the batch machine but doesn’t tell java that this much is available for it on the heap. The -XmxXXXXm does that.
> On May 31, 2015, at 2:57 AM, Luca Colaneri <[log in to unmask]> wrote:
>
> It's not about memory, I've tried requesting much more than necessary.
> Anyhow, it works if i save the histograms in AIDA. If there is a way to convert them there is no problem..otherwise I wouldn't know what to do. Tha aida file is just 1.9 MB..
>
> Matt, I still have to try your suggestion.. shall I put that flag in the command line?
> L.
>
> Il 30/05/15 23:09, Nathan Baltzell ha scritto:
>> Or, does anyone know how to convert an AIDA file with histograms to a ROOT file?
>>
>> Possibly if Luca writes an AIDA file this memory problem will go away (since it’s already
>> got all the AIDA histos in memory and appears to only be crashing when converting them
>> to ROOT at the very end).
>>
>> -Nathan
>>
>>
>>
>> On May 30, 2015, at 17:02, Nathan Baltzell <[log in to unmask]> wrote:
>>
>>> How much memory does your program use on your local computer when the AidaSaveDriver
>>> is succesfully converting to ROOT? You could try setting the farm limit to above that. Or just
>>> try bigger numbers. Or do your histograms have overly fine binning (do you rebin them later?)
>>> that could be reduced?
>>>
>>> -Nathan
>>>
>>>
>>>
>>> On May 30, 2015, at 12:54, Luca Colaneri <[log in to unmask]> wrote:
>>>
>>>> I used the same steering and the same jar file and I also tried requesting more memory..
>>>>
>>>> Il 29/05/15 20:38, McCormick, Jeremy I. ha scritto:
>>>>> Have you tried requesting more memory in your Auger job?
>>>>>
>>>>> <Memory space="2048" unit="MB"/>
>>>>>
>>>>> -----Original Message-----
>>>>> From: [log in to unmask] [mailto:[log in to unmask]] On Behalf Of Luca Colaneri
>>>>> Sent: Friday, May 29, 2015 9:51 AM
>>>>> To: hps-software
>>>>> Subject: job on farm
>>>>>
>>>>> Hi guys
>>>>> I'm trying to read some data on the farm, but I get this error:
>>>>> java.lang.OutOfMemoryError: Java heap space
>>>>> at
>>>>> hep.aida.ref.rootwriter.converter.IHistogram2DConverter.convert(IHistogram2DConverter.java:119)
>>>>> at hep.aida.ref.rootwriter.RootFileStore.add(RootFileStore.java:124)
>>>>> at hep.aida.ref.rootwriter.RootFileStore.add(RootFileStore.java:94)
>>>>> at hep.aida.ref.rootwriter.Store.add(Store.java:94)
>>>>> at org.lcsim.util.aida.AIDA.saveAsRoot(AIDA.java:352)
>>>>> at org.lcsim.util.aida.AIDA.saveAs(AIDA.java:291)
>>>>> at org.lcsim.job.AidaSaveDriver.endOfData(AidaSaveDriver.java:32)
>>>>> at org.lcsim.util.Driver.endOfData(Driver.java:151)
>>>>> at org.lcsim.util.DriverAdapter.finish(DriverAdapter.java:43)
>>>>> at
>>>>> org.freehep.record.loop.AbstractLoopListener.process(AbstractLoopListener.java:24)
>>>>> at
>>>>> org.freehep.record.loop.DefaultRecordLoop.fireLoopEvents(DefaultRecordLoop.java:125)
>>>>> at
>>>>> org.freehep.record.loop.DefaultRecordLoop.loop(DefaultRecordLoop.java:713)
>>>>> at
>>>>> org.freehep.record.loop.DefaultRecordLoop.execute(DefaultRecordLoop.java:566)
>>>>> at org.lcsim.util.loop.LCSimLoop.loop(LCSimLoop.java:151)
>>>>> at org.lcsim.job.JobControlManager.run(JobControlManager.java:431)
>>>>> at org.hps.job.JobManager.run(JobManager.java:55)
>>>>> at org.lcsim.job.JobControlManager.run(JobControlManager.java:189)
>>>>> at org.hps.job.JobManager.main(JobManager.java:23)
>>>>>
>>>>>
>>>>> I'm using the same steering I use locally and it works just fine..Any clues?
>>>>>
>>>>> L.
>>>>>
>>>>> --
>>>>> PhD Student,
>>>>> Università degli Studi di Roma Tor Vergata INFN sez. Roma2 Via della Ricerca Scientifica 1, 00133 Rome, Italy
>>>>> +39 0672594562
>>>>>
>>>>> ########################################################################
>>>>> Use REPLY-ALL to reply to list
>>>>>
>>>>> To unsubscribe from the HPS-SOFTWARE list, click the following link:
>>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
>>>>>
>>>>> ########################################################################
>>>>> Use REPLY-ALL to reply to list
>>>>>
>>>>> To unsubscribe from the HPS-SOFTWARE list, click the following link:
>>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
>>>> ########################################################################
>>>> Use REPLY-ALL to reply to list
>>>>
>>>> To unsubscribe from the HPS-SOFTWARE list, click the following link:
>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
>>> ########################################################################
>>> Use REPLY-ALL to reply to list
>>>
>>> To unsubscribe from the HPS-SOFTWARE list, click the following link:
>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
>
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the HPS-SOFTWARE list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the HPS-SOFTWARE list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
|