Hi Sho,
Thank you for looking into this. It would be nice to know what the memory use depends on.
Best,
Maurik
On Mar 5, 2014, at 5:48 PM, Sho Uemura <[log in to unmask]> wrote:
> Was not aware this was a problem. Testing some fixes. The jobs that use 4 GB are all done for the moment, and I'm not submitting any more until this is figured out.
>
> On Wed, 5 Mar 2014, Maurik Holtrop wrote:
>
>> Dear All,
>>
>> While here at jlab, I was told in passing that our jobs on the Jlab farm are taking up too much memory. The farm systems have 2 GB per core (I think?) and some of our jobs are asking for 4 GB. That means that one job is actually using up the resources for 2.
>>
>> I am wondering if this is really a required foot print for our code, or whether there are ways to reduce the memory usage. For full out data processing of our real data, this could become a critical issue.
>>
>> What is the memory footprint of our reconstruction code, and what does it depend on?
>> What causes it to be so large, can we reduce it?
>>
>> For the current MDC, perhaps it would be possible to split the SLIC step, which takes little memory, from the reconstruction step which takes a lot. This would increase the throughput on the farm, since more nodes would be available to us.
>>
>> Best,
>> Maurik
>>
>>
>> ########################################################################
>> Use REPLY-ALL to reply to list
>>
>> To unsubscribe from the HPS-SOFTWARE list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
>>
>
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the HPS-SOFTWARE list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the HPS-SOFTWARE list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
|