 |
 |
Hi, In ATLAS TDAQ we have the following problem: there is a huge number of small files (~5 million) that we are storing in EOS as compressed tar archives. Then to read a single small file we have to bring back from EOS an entire archive file which can be up to 6 GBs. This is very inneficient and takes a lot of time. Is there a way to programatically extract just the small file we need from the archive directly on the EOS side? Or do you know a file format which can be used instead of tar that will return us only a subset of data from EOS, not only a complete file? What can the XrootD API give to us? Cheers, Alex ---- Alexandru Dan Sicoe MEng, Research Fellow CERN, PH-ADT Office: 40-5-D01 Phone: +41 (0) 22 76 71113 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the XROOTD-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1