XROOTD-L Archives

Support use of xrootd by HEP experiments

XROOTD-L@LISTSERV.SLAC.STANFORD.EDU

Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Michal Kamil Simon <[log in to unmask]>
Reply To:
Support use of xrootd by HEP experiments <[log in to unmask]>
Date:
Tue, 4 Feb 2020 14:23:13 +0000
Content-Type:
text/plain
Parts/Attachments:
text/plain (43 lines)
Hi Adiran,

I case of multi-source transfers the fallback is not implemented, please create a github issue for that.

Regarding the copying data out of ZIP archive, are using multi-source transfer to do that? If yes there
is most likely a bug multi-source transfer logic that does not account for ZIP archives. Could you give
me your xrdcp command you are executing and the source ZIP archive?

Cheers,
Michal
________________________________________
From: Adrian Sevcenco
Sent: 03 February 2020 19:18
To: [log in to unmask]; Michal Kamil Simon; Costin Grigoras; Nikola Hardi
Subject: Re: XRootD py: there are zip files from each extraction does not take place

On 2/3/20 5:48 PM, Adrian Sevcenco wrote:
> Hi! It seems that there are some zip files from which the content is not
> correctly extracted ... the files are the correct size but the content
> is mangled ..
> See the log at https://cernbox.cern.ch/index.php/s/JNaLKsaC5pyrhMP
>
> Let me know how can i assist with the debugging :)
> (btw, this is the latest .2 tag)
on more catch : the mangling happens when sourcelimit > 1
we have multiple replicas for each file (and those appear in the
metafile), and from my observations it would appear that if sourcelimit
is not specified the fallback does not happen, so with sourcelimit =1 if
the first replica is not available then the whole transfer is failed.
Is this expected? my expectation is that fallback is present always and
the sourcelimit > 1 only make a parallel chunked download between the
specified source numbers available ...

Thank you!
Adrian


########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1

ATOM RSS1 RSS2