Hi Adrian,
If (for now) you simply want to download a file having different replicas (with
different names, etc.) a metalink is what you need. Have a look at:
you can create a metalink containing different URLs and assign priorities
to them. You could e.g. generate the metalink from python and then use a
local metalink as source in the CopyProcess.
Once we release 4.9.1 you will be also able to do a multi-source download
using a metalink.
However, this wont work for uploads.
Cheers,
Michal
________________________________________
From: Adrian Sevcenco
Sent: 28 March 2019 16:03
To: Michal Kamil Simon;
[log in to unmask]
Subject: Re: xrootd python :: CopyProcess - stop the queue if a job succeed
On 3/28/19 4:35 PM, Michal Kamil Simon wrote:
> Hi Adrian,
Hi!
> My impression (correct me if I'm wrong) is that you are trying to do a multi-source transfer,
> right?
well, that would have been the optimal result, but at this moment i was just trying
to download a file while trying all replicas
> If so, you need to specify in the CopyProcess the sourceLimit, and as a source you need
> to specify a metalink containing all the replicas, or a manager (in this case the client will
> figure out what the replicas are by itself by using locate).
my case is a little special ... the same file have multiple replicas that have _different_ physical names
and authz envelopes ...
as a client i have all required info.. i know for my logical file name /alice/cern.ch/user/a/asevcenc/testfile
that the actual links are :
root://eosalice.cern.ch:1094//06/17419/a7f1c690-4e49-11e9-8a64-0242266c4d21?_LONG_STRING_OF_OPTIONS_
and
root://ipngridxrd0.in2p3.fr:1094//06/17419/a7f1c690-4e49-11e9-8a64-0242266c4d21?_LONG_STRING_OF_OPTIONS_
how can i create/what is the format of a metalink?
can i somehow put toghether the remote links from above?
would the same mechanism work for upload?
> I just pushed a patch for the client that is enabling multi-source download in python bindings
> (63e9604) and will port it for 4.9.1.
great! thanks a lot!!!
Adrian
>
> Cheers,
> Michal
> ________________________________________
> From:
[log in to unmask] [
[log in to unmask]] on behalf of Adrian Sevcenco [
[log in to unmask]]
> Sent: 28 March 2019 14:22
> To:
[log in to unmask]
> Subject: xrootd python :: CopyProcess - stop the queue if a job succeed
>
> Hi! In my use case (ALICE), to download a file, i get all replicas
> and i add them as copy jobs to a CopyProcess ..
> I would like to stop the CopyProcess when a job is succesful ..
> Is there a way to do this?
> Maybe in MyCopyProgressHandler.end() to check if results['status'] have
> a "status: 0" and cancel all CopyProcess?
> Is there a way to stop a CopyProcess? or other way to take into account the posibility
> of multiple replicas?
>
> Thank you!
> Adrian
>
>
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>