Print

Print


Hi Adrian,

Yes, please create an issue for the #streams in python copy job.
(thanks for noticing!)

Cheers,
Michal
________________________________________
From: Adrian Sevcenco
Sent: 21 August 2019 02:50
To: Michal Kamil Simon; [log in to unmask]
Subject: Re: python chunks and xrdcp streams equivalent?

On 8/19/19 4:31 PM, Michal Kamil Simon wrote:
> Hi Adrian,
>
> Number of chunks is not the same thing as the -S|--streams option
> from xrdcp.
>
> Number of parallel chunks is set via XRD_CPPARALLELCHUNKS,
> Number of streams is set via XRD_SUBSTREAMSPERCHANNEL.
ok, then, looking at
https://github.com/xrootd/xrootd/blob/master/bindings/python/libs/client/copyprocess.py#L73

means that the python bindings does not have the streams option ..
should i create a issue?

Thanks a lot!
Adrian

> Number of chunks means how many in-fly data-chunks we can have
> per channel. Number of streams means how many physical tcp connections
> we have per channel.
> Number of sources is the maximum number of sources (data servers)
> that will be used for extreme-copy. Of course each data source will have its
> own communication channel, so 'chunks' and 'streams' are per source.
>
> As we use non-block I/O neither adding sources, streams nor chunks will
> create new threads.
>
> I hope that helps. Don't hesitate to ask if you need more clarification on this
> subject!
>
> Cheers,
> Michal
> ________________________________________
> From: Adrian Sevcenco
> Sent: 17 August 2019 13:20
> To: [log in to unmask]; Michal Kamil Simon
> Subject: python chunks and xrdcp streams equivalent?
>
> Hi! Is the chunks number (from python bindings) and the -S|--streams
> from xrdcp the same thing?
>
> moreover, will this multiply with the number of sources?
> so, with chunks=4 and sources=2, there will be 8 download threads (per
> file)?
>
> Thank you!
> Adrian
>


########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1