Print

Print


On 8/19/19 4:31 PM, Michal Kamil Simon wrote:
> Hi Adrian,
> 
> Number of chunks is not the same thing as the -S|--streams option
> from xrdcp.
> 
> Number of parallel chunks is set via XRD_CPPARALLELCHUNKS,
> Number of streams is set via XRD_SUBSTREAMSPERCHANNEL.
ok, then, looking at
https://github.com/xrootd/xrootd/blob/master/bindings/python/libs/client/copyprocess.py#L73

means that the python bindings does not have the streams option ..
should i create a issue?

Thanks a lot!
Adrian

> Number of chunks means how many in-fly data-chunks we can have
> per channel. Number of streams means how many physical tcp connections
> we have per channel.
> Number of sources is the maximum number of sources (data servers)
> that will be used for extreme-copy. Of course each data source will have its
> own communication channel, so 'chunks' and 'streams' are per source.
> 
> As we use non-block I/O neither adding sources, streams nor chunks will
> create new threads.
> 
> I hope that helps. Don't hesitate to ask if you need more clarification on this
> subject!
> 
> Cheers,
> Michal
> ________________________________________
> From: Adrian Sevcenco
> Sent: 17 August 2019 13:20
> To: [log in to unmask]; Michal Kamil Simon
> Subject: python chunks and xrdcp streams equivalent?
> 
> Hi! Is the chunks number (from python bindings) and the -S|--streams
> from xrdcp the same thing?
> 
> moreover, will this multiply with the number of sources?
> so, with chunks=4 and sources=2, there will be 8 download threads (per
> file)?
> 
> Thank you!
> Adrian
> 


########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1