Print

Print


Hi Adrian,

Number of chunks is not the same thing as the -S|--streams option
from xrdcp.

Number of parallel chunks is set via XRD_CPPARALLELCHUNKS,
Number of streams is set via XRD_SUBSTREAMSPERCHANNEL.

Number of chunks means how many in-fly data-chunks we can have
per channel. Number of streams means how many physical tcp connections
we have per channel.
Number of sources is the maximum number of sources (data servers)
that will be used for extreme-copy. Of course each data source will have its 
own communication channel, so 'chunks' and 'streams' are per source.

As we use non-block I/O neither adding sources, streams nor chunks will
create new threads.

I hope that helps. Don't hesitate to ask if you need more clarification on this
subject!

Cheers,
Michal
________________________________________
From: Adrian Sevcenco
Sent: 17 August 2019 13:20
To: [log in to unmask]; Michal Kamil Simon
Subject: python chunks and xrdcp streams equivalent?

Hi! Is the chunks number (from python bindings) and the -S|--streams
from xrdcp the same thing?

moreover, will this multiply with the number of sources?
so, with chunks=4 and sources=2, there will be 8 download threads (per
file)?

Thank you!
Adrian


########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1