On 8/21/19 10:57 AM, Michal Kamil Simon wrote:
> Hi Adrian,
Hi!
> Yes, please create an issue for the #streams in python copy job.
> (thanks for noticing!)
done, thanks a lot!!
https://github.com/xrootd/xrootd/issues/1044
Adrian
>
> Cheers,
> Michal
> ________________________________________
> From: Adrian Sevcenco
> Sent: 21 August 2019 02:50
> To: Michal Kamil Simon; [log in to unmask]
> Subject: Re: python chunks and xrdcp streams equivalent?
>
> On 8/19/19 4:31 PM, Michal Kamil Simon wrote:
>> Hi Adrian,
>>
>> Number of chunks is not the same thing as the -S|--streams option
>> from xrdcp.
>>
>> Number of parallel chunks is set via XRD_CPPARALLELCHUNKS,
>> Number of streams is set via XRD_SUBSTREAMSPERCHANNEL.
> ok, then, looking at
> https://github.com/xrootd/xrootd/blob/master/bindings/python/libs/client/copyprocess.py#L73
>
> means that the python bindings does not have the streams option ..
> should i create a issue?
>
> Thanks a lot!
> Adrian
>
>> Number of chunks means how many in-fly data-chunks we can have
>> per channel. Number of streams means how many physical tcp connections
>> we have per channel.
>> Number of sources is the maximum number of sources (data servers)
>> that will be used for extreme-copy. Of course each data source will have its
>> own communication channel, so 'chunks' and 'streams' are per source.
>>
>> As we use non-block I/O neither adding sources, streams nor chunks will
>> create new threads.
>>
>> I hope that helps. Don't hesitate to ask if you need more clarification on this
>> subject!
>>
>> Cheers,
>> Michal
>> ________________________________________
>> From: Adrian Sevcenco
>> Sent: 17 August 2019 13:20
>> To: [log in to unmask]; Michal Kamil Simon
>> Subject: python chunks and xrdcp streams equivalent?
>>
>> Hi! Is the chunks number (from python bindings) and the -S|--streams
>> from xrdcp the same thing?
>>
>> moreover, will this multiply with the number of sources?
>> so, with chunks=4 and sources=2, there will be 8 download threads (per
>> file)?
>>
>> Thank you!
>> Adrian
>>
>
>
>
--
----------------------------------------------
Adrian Sevcenco, Ph.D. |
Institute of Space Science - ISS, Romania |
adrian.sevcenco at {cern.ch,spacescience.ro} |
----------------------------------------------
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
