I did some 100GE benchmarks and I notice the following when comparing parallel sockets vs extreme copy.

The single stream copy :

[root@node]# time xrdcp -y 1 e.meta4 /dev/null -f 
[9.766GB/9.766GB][100%][==================================================][2.441GB/s]  

real	0m4.887s
user	0m1.523s
sys	0m4.945s

The parallel socket implementation using 10 sockets:

[root@node]# time xrdcp -S 10 e.meta4 /dev/null -f 
[9.766GB/9.766GB][100%][==================================================][1.953GB/s]  

real	0m4.964s
user	0m1.688s
sys	0m4.998s

An extreme copy by using 10 named connections to the same xrootd server:

[root@node]# time xrdcp -y 10 e.meta4 /dev/null -f 
[9.766GB/9.766GB][100%][==================================================][9.766GB/s]  

real	0m0.947s
user	0m2.685s
sys	0m7.357s

It is fantastic, that I can run a single copy with 10 GB/s but I have to do some gymnastic to get this, while the easy defaults with single or parallel sockets have a much lower limit.

Maybe one could use the same switch for implicit extreme copy mode to specify the number of connections if the source is not a meta link file?
E.g.

xrdcp -y 10 root://server//10G /dev/null 

does implicit extreme copy from 10 named connections:

root://1@server//10G 
root://2@server//10G
root://3@server/10G
...
root://10@server//10G

Or do a fix to get the same result using the -S switch?

—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: <xrootd/xrootd/issues/1938@github.com>

Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1