Hi Andy and Wei,
while building the library works so far, the test fails as it uses some
"-A" flag [1], which seems to be unknown to the per default shipped
xrdcp [2].
I tried bluntly to run the test with the flag removed [3] but failed now
with http as unknown protocol -- I guess, that -A is the http flag then? ;)
I.e., as the vanilla packages do not ship with http included, I would
need to build from a dev branch, or?
Cheers,
Thomas
[1]
> wget -O -
http://ecsft.cern.ch:80/dist/cvmfs/builddeps/caddy-linux-amd64 >
/dev/null 2>&1 | sha1sum
da39a3ee5e6b4b0d3255bfef95601890afd80709 -
> XROOTD_PREFIX=/usr/ ./test/run_test.sh
Downloading: http://ecsft.cern.ch:80/dist/cvmfs/builddeps/caddy-linux-amd64
\nRunning test case 000: Download files from an HTTP source\n
Using test workspace: /tmp/xrdclhttp-test-ws.EQiSaTECLX
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.EQiSaTECLX/in/1f65ecaa0765e164fced1787afd96cd0132dfb3b
xrdcp: Invalid option, '-A'.
Usage: xrdcp [<options>] <src> [<src> [. . .]] <dest>
Options: [--cksum <args>] [--debug <lvl>] [--coerce] [--dynamic-src]
[--force] [--help] [--infiles <fn>] [--license] [--nopbar]
[--path] [--posc] [--proxy <host>:<port>] [--recursive]
[--retry <n>] [--server] [--silent] [--sources <n>] [--streams <n>]
[--tpc {first|only}] [--verbose] [--version] [--xrate <rate>]
[--parallel <n>] [--zip <file>]
<src>: [[x]root://<host>[:<port>]/]<path> | -
<dest>: [[x]root://<host>[:<port>]/]<path> | -
sha1sum:
/tmp/xrdclhttp-test-ws.EQiSaTECLX/out/1f65ecaa0765e164fced1787afd96cd0132dfb3b:
No such file or directory
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.EQiSaTECLX/in/1f65ecaa0765e164fced1787afd96cd0132dfb3b
SHA1 (in): 1f65ecaa0765e164fced1787afd96cd0132dfb3b
SHA1 (out):
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.EQiSaTECLX
\nRunning test case 001: Download files from deep paths at an HTTP source\n
Using test workspace: /tmp/xrdclhttp-test-ws.OqMQcNwsdi
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.OqMQcNwsdi/in/aaa/bbb/ccc/6c5571896c849c4f93d925dcecfdf1bc8441b4f5
xrdcp: Invalid option, '-A'.
Usage: xrdcp [<options>] <src> [<src> [. . .]] <dest>
Options: [--cksum <args>] [--debug <lvl>] [--coerce] [--dynamic-src]
[--force] [--help] [--infiles <fn>] [--license] [--nopbar]
[--path] [--posc] [--proxy <host>:<port>] [--recursive]
[--retry <n>] [--server] [--silent] [--sources <n>] [--streams <n>]
[--tpc {first|only}] [--verbose] [--version] [--xrate <rate>]
[--parallel <n>] [--zip <file>]
<src>: [[x]root://<host>[:<port>]/]<path> | -
<dest>: [[x]root://<host>[:<port>]/]<path> | -
sha1sum:
/tmp/xrdclhttp-test-ws.OqMQcNwsdi/out/6c5571896c849c4f93d925dcecfdf1bc8441b4f5:
No such file or directory
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.OqMQcNwsdi/in/aaa/bbb/ccc/6c5571896c849c4f93d925dcecfdf1bc8441b4f5
SHA1 (in): 6c5571896c849c4f93d925dcecfdf1bc8441b4f5
SHA1 (out):
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.OqMQcNwsdi
\nRunning test case 002: Upload files to an HTTP destination\n
Using test workspace: /tmp/xrdclhttp-test-ws.IfYCUcCu1N
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.IfYCUcCu1N/in/000e1bec427ffa0bb1c6c9742edff72ead11d367
xrdcp: Invalid option, '-A'.
Usage: xrdcp [<options>] <src> [<src> [. . .]] <dest>
Options: [--cksum <args>] [--debug <lvl>] [--coerce] [--dynamic-src]
[--force] [--help] [--infiles <fn>] [--license] [--nopbar]
[--path] [--posc] [--proxy <host>:<port>] [--recursive]
[--retry <n>] [--server] [--silent] [--sources <n>] [--streams <n>]
[--tpc {first|only}] [--verbose] [--version] [--xrate <rate>]
[--parallel <n>] [--zip <file>]
<src>: [[x]root://<host>[:<port>]/]<path> | -
<dest>: [[x]root://<host>[:<port>]/]<path> | -
xrdcp: Invalid option, '-A'.
Usage: xrdcp [<options>] <src> [<src> [. . .]] <dest>
Options: [--cksum <args>] [--debug <lvl>] [--coerce] [--dynamic-src]
[--force] [--help] [--infiles <fn>] [--license] [--nopbar]
[--path] [--posc] [--proxy <host>:<port>] [--recursive]
[--retry <n>] [--server] [--silent] [--sources <n>] [--streams <n>]
[--tpc {first|only}] [--verbose] [--version] [--xrate <rate>]
[--parallel <n>] [--zip <file>]
<src>: [[x]root://<host>[:<port>]/]<path> | -
<dest>: [[x]root://<host>[:<port>]/]<path> | -
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.IfYCUcCu1N/in/000e1bec427ffa0bb1c6c9742edff72ead11d367
SHA1 (in): 000e1bec427ffa0bb1c6c9742edff72ead11d367
SHA1 (out): adc83b19e793491b1c6ea0fd8b46cd9f32e592fc
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.IfYCUcCu1N
\nRunning test case 003: Upload files to a deep path at an HTTP
destination\n
Using test workspace: /tmp/xrdclhttp-test-ws.rBdjk6DcDI
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.rBdjk6DcDI/in/3eae83a79832ffa096bcb87d54f28d8695f60073
xrdcp: Invalid option, '-A'.
Usage: xrdcp [<options>] <src> [<src> [. . .]] <dest>
Options: [--cksum <args>] [--debug <lvl>] [--coerce] [--dynamic-src]
[--force] [--help] [--infiles <fn>] [--license] [--nopbar]
[--path] [--posc] [--proxy <host>:<port>] [--recursive]
[--retry <n>] [--server] [--silent] [--sources <n>] [--streams <n>]
[--tpc {first|only}] [--verbose] [--version] [--xrate <rate>]
[--parallel <n>] [--zip <file>]
<src>: [[x]root://<host>[:<port>]/]<path> | -
<dest>: [[x]root://<host>[:<port>]/]<path> | -
xrdcp: Invalid option, '-A'.
Usage: xrdcp [<options>] <src> [<src> [. . .]] <dest>
Options: [--cksum <args>] [--debug <lvl>] [--coerce] [--dynamic-src]
[--force] [--help] [--infiles <fn>] [--license] [--nopbar]
[--path] [--posc] [--proxy <host>:<port>] [--recursive]
[--retry <n>] [--server] [--silent] [--sources <n>] [--streams <n>]
[--tpc {first|only}] [--verbose] [--version] [--xrate <rate>]
[--parallel <n>] [--zip <file>]
<src>: [[x]root://<host>[:<port>]/]<path> | -
<dest>: [[x]root://<host>[:<port>]/]<path> | -
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.rBdjk6DcDI/in/3eae83a79832ffa096bcb87d54f28d8695f60073
SHA1 (in): 3eae83a79832ffa096bcb87d54f28d8695f60073
SHA1 (out): adc83b19e793491b1c6ea0fd8b46cd9f32e592fc
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.rBdjk6DcDI
Finished.
[2]
xrootd-client-libs-4.8.4-1.el7.x86_64
xrootd-server-libs-4.8.4-1.el7.x86_64
xrootd-server-devel-4.8.4-1.el7.x86_64
xrootd-libs-4.8.4-1.el7.x86_64
xrootd-client-4.8.4-1.el7.x86_64
xrootd-client-devel-4.8.4-1.el7.x86_64
xrootd-server-4.8.4-1.el7.x86_64
xrootd-rucioN2N-for-Xcache-1.0-0.el7.centos.x86_64
python2-xrootd-4.8.4-1.el7.x86_64
xrootd-devel-4.8.4-1.el7.x86_64
xrootd-selinux-4.8.4-1.el7.noarch
xrootd-4.8.4-1.el7.x86_64
[3]
sed -i 's/xrdcp -A/xrdcp/g' ./test/cases/00X.sh
> XROOTD_PREFIX=/usr/ ./test/run_test.sh
\nRunning test case 000: Download files from an HTTP source\n
Using test workspace: /tmp/xrdclhttp-test-ws.DKdICDDJcm
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.DKdICDDJcm/in/06af3e7b39d1c747152b10d5adfe58d2d8fbe3af
xrdcp: http file protocol is not supported.
sha1sum:
/tmp/xrdclhttp-test-ws.DKdICDDJcm/out/06af3e7b39d1c747152b10d5adfe58d2d8fbe3af:
No such file or directory
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.DKdICDDJcm/in/06af3e7b39d1c747152b10d5adfe58d2d8fbe3af
SHA1 (in): 06af3e7b39d1c747152b10d5adfe58d2d8fbe3af
SHA1 (out):
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.DKdICDDJcm
\nRunning test case 001: Download files from deep paths at an HTTP source\n
Using test workspace: /tmp/xrdclhttp-test-ws.Oajo406aJ4
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.Oajo406aJ4/in/aaa/bbb/ccc/08edf64fc4cc40fc5212341705ba718d885fa19c
xrdcp: http file protocol is not supported.
sha1sum:
/tmp/xrdclhttp-test-ws.Oajo406aJ4/out/08edf64fc4cc40fc5212341705ba718d885fa19c:
No such file or directory
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.Oajo406aJ4/in/aaa/bbb/ccc/08edf64fc4cc40fc5212341705ba718d885fa19c
SHA1 (in): 08edf64fc4cc40fc5212341705ba718d885fa19c
SHA1 (out):
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.Oajo406aJ4
\nRunning test case 002: Upload files to an HTTP destination\n
Using test workspace: /tmp/xrdclhttp-test-ws.JPGsxWpT0i
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.JPGsxWpT0i/in/09333a8b0a842d2d5b28fec70b71b1b902d789e8
xrdcp: httpfile protocol is not supported.
xrdcp: http file protocol is not supported.
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.JPGsxWpT0i/in/09333a8b0a842d2d5b28fec70b71b1b902d789e8
SHA1 (in): 09333a8b0a842d2d5b28fec70b71b1b902d789e8
SHA1 (out): adc83b19e793491b1c6ea0fd8b46cd9f32e592fc
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.JPGsxWpT0i
\nRunning test case 003: Upload files to a deep path at an HTTP
destination\n
Using test workspace: /tmp/xrdclhttp-test-ws.YA3yXlEKLf
Starting Caddy... Activating privacy features... done.
http://localhost:8080
done.
Downloading:
/tmp/xrdclhttp-test-ws.YA3yXlEKLf/in/1aedaaf64b825b222b17f37da8ac625489c44c67
xrdcp: httpfile protocol is not supported.
xrdcp: http file protocol is not supported.
Error: incorrect transfer of file:
/tmp/xrdclhttp-test-ws.YA3yXlEKLf/in/1aedaaf64b825b222b17f37da8ac625489c44c67
SHA1 (in): 1aedaaf64b825b222b17f37da8ac625489c44c67
SHA1 (out): adc83b19e793491b1c6ea0fd8b46cd9f32e592fc
Stopping Caddy... done.
Cleaning up: /tmp/xrdclhttp-test-ws.YA3yXlEKLf
Finished.
On 19/02/2019 23.37, Andrew Hanushevsky wrote:
> Hi Thomas,
>
> Just to add to Wei's comments. The amount of documentation will be
> minimal. All you will need is the HTTP plugin, a slight change to he
> origin directive, and a line in the client config file.
>
> Andy
>
> -----Original Message----- From: Thomas Hartmann
> Sent: Friday, February 15, 2019 7:15 AM
> To: xrootd-l
> Subject: setting up Xcache as http reverse proxy
>
> Hi all,
>
> is there already documentation on using Xcache as http{s} proxy?
>
> Else, I assume that the way would be to build the plugin at
> https://github.com/xrootd/xrdcl-http
> and include it into the container, or?
>
> Cheers,
> Thomas
>
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
