Hi Andy,

Do you have any other thoughts about this given my last reply?

Many thanks,

George


From: Patargias, George (STFC,RAL,SC) <[log in to unmask]>
Sent: 16 December 2021 17:39
To: Andrew Hanushevsky <[log in to unmask]>
Subject: Re: XRootD TPC failing from XRootD native and dCache sources (ALICE)
 
Hi Andy,

Many thanks for the reply. I have set the ttl value to a value much larger than 7 secs

ofs.tpc autorm ttl 80 90 xfr 200 pgm /etc/xrootd/xrdcp-tpc.sh

According to the documentation, only gsi can be used with delegation

3.15.3    Third Party Copy Using Delegated Credentials

Third party copy can use delegated credentials to perform the copy for those authentication protocols that support delegation. Currently, only gsi authentication supports delegation.


so I am not sure how exactly the delegation can work with the ALICE auth tokens


Best,


George



From: [log in to unmask] <[log in to unmask]> on behalf of Andrew Hanushevsky <[log in to unmask]>
Sent: 15 December 2021 21:48
To: [log in to unmask] <[log in to unmask]>
Subject: Re: XRootD TPC failing from XRootD native and dCache sources (ALICE)
 
Hi George,

In the xrootd case, there are two ways of doing native TPC 1) rendezvous
token, and 2) delegated x509 credentials. It would appear, based oon the
message, a rendezvous token is being used. That token has a limited
lifetime. The default is 7 seconds. So, if the copy does not start within
this window it will fail with the message you see. You can increase the
amount of time using the ofs.tpc directive:

https://xrootd.slac.stanford.edu/doc/dev54/ofs_config.htm#_Toc89982392

Frankly, if you are already using x509 the better bet is to use delegated
copies which gets around this problem.

As for dCache, I don't know but I have copied this email to a dCache
person who may know.

Andy

On Wed, 15 Dec 2021, George Patargias - STFC UKRI wrote:

> Hello,
>
> As a follow up to the previous email, a direct XRootD transfer, from both the XRootD native and the dCache sources, to a local file system using the read envelope pasted below worked fine (and didn't work as expected if the envelope was omitted).
>
> In addition, TPC from EOS sources to our Ceph cluster also work.
>
> Best,
>
> George
>
> ________________________________
> From: Alastair Dewhurst <[log in to unmask]>
> Sent: 15 December 2021 12:49
> To: George Patargias - STFC UKRI <[log in to unmask]>
> Cc: Byrne, Thomas (STFC,RAL,SC) <[log in to unmask]>; Johnson, Ian (STFC,RAL,SC) <[log in to unmask]>; Packer, Alison (STFC,RAL,SC) <[log in to unmask]>
> Subject: Re: XRootD TPC failing from XRootD native and dCache sources (ALICE)
>
> Hi George
>
> Would it not be useful to also include the situations where the code works.  e.g. give an example of it working fine with EOS?
>
> Alastair
>
> On 15 Dec 2021, at 12:02, George Patargias - STFC UKRI <[log in to unmask]<mailto:[log in to unmask]>> wrote:
>
> Hello,
>
> We are struggling to make XRootD TPC from XRootD native and dCache sources
> work for ALICE. The destination, i.e our, SE is running Ceph (xrootd@proxy and
> xrootd@ceph)
>
> For some reason, the auth read envelope (pasted below) is not passed to the SE and
> we get the following errors
>
> In the case of XRootD native source
>
> Run: [ERROR] Server responded with an error: [3005] [ERROR] Server responded with an error: [3010] tpc authorization expired (source)
>
> In the case of dCache source
>
> Run: [ERROR] Server responded with an error: [3005] [ERROR] Server responded with an error: [3010] An authorization token is required for this request. (source)
>
> If you can give us any clues of what is going on that would be great!
>
> Many thanks,
>
> George
>
> **** XRootD Native ****
> xrdcp --tpc only --force --posc --nopbar 'root://rd.spacescience.ro:1094//home/aliprod/data/15/44156/4bab4f00-3014-11ec-b8b3-0242ee26aa8b?authz=-----BEGIN SEALED CIPHER-----
> fPuOKid+31dD0jT5TOoC2+r+NrdJFDeUSLk+FNRQ3pTAIRtxEzfhISgCwkC0I+276381KvsXa5jP
> W4tGSnAzStPhe81RjMmViXtNPIiwEflvJf1+VdAXRzOCreb+vGslFJIw9qNm9s2GmrGI7TDRHqlP
> LpY+3y62QzWnNOkJezs=
> -----END SEALED CIPHER-----
> -----BEGIN SEALED ENVELOPE-----
> AAAAgIGJ9r82V1aT5BgzqtU8Hvq2vWFB9zB+qMrowdS0izqNscs0A7bdNCuVohNZB6CglbsjZBQr
> IjngdHnvIz5tyN5TzqbnUXAKTOPxHikPZ96hTZgisEE3B0nm0ZQdNN+6duBfJSFmJg5gvx7ongqt
> ePNX-yRyc5iWu6dMka6ZLOMu0QPeKW5j9BOISR-RsnkQYnWCLDyDiWzasNp-x5pEjNRg1r+UgKun
> fZp0SU924mUmT85ytrAROb80wnsvQYUON9tYAj3zS3bq+qvpiOcIZRDxRklqE0vHzfEmNvAGZPWr
> 51Zf5qGyFAwY1N3aSDf7XHm7bFKemn-sZPrf7R9xdWuCjaJEwfqPg9aHSzH9tKZSjOq5AqwfsQem
> n7WvA7Mn9DjK9bKcckBUaLq0efy6U9dRS2ReqsC7pQi5A4EEzdfHWiTlS8yiGKsAKaoIIoo4ldQh
> DiNtrCCVzPPIOlb1MYXPqz3yrgHGh0nU3c2uWkzR--tfEnzyRy4waiYoWbs6CRzC+WyTUpZ2jhYH
> jhoELhpG+c84ZqtiOckJ+FWZIXHnIiUhNoRBbJ7kgsA-tKPmE6AMZwP8N1ItVpTbgZaiIHf9IVgN
> ENpFoD4YyZqIGhuF2Mho9bHC+tLgxLO-AXXZTcrqI3u9FtFp5i4ee2bDpLzTYb13hzAgnvxyM+cg
> wEuZeBUFDThA5epFH3TYzDaWpUHxOKhHebNpsrC15sTvnT8MlCRbcH76vezfxLG7uMpHUKg61QLZ
> gTVdp8l7OUmF-pqSFYr5WtCxDI7xT4l2kaLTEqt5QR1wL1o2xHrh+UBzOPd9k1X4SLDq5Q+7bnYK
> 4DMMgPCNIrx46HkOIWsBuNlnS-j7+ByaCpxhlBko8hI+U1s4yOvmEc+GFfkD98098a74-BNRfxUd
> D5iek6zDeMk56sN68GgxOgSr1I51FNRU9H0Jd6RY6sUlDxvuBagbHAQBQxEKlZKp+H+nOU9RvU4U
> OfMv6Ip4hoGmwKBNgCvJGKSh71MIuAFJQ-Hm29BxButvQ3w4QbojvXFdwiSmK03sJF8wn6ZZC2xC
> U8QbvTT8qGR2rLiRjm0=
> -----END SEALED ENVELOPE-----
> &eos.app=transfer-3rd' 'root://ceph-dev-gw2.gridpp.rl.ac.uk:1094/alice:/15/44156/4bab4f00-3014-11ec-b8b3-0242ee26aa8b?authz=-----BEGIN SEALED CIPHER-----
> bzagXbfYXh2Kqh3Kfw+JsknjdKoQFfqHmSE79l8VpWx6gKU8NZ4G3gxT5q7yw40rAEdu4eHjSmIZ
> tMKr818DNUBQ7KYc30esdRzH+ztSh71LeaRnL5SNol4RD+TCFSiQ4n0q3hY2vbdryAkYoirT5Vum
> -GsrLP+uFfwUM9Jvw2w=
> -----END SEALED CIPHER-----
> -----BEGIN SEALED ENVELOPE-----
> AAAAgJJ5f2qhE8b+WzbgjTgv5Ei+A5Qxs4jPAU-3kyJIyzsMsJJ0rtJDLx-1yHSlQrmKIqMNutE1
> zT+yEkTAu9-iwrpJOdkEuSDVtffNt9XUgutslUWkXT9sqqKaLaQFw7RRQ5lqIXAOiFWOGhdxR-pr
> KEjxUgwjqVVqQUhzQqSd+qOjwORz4tmRHCd+9-fi2UEkq6L3n-8jgGvpE7zxg0SbSJMCX7HUAA8G
> KU0tXRPkpWnDeis9paG69jAE17u+rMpoWRKya-ASjRsToKI0jUPpq0tbN3dZ3KlYvmkAExycyJcz
> ayl-kCgnPiIQoIqE2pZV83OjRmYvTPhI9D5yk-b2XDCOItWgeMLxQm1vInEEAvifrvx64QVqbcC8
> apVC1+kpItHxCWeIVNEvCJT0y6O0JhnokEPqCMAZ83iRFiRdx2XBcU9qAo2cy369YSpJ6+gaw43V
> SEe81X6Hm+jGmJrCUJA65Hu32QOcwoUcDTU+6BvOc9C5AKJaiwOkV4EzLH0TmVNcuQXM7DNhlhxA
> +ZoSQKcVwbZCz6ZUbc1iCMaWv7e31GYPqQgsHuEpFvI13X6yzErdS41u7GbCldcUKlxGWRrXp9v5
> PDNgTe8XUWms1-ptJZDk4JAOQLo4xlDZkD69FomkptsOt3xVMNdH6TKCQZhfg+SpDcb0h7uKHvua
> rnp61NVE+MxoQlfOKj0efptBboz8zPiKOZx2Nyoj2Lzh2fhPAA1TN2WutinAdFVfvC3L8ovApVv0
> uwZoe6paCT1YvT0Upgf9s4CcKo+KcTgzy6t7gza1B-h-MQ6cGaauYxOZP77dr6qSX2wSBrGdyTeq
> MsSF5eNG735IsjmR71if6M58K7XzPJuvtu+RkO1q76aypzO86ypWHFRC6uPirwuNuEGrycxj3yU4
> htkJ+v6EhXRhX7BTtjZHj7GSASeEXsIAaUOhvzvhW8WV4DENBe+RXo1mBenXw2BnsO88S6KtnfsW
> dIvUvOeGH4ycfs1a8yXZufJmMzSqW2EqvZezQQ5Kl1s6Fg4wDLbBn5ybucMd7wL2B29WGP2xCubV
> cRqXCe0H
> -----END SEALED ENVELOPE-----
> &eos.app=transfer-3rd'
>
> **** dCache ****
>
> xrdcp -d 3 --tpc only --force --posc --nopbar 'root://srm.ndgf.org:1094//NOLFN?authz=-----BEGIN SEALED CIPHER-----
> ZL4OKEvHvwaDMmKXUA+zsZ4mmLYqhh90V9v++F99GpbHu8nX3HTgzYAMjfODIFA7KWcU4eXujd30
> YO9jJDXPL1jdnyo7ym9yhE8gCCY4QoxLnD3xjeC06tEPX1U4ha8bj+Q0EBRPAbuXOqtW2rZAfEH5
> 6OCqvZvvZPGjcEmLtHg=
> -----END SEALED CIPHER-----
> -----BEGIN SEALED ENVELOPE-----
> AAAAgJl3Z2JamHvCK331bUyYfiqfoBV4YWjIV8yU7u7x3r0pAwVex0HqamsZ9myljjgcIgws8qNs
> Y3r7B3BMx+sPmNBeu6rAIvvG+xfTnRHWH8prI+j88zXsCCVio92EsDOY9NMgU03+x6l5kXziqy1j
> npxvXwIxaJXCfuEAOFwrQwT21f1VgkYE3FyBaglmrY4aMGyZ98jXxeCdVhjOLetFKiohRVnJaseq
> zYoY2dXXU0ssx98WWKOr1T5cUl2hp6lnMfChxeGHJVkMXU+VhQsSNL7Sk4uiTGydCUMSkwaW2qWl
> pN35k8LUNikZy4yVRfDcjkxWYaMLnxssnpu8jwckOUH2fcMH+jQX9VgtXh+gBVCGZEqiRETCQpbC
> V3DePKdgys+LdOLUlkGlXngVs2dTZNQq2sftpZ9EkITgosY5ZGGlHDtCyabriNyS5MJ5KvY3oLsc
> jRwz6rv0KOGs8IfzHFBerhErsLORSpULGEtZ-0K2Ixbx2raTCB2z7O13QGAhEqOLd3oAEuxQDg+t
> DSCsBqsIBRT4z34KCFvtFzqy45O+IIkRg-Qykk4CVotqsc0nHf04CYYDCwpsnm+mA2DB-smq0aio
> sjbqiyjLnDnQN2b2w0ko5YqyPGK1JClmcuU38v9qPXN2b33YiUqHkM5ZkH7nYBbeo77onX+W-1Qs
> BhGcZ+5jITDq-ljuyD40VnoVaflP7GhlBCwDs1VBkKErnJfQJZFjau7FJMuFnTcv7QMFG3d2fsLP
> aZf7SLnDX-AMkx-Q4+AGFehp4ceov0tCYInJ5I88s+JsnxV2fmfuVYoWquE3UlzYIwTsZobBCyS8
> rbm47BhJxAxMyH4BLsRL32+7iiok6gqhf7jUIESROdBo5hOWymkD5lnoeNMyuNA7EHb3kqGQzw5W
> QHR1HTVPiNiEw130vLJExcRY599QNBejzCk82bB7e728JJPXYUDbMn5sLGlJLAuLrS-Z1vHuPBE8
> mRRv497BGGXYGLyV7k-7aed3BAiquqjsurLK2mAWU6kX0wIjoAWsXmWYIlZW3UFxjEjphTWbgg==
> -----END SEALED ENVELOPE-----
> &eos.app=transfer-3rd' 'root://ceph-dev-gw2.gridpp.rl.ac.uk:1094/alice:/05/30011/802c7880-3014-11ec-b8b3-0242ee26aa8b?authz=-----BEGIN SEALED CIPHER-----
> d-kOKtQ7OB6OVblZrvvvLD9B8VIAqmuPK89sxDHkev27OKXgN1ZYrf4+Ujm69hsYKdPCful8GDTk
> jYRBgfRTs-vIIEL7KK4rAUrku+tcledTgTiNguYdT6KUkdQwAOi2bb8kOscHKVEEHKz4IqVQ95PL
> 7kPDaYrocFv3k9R4uoE=
> -----END SEALED CIPHER-----
> -----BEGIN SEALED ENVELOPE-----
> AAAAgG0W57nC+1toPKDOKzvSE5c3dOaaMuzvVZh8JujqlYdB36sAizentUc-4q3WV6Tph46V6TGc
> p9GYo1QGuTikPH9YpKBJ9V846vorwTgzs0PLMfgB2724VvNu7L19iHhJWTF10BpJYNRCrNpeAXGn
> SzrVSlEEAFeDGKAFMMzEGMPq91S-ToDkm0pKxog7UwICWt5a17J-NChu1WQJQeCPbKCcj9b9JVaq
> BQNr0fySNMtXHhS2GAd3bOcSaYtn4u2Bx14kMCU-8Z3ojoc19-XosqCnJB3CzTX+RaU4DQv3xndd
> rOXhkOzUm1WPKInm6K91+15Pm4kcu2mpa7W0s0SfZzVNu9V9e+qLRRyDBT0K8-U9mRS+MHWyCi9O
> pcWz7TAg3VqPfDl8eOBvr7tY5ljE1QDFwGqhiLxC+EaT2gyZ6sPBHDHJZy0KFZpGZ7nm3qLtfJdD
> FRLP+KZ5N5d0jiUrRtPH1lb-EUxkstqjMkpo8kU4f1BdwQnJHMW4wrOZdLjtOcqHyCvOZqVzV4Te
> jZQYGtTILgN3+l4MMR1-gf7X06EtXEodR3kStAiHbfFYRYe1HNC5JCkXh5gE+V7RmP6ywPOFMpQy
> GYhfoI8W+5Wri45qp6Mb-15+VxmI4frDRxr31LhKN0JG2p5J4VqE1BNiJ-ClkS1b0yiuMgYUw2ED
> PnAo9rKiniaVhGvx8peEswB6U901xrM9q6FiGqzUbycXZh+CC3WA7JIY8gGP99-deNNZgLuUZ+1Z
> OqhIxXUCYTjeuuIA0q4zdk+AZftJnh4GwdpygttWHmIN1rKtFzklwm7qJ40PK7d5RiGlleUPiY0X
> nVEM3k6wCnRIw8cX4ypsNHZSKq7kjlWTeoVw8SP8dvmaLFPEnVUb4sAOMmCD07TNWu2+IsnYCuE5
> 8zgT6boEfG+ThkeztzDDbw9L3BeOu7HUJVShm8ig8oBHhzTNf+wOmg8vRj676v5yTm7v5TA+bLQC
> j+r57ZNJ3QzvBkWBWVYwkORakavY51Tr7A12FKm0s0lZ8cun+0TYCmBY3wmk85N-2nnaTB8rU-aU
> EGtj6DWG
> -----END SEALED ENVELOPE-----
> &eos.app=transfer-3rd'
> This email and any attachments are intended solely for the use of the named recipients. If you are not the intended recipient you must not use, disclose, copy or distribute this email or any of its attachments and should notify the sender immediately and delete this email from your system. UK Research and Innovation (UKRI) has taken every reasonable precaution to minimise risk of this email or any attachments containing viruses or malware but the recipient should carry out its own virus and malware checks before opening the attachments. UKRI does not accept any liability for any losses or damages which the recipient may sustain due to presence of any viruses.
>
> ________________________________
> Use REPLY-ALL to reply to list
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>
>
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1


Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1