I don’t know if I correctly understand you. In my case, I use a script for TPC copying, and I do this in the script


xrdcp --server -f $src root://$XRDXROOTD_PROXY/$dst

Here XRDXROOTD_PROXY is actually the hostname pointed by the pss.origin (which I guess is the CEPH storage in your case). Does this address your problem? The name XRDXROOTD_PROXY is misleading. I though Andy was going to it a new name…

--
Wei Yang | [log in to unmask]<mailto:[log in to unmask]> | 650-926-3338 (O)


From: Giuseppe <[log in to unmask]>
Reply-To: xrootd/xrootd <[log in to unmask]>
Date: Thursday, June 7, 2018 at 2:08 AM
To: xrootd/xrootd <[log in to unmask]>
Cc: Subscribed <[log in to unmask]>
Subject: [xrootd/xrootd] RFE: TPC should support the case of a destination xrootd running on top of external storage (Ceph) (#729)


As discussed with @simonmichal<https://github.com/simonmichal>, we have the case of xrootd servers that run as gateways in front of a Ceph storage (but for the context of this issue, this can be any external non-local storage).

The current TPC runs in such a way that the destination pulling the file, for efficiency reasons, uses a stripped-down URL for the destination, which does not include the server (root://localhost...) and instead only includes the file path. This makes such a case of xrootd gateways break as the file path cannot be interpreted as a local path.

A possible solution is to have the destination server choose (e.g. by a configuration option) whether to use a local path or a full root URL: that would allow forcing the traffic to go through the xrootd local server, which already knows how to forward it to the external storage.


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub<https://github.com/xrootd/xrootd/issues/729>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AE9TA7h6QwlXRnktIdhR0ktTIX4i_oDcks5t6O1rgaJpZM4UeBP8>.


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

{"@context":"http://schema.org","@type":"EmailMessage","potentialAction":{"@type":"ViewAction","target":"https://github.com/xrootd/xrootd/issues/729#issuecomment-395533643","url":"https://github.com/xrootd/xrootd/issues/729#issuecomment-395533643","name":"View Issue"},"description":"View this Issue on GitHub","publisher":{"@type":"Organization","name":"GitHub","url":"https://github.com"}} {"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/xrootd/xrootd","title":"xrootd/xrootd","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/xrootd/xrootd"}},"updates":{"snippets":[{"icon":"PERSON","message":"@wyang007 in #729: I don’t know if I correctly understand you. In my case, I use a script for TPC copying, and I do this in the script\r\n\r\n\r\nxrdcp --server -f $src root://$XRDXROOTD_PROXY/$dst\r\n\r\nHere XRDXROOTD_PROXY is actually the hostname pointed by the pss.origin (which I guess is the CEPH storage in your case). Does this address your problem? The name XRDXROOTD_PROXY is misleading. I though Andy was going to it a new name…\r\n\r\n--\r\nWei Yang | [log in to unmask]\u003cmailto:[log in to unmask]\u003e | 650-926-3338 (O)\r\n\r\n\r\nFrom: Giuseppe \[log in to unmask]\u003e\r\nReply-To: xrootd/xrootd \[log in to unmask]\u003e\r\nDate: Thursday, June 7, 2018 at 2:08 AM\r\nTo: xrootd/xrootd \[log in to unmask]\u003e\r\nCc: Subscribed \[log in to unmask]\u003e\r\nSubject: [xrootd/xrootd] RFE: TPC should support the case of a destination xrootd running on top of external storage (Ceph) (#729)\r\n\r\n\r\nAs discussed with @simonmichal\u003chttps://github.com/simonmichal\u003e, we have the case of xrootd servers that run as gateways in front of a Ceph storage (but for the context of this issue, this can be any external non-local storage).\r\n\r\nThe current TPC runs in such a way that the destination pulling the file, for efficiency reasons, uses a stripped-down URL for the destination, which does not include the server (root://localhost...) and instead only includes the file path. This makes such a case of xrootd gateways break as the file path cannot be interpreted as a local path.\r\n\r\nA possible solution is to have the destination server choose (e.g. by a configuration option) whether to use a local path or a full root URL: that would allow forcing the traffic to go through the xrootd local server, which already knows how to forward it to the external storage.\r\n\r\n—\r\nYou are receiving this because you are subscribed to this thread.\r\nReply to this email directly, view it on GitHub\u003chttps://github.com/xrootd/xrootd/issues/729\u003e, or mute the thread\u003chttps://github.com/notifications/unsubscribe-auth/AE9TA7h6QwlXRnktIdhR0ktTIX4i_oDcks5t6O1rgaJpZM4UeBP8\u003e.\r\n"}],"action":{"name":"View Issue","url":"https://github.com/xrootd/xrootd/issues/729#issuecomment-395533643"}}} { "@type": "MessageCard", "@context": "http://schema.org/extensions", "hideOriginalBody": "false", "originator": "AF6C5A86-E920-430C-9C59-A73278B5EFEB", "title": "Re: [xrootd/xrootd] RFE: TPC should support the case of a destination xrootd running on top of external storage (Ceph) (#729)", "sections": [ { "text": "", "activityTitle": "**Wei Yang**", "activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png", "activitySubtitle": "@wyang007", "facts": [ ] } ], "potentialAction": [ { "name": "Add a comment", "@type": "ActionCard", "inputs": [ { "isMultiLine": true, "@type": "TextInput", "id": "IssueComment", "isRequired": false } ], "actions": [ { "name": "Comment", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"IssueComment\",\n\"repositoryFullName\": \"xrootd/xrootd\",\n\"issueId\": 729,\n\"IssueComment\": \"{{IssueComment.value}}\"\n}" } ] }, { "name": "Close issue", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"IssueClose\",\n\"repositoryFullName\": \"xrootd/xrootd\",\n\"issueId\": 729\n}" }, { "targets": [ { "os": "default", "uri": "https://github.com/xrootd/xrootd/issues/729#issuecomment-395533643" } ], "@type": "OpenUri", "name": "View on GitHub" }, { "name": "Unsubscribe", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"MuteNotification\",\n\"threadId\": 343413756\n}" } ], "themeColor": "26292E" }

Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1