@simonmichal: Indeed, we are using the xrootd-hdfs
plugin and also enabling CMS TFC support to XrootD. The configuration lines we used for this come from the sample configuration file in XRootD for hadoop (xrootd.sample.hdfs.cfg)
# Add Hadoop support
xrootd.fslib /usr/lib64/libXrdOfs.so
ofs.osslib /usr/lib64/libXrdHdfs.so
# Integrate with CMS TFC, placed in /etc/xrootd/storage.xml
oss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage.xml?protocol=hadoop
where the mapping for the hadoop protocol in storage.xml is:
<!-- Hadoop protocol rules-->
<lfn-to-pfn protocol="hadoop" destination-match=".*" path-match="//+store/(.*)" result="/hadoop/store/$1"/>
<lfn-to-pfn protocol="hadoop" destination-match=".*" path-match="//+store/user/(.*)" result="/hadoop/store/user/$1"/>
<!-- Translation rules for PFN to LFN (Physical File Name to Logical File Name -->
<pfn-to-lfn protocol="hadoop" destination-match=".*" path-match="/hadoop/store/(.*)" result="/store/$1"/>
Let me know if you need more details!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/xrootd/xrootd","title":"xrootd/xrootd","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/xrootd/xrootd"}},"updates":{"snippets":[{"icon":"PERSON","message":"@khurtado in #403: @simonmichal: Indeed, we are using the `xrootd-hdfs` plugin and also enabling CMS TFC support to XrootD. The configuration lines we used for this come from the sample configuration file in XRootD for hadoop (xrootd.sample.hdfs.cfg)\r\n```\r\n# Add Hadoop support\r\nxrootd.fslib /usr/lib64/libXrdOfs.so\r\nofs.osslib /usr/lib64/libXrdHdfs.so\r\n\r\n# Integrate with CMS TFC, placed in /etc/xrootd/storage.xml\r\noss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage.xml?protocol=hadoop\r\n```\r\nwhere the mapping for the hadoop protocol in storage.xml is:\r\n```\r\n\u003c!-- Hadoop protocol rules--\u003e\r\n \u003clfn-to-pfn protocol=\"hadoop\" destination-match=\".*\" path-match=\"//+store/(.*)\" result=\"/hadoop/store/$1\"/\u003e\r\n \u003clfn-to-pfn protocol=\"hadoop\" destination-match=\".*\" path-match=\"//+store/user/(.*)\" result=\"/hadoop/store/user/$1\"/\u003e\r\n\r\n\u003c!-- Translation rules for PFN to LFN (Physical File Name to Logical File Name --\u003e\r\n \u003cpfn-to-lfn protocol=\"hadoop\" destination-match=\".*\" path-match=\"/hadoop/store/(.*)\" result=\"/store/$1\"/\u003e\r\n```\r\n\r\nLet me know if you need more details!\r\n"}],"action":{"name":"View Issue","url":"https://github.com/xrootd/xrootd/issues/403#issuecomment-248028833"}}}
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1