Print

Print


@simonmichal: Indeed, we are using the xrootd-hdfs plugin and also enabling CMS TFC support to XrootD. The configuration lines we used for this come from the sample configuration file in XRootD for hadoop (xrootd.sample.hdfs.cfg)

# Add Hadoop support
xrootd.fslib /usr/lib64/libXrdOfs.so
ofs.osslib /usr/lib64/libXrdHdfs.so

# Integrate with CMS TFC, placed in /etc/xrootd/storage.xml
oss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage.xml?protocol=hadoop

where the mapping for the hadoop protocol in storage.xml is:

<!-- Hadoop protocol rules-->
  <lfn-to-pfn protocol="hadoop" destination-match=".*" path-match="//+store/(.*)"        result="/hadoop/store/$1"/>
  <lfn-to-pfn protocol="hadoop" destination-match=".*" path-match="//+store/user/(.*)"   result="/hadoop/store/user/$1"/>

<!-- Translation rules for PFN to LFN (Physical File Name to Logical File Name -->
  <pfn-to-lfn protocol="hadoop" destination-match=".*" path-match="/hadoop/store/(.*)"         result="/store/$1"/>

Let me know if you need more details!


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/xrootd/xrootd","title":"xrootd/xrootd","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/xrootd/xrootd"}},"updates":{"snippets":[{"icon":"PERSON","message":"@khurtado in #403: @simonmichal: Indeed, we are using the `xrootd-hdfs` plugin and also enabling CMS TFC support to XrootD. The configuration lines we used for this come from the sample configuration file in XRootD for hadoop (xrootd.sample.hdfs.cfg)\r\n```\r\n# Add Hadoop support\r\nxrootd.fslib /usr/lib64/libXrdOfs.so\r\nofs.osslib /usr/lib64/libXrdHdfs.so\r\n\r\n# Integrate with CMS TFC, placed in /etc/xrootd/storage.xml\r\noss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage.xml?protocol=hadoop\r\n```\r\nwhere the mapping for the hadoop protocol in storage.xml is:\r\n```\r\n\u003c!-- Hadoop protocol rules--\u003e\r\n \u003clfn-to-pfn protocol=\"hadoop\" destination-match=\".*\" path-match=\"//+store/(.*)\" result=\"/hadoop/store/$1\"/\u003e\r\n \u003clfn-to-pfn protocol=\"hadoop\" destination-match=\".*\" path-match=\"//+store/user/(.*)\" result=\"/hadoop/store/user/$1\"/\u003e\r\n\r\n\u003c!-- Translation rules for PFN to LFN (Physical File Name to Logical File Name --\u003e\r\n \u003cpfn-to-lfn protocol=\"hadoop\" destination-match=\".*\" path-match=\"/hadoop/store/(.*)\" result=\"/store/$1\"/\u003e\r\n```\r\n\r\nLet me know if you need more details!\r\n"}],"action":{"name":"View Issue","url":"https://github.com/xrootd/xrootd/issues/403#issuecomment-248028833"}}}

Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1