Print

Print


Following setup:
- Redirector without direct filesystem access, configured like:
```cms.dfs limit 0 lookup distrib mdhold 0 redirect immed retries 2```
- All data nodes have access to the files (i.e. shared filesystem behind them). 

Now, listing a directory with `xrdfs` works fine:
```
$ xrdfs redirector.example.com ls -ul /cephfs/grid/atlas/user/scratch/freyermu
/cephfs/grid/atlas/user/scratch/freyermu/bla.root
/cephfs/grid/atlas/user/scratch/freyermu/blub
```
and on the redirector, I see:
```
Decode xrootd sent XXX@YYY 'Swxrootd003.example.com Swxrootd001.example.com:1094 Swxrootd006.example.com:1094 Swxrootd007.example.com:1094 Swxrootd002.example.com Swxrootd004.example.com Swxrootd005.example.com:1094' */cephfs/grid/atlas/user/scratch/freyermu
```
Up to now, all is well. But `xrdcp -r` fails:

```
$ xrdcp --debug 1 -r xroot://redirector.example.com:1094//cephfs/grid/atlas/user/scratch/freyermu/ bla/
[2019-03-29 19:55:19.309750 +0100][Info   ][App               ] Failed to get directory listing for xroot://redirector.example.com:1094//cephfs/grid/atlas/user/scratch/freyermu/: Unable to open directory /cephfs/grid/atlas/user/scratch/freyermu/; no such file or directory
Error indexing remote directory.
```
In the logs of the redirector, I find:
```
Decode xrootd redirects XXX@YYY to xrootd001.example.com:1094 /cephfs/grid/atlas/user/scratch/freyermu/
ofs_opendir: XXX@YYY Unable to open directory /cephfs/grid/atlas/user/scratch/freyermu/; no such file or directory
```
So for some reason, it seems that the directory listing requested by `xrdcp -r` is not honuring `lookup distrib` but performed on the redirector - even worse, the redirector checks locally instead of performing a distributed lookup itself. 

Doing an `xrdcp` of single files works fine, of course. 

Is this a misconfiguration somewhere? Since `xrdfs ls` works, I doubt it, but let me know if something comes to mind. 

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/xrootd/xrootd/issues/954

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1