Hello,
We are trying to get the OSG standalone xrootd server to work in multiuser mode. In order to server files via https (davs) from Lustre storage at BNL.
For testing I am using my DN file that is mapped to the local user usatlas1 (this is the same account that owns the lustre areas)
When I try to use davs protocol, I get this behavior on the client side (using gfal commands) -
[spar0106]> gfal-copy file:///usatlas/u/benjamin/davs-test-file-spar0106 davs://xrootd04.usatlas.bnl.gov:1094//hpcdisk/test/davs-test-file-spar0106
Copying file:///usatlas/u/benjamin/davs-test-file-spar0106 [FAILED] after 0s
gfal-copy error: 1 (Operation not permitted) - DESTINATION OVERWRITE HTTP 403 : Permission refused
[spar0106]> gfal-copy file:///usatlas/u/benjamin/davs-test-file-spar0106 davs://xrootd04.usatlas.bnl.gov//hpcdisk/test/davs-test-file-spar0106
Copying file:///usatlas/u/benjamin/davs-test-file-spar0106 [FAILED] after 0s
gfal-copy error: 112 (Host is down) - DESTINATION OVERWRITE Result Could not connect to server after 1 attempts
Here is what xrootd.log looks like -
211128 21:21:32 65596 Xrd_Inet: Accepted connection on port 1094 from [log in to unmask]
211128 21:21:32 65666 Xrd_Sched: running main accept inq=0
211128 21:21:32 65596 Xrd_ProtLoad: matched port 1094 protocol http
211128 21:21:32 65596 anon.0:34@spar0106 Xrd_Poll: FD 34 attached to poller 0; num=1
211128 21:21:32 65596 XrootdBridge: bdouglas.21:34@spar0106 login as bdouglas
211128 21:21:32 65596 multiuser_UserSentry: Failed to lookup UID for username bdouglas Success
211128 21:21:32 65596 ofs_stat: bdouglas.21:34@spar0106 Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65596 bdouglas.21:34@spar0106 Xrootd_Response: sending err 3010: Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65596 XrootdXeq: bdouglas.21:34@spar0106 disc 0:00:00 (send failure)
211128 21:21:32 65596 multiuser_UserSentry: Anonymous client; no user set, cannot change FS UIDs
211128 21:21:32 65596 bdouglas.21:34@spar0106 Xrd_Poll: Poller 0 removing FD 34
211128 21:21:32 65596 bdouglas.21:34@spar0106 Xrd_Poll: FD 34 detached from poller 0; num=0
211128 21:21:32 65666 Xrd_Inet: Accepted connection on port 1094 from [log in to unmask]
211128 21:21:32 65666 Xrd_ProtLoad: matched port 1094 protocol http
211128 21:21:32 65666 anon.0:35@spar0106 Xrd_Poll: FD 35 attached to poller 0; num=1
211128 21:21:32 65597 Xrd_Sched: running main accept inq=0
211128 21:21:32 65666 XrootdBridge: bdouglas.22:35@spar0106 login as bdouglas
211128 21:21:32 65666 multiuser_UserSentry: Failed to lookup UID for username bdouglas Success
211128 21:21:32 65666 ofs_stat: bdouglas.22:35@spar0106 Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65666 bdouglas.22:35@spar0106 Xrootd_Response: sending err 3010: Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65666 XrootdXeq: bdouglas.22:35@spar0106 disc 0:00:00 (send failure)
211128 21:21:32 65666 multiuser_UserSentry: Anonymous client; no user set, cannot change FS UIDs
211128 21:21:32 65666 bdouglas.22:35@spar0106 Xrd_Poll: Poller 0 removing FD 35
211128 21:21:32 65666 bdouglas.22:35@spar0106 Xrd_Poll: FD 35 detached from poller 0; num=0
211128 21:21:32 65597 Xrd_Inet: Accepted connection on port 1094 from [log in to unmask]
211128 21:21:32 65597 Xrd_ProtLoad: matched port 1094 protocol http
211128 21:21:32 65597 anon.0:34@spar0106 Xrd_Poll: FD 34 attached to poller 0; num=1
211128 21:21:32 67061 Xrd_Sched: running main accept inq=0
211128 21:21:32 65597 XrootdBridge: bdouglas.23:34@spar0106 login as bdouglas
211128 21:21:32 65597 multiuser_UserSentry: Failed to lookup UID for username bdouglas Success
211128 21:21:32 65597 ofs_stat: bdouglas.23:34@spar0106 Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65597 bdouglas.23:34@spar0106 Xrootd_Response: sending err 3010: Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65597 XrootdXeq: bdouglas.23:34@spar0106 disc 0:00:00 (send failure)
211128 21:21:32 65597 multiuser_UserSentry: Anonymous client; no user set, cannot change FS UIDs
211128 21:21:32 65597 bdouglas.23:34@spar0106 Xrd_Poll: Poller 0 removing FD 34
211128 21:21:32 65597 bdouglas.23:34@spar0106 Xrd_Poll: FD 34 detached from poller 0; num=0
211128 21:21:32 67061 Xrd_Inet: Accepted connection on port 1094 from [log in to unmask]
211128 21:21:32 67604 Xrd_Sched: running main accept inq=0
211128 21:21:32 67061 Xrd_ProtLoad: matched port 1094 protocol http
211128 21:21:32 67061 anon.0:35@spar0106 Xrd_Poll: FD 35 attached to poller 0; num=1
211128 21:21:32 67061 XrootdBridge: bdouglas.24:35@spar0106 login as bdouglas
211128 21:21:32 67061 multiuser_UserSentry: Failed to lookup UID for username bdouglas Success
211128 21:21:32 67061 ofs_stat: bdouglas.24:35@spar0106 Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 67061 bdouglas.24:35@spar0106 Xrootd_Response: sending err 3010: Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 67061 XrootdXeq: bdouglas.24:35@spar0106 disc 0:00:00 (send failure)
211128 21:21:32 67061 multiuser_UserSentry: Anonymous client; no user set, cannot change FS UIDs
211128 21:21:32 67061 bdouglas.24:35@spar0106 Xrd_Poll: Poller 0 removing FD 35
211128 21:21:32 67061 bdouglas.24:35@spar0106 Xrd_Poll: FD 35 detached from poller 0; num=0
211128 21:21:32 67604 Xrd_Inet: Accepted connection on port 1094 from [log in to unmask]
211128 21:21:32 65616 Xrd_Sched: running main accept inq=0
211128 21:21:32 67604 Xrd_ProtLoad: matched port 1094 protocol http
211128 21:21:32 67604 anon.0:34@spar0106 Xrd_Poll: FD 34 attached to poller 0; num=1
211128 21:21:32 67604 XrootdBridge: bdouglas.25:34@spar0106 login as bdouglas
211128 21:21:32 67604 multiuser_UserSentry: Failed to lookup UID for username bdouglas Success
211128 21:21:32 67604 ofs_stat: bdouglas.25:34@spar0106 Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 67604 bdouglas.25:34@spar0106 Xrootd_Response: sending err 3010: Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 67604 XrootdXeq: bdouglas.25:34@spar0106 disc 0:00:00 (send failure)
211128 21:21:32 67604 multiuser_UserSentry: Anonymous client; no user set, cannot change FS UIDs
211128 21:21:32 67604 bdouglas.25:34@spar0106 Xrd_Poll: Poller 0 removing FD 34
211128 21:21:32 67604 bdouglas.25:34@spar0106 Xrd_Poll: FD 34 detached from poller 0; num=0
211128 21:21:32 65616 Xrd_Inet: Accepted connection on port 1094 from [log in to unmask]
211128 21:21:32 65596 Xrd_Sched: running main accept inq=0
211128 21:21:32 65616 Xrd_ProtLoad: matched port 1094 protocol http
211128 21:21:32 65616 anon.0:35@spar0106 Xrd_Poll: FD 35 attached to poller 0; num=1
211128 21:21:32 65616 XrootdBridge: bdouglas.26:35@spar0106 login as bdouglas
211128 21:21:32 65616 multiuser_UserSentry: Failed to lookup UID for username bdouglas Success
211128 21:21:32 65616 ofs_stat: bdouglas.26:35@spar0106 Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65616 bdouglas.26:35@spar0106 Xrootd_Response: sending err 3010: Unable to locate /hpcdisk/test/davs-test-file-spar0106; permission denied
211128 21:21:32 65616 XrootdXeq: bdouglas.26:35@spar0106 disc 0:00:00 (send failure)
211128 21:21:32 65616 multiuser_UserSentry: Anonymous client; no user set, cannot change FS UIDs
211128 21:21:32 65616 bdouglas.26:35@spar0106 Xrd_Poll: Poller 0 removing FD 35
211128 21:21:32 65616 bdouglas.26:35@spar0106 Xrd_Poll: FD 35 detached from poller 0; num=0
----- While if I use the root:// I am able to copy the file -
[spar0106]> gfal-copy file:///usatlas/u/benjamin/davs-test-file-spar0106 root://xrootd04.usatlas.bnl.gov//hpcdisk/test/root-davs-test-file-spar0106
Unable to load sec.protocol plugin libXrdSecztn.so
Copying file:///usatlas/u/benjamin/davs-test-file-spar0106 [DONE] after 0s
And the xrootd log file looks like -
211128 21:22:13 65596 Xrd_Inet: Accepted connection on port 1094 from [log in to unmask]
211128 21:22:13 67604 Xrd_Sched: running main accept inq=0
211128 21:22:13 65596 Xrd_ProtLoad: matched port 1094 protocol xroot
211128 21:22:13 65596 anon.0:34@spar0106 Xrd_Poll: FD 34 attached to poller 0; num=1
211128 21:22:13 65596 benjamin.31372:34@spar0106 Xrootd_Protocol: more auth requested; sz=3049
211128 21:22:14 65596 benjamin.31372:34@spar0106 Xrootd_Protocol: more auth requested; sz=6559
211128 21:22:14 65596 XrootdXeq: benjamin.31372:34@spar0106 pub IPv4 login as usatlas1
211128 21:22:14 65596 multiuser_UserSentry: Switching FS uid for user usatlas1
211128 21:22:14 65596 multiuser_UserSentry: Switching FS uid for user usatlas1
211128 21:22:14 65596 ofs_stat: benjamin.31372:34@spar0106 Unable to locate /hpcdisk/test/root-davs-test-file-spar0106; no such file or directory
211128 21:22:14 65596 benjamin.31372:34@spar0106 Xrootd_Response: sending err 3011: Unable to locate /hpcdisk/test/root-davs-test-file-spar0106; no such file or directory
211128 21:22:14 65596 multiuser_UserSentry: Switching FS uid for user usatlas1
211128 21:22:14 65596 ofs_stat: benjamin.31372:34@spar0106 Unable to locate /hpcdisk/test/root-davs-test-file-spar0106; no such file or directory
211128 21:22:14 65596 benjamin.31372:34@spar0106 Xrootd_Response: sending err 3011: Unable to locate /hpcdisk/test/root-davs-test-file-spar0106; no such file or directory
211128 21:22:14 65596 multiuser_UserSentry: Switching FS uid for user usatlas1
211128 21:22:14 65596 multiuser_UserSentry: Switching FS uid for user usatlas1
211128 21:22:14 65596 multiuser_Open: Will not create checksum
211128 21:22:14 65596 XrootdXeq: benjamin.31372:34@spar0106 disc 0:00:01
211128 21:22:14 65596 multiuser_UserSentry: Switching FS uid for user usatlas1
211128 21:22:14 65596 benjamin.31372:34@spar0106 Xrd_Poll: Poller 0 removing FD 34
211128 21:22:14 65596 benjamin.31372:34@spar0106 Xrd_Poll: FD 34 detached from poller 0; num=0
----
What configuration files should we provide to help debug this issues ?
Regards,
Doug Benjamin
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
|