LISTSERV 16.5 - XROOTD-L Archives

Subscriber's Corner
Email Lists
XROOTD-L Archives

XROOTD-L@LISTSERV.SLAC.STANFORD.EDU

View:

Message:
[
First
Last
]
By Topic:
[
First
Last
]
By Author:
[
First
Last
]
Font:
Proportional Font
		LISTSERV Archives
		XROOTD-L Home
		XROOTD-L April 2018
Subject:
Re: xrootd 4.8.3-rc1 FUSE mount "eligible servers shunned"
From:
Heiko Schröter <[log in to unmask]>
Reply-To:
Support use of xrootd by HEP experiments <[log in to unmask]>
Date:
Fri, 27 Apr 2018 08:27:18 +0200
Content-Type:
text/plain
Parts/Attachments:
text/plain (326 lines)
No the file does not exist. I checked it on the data servers.

The scenario is just as given from step 1 to step 3 in that order.
First do a a failed "fuse" copy (permission denied, which is wanted in 
that dir).
Just followed by the other two commands.
Nothing in between.

Heiko



Am 27.04.2018 um 08:23 schrieb Yang, Wei:
> Only the first one uses XrootdFS (xrootd fuse mount). for 3) do you know if the file actually exist before xrdcp? If so, you will need -f option to xrdcp.
>
> --
> Wei Yang  |  [log in to unmask]  |  650-926-3338(O)
>
>
>
>
>
>
>
>
> -----Original Message-----
> From: <[log in to unmask]> on behalf of Heiko Schröter <[log in to unmask]>
> Date: Thursday, April 26, 2018 at 1:45 AM
> To: xrootd-l <[log in to unmask]>
> Cc: "[log in to unmask]" <[log in to unmask]>
> Subject: xrootd 4.8.3-rc1 FUSE mount "eligible servers shunned"
>
>> In short:
>> 1) cp file via xrootd FUSE mount -> no permission # OK. Wanted behaviour.
>> 2) xrdfs rm file -> Unable to write file; eligible servers shunned
>> 3) xrdcp file -> Unable to create new file; file already exists.
>>
>> It does not happen when copying a file with xrdcp into a forbidden
>> directory.
>>
>> Only solution seems to be restarting the redirector.
>> This situation may lead into a completely blocked namespace if a user
>> starts a mass copy job via FUSE mount (by accident).
>>
>> Are there any other options ?
>> IMHO xrootd should not create any caching issues when a file is
>> forbidden to write/create/copy.
>>
>>
>> Heiko
>>
>> P.S: Also this "stalling client" pops up.
>>
>>
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++
>> Resume State after fresh restart of redirector:
>> 180426 10:03:53 4079 setStatus REDIRECTOR sent resume event
>> 180426 10:03:53 4079 cms_setStatus: Manager REDIRECTOR resumed
>>
>>
>> Copy via FUSE mnt without permissions which is the wanted behaviour:
>> schroete@CLIENT:~$ cp MetopA.sh /mnt/xrootd/schroete/willi.dat
>> cp: reguläre Datei '/mnt/xrootd/schroete/willi.dat' kann nicht angelegt
>> werden: Keine Berechtigung
>> i.e. no permissions
>>
>> ```bash
>> 180426 10:15:21 4071 XrdSched: Now have 3 workers
>> 180426 10:15:21 4071 XrdSched: running main accept inq=0
>> 180426 10:15:21 4247 XrdXeq: Worker thread started
>> 180426 10:15:21 4072 XrdInet: Accepted connection from 7@CLIENT
>> 180426 10:15:21 4072 XrdProtocol: matched protocol xrootd
>> 180426 10:15:21 4072 ?:7@CLIENT XrdPoll: FD 7 attached to poller 0; num=1
>> 180426 10:15:21 4072 ?:7@CLIENT XrootdProtocol: 0000 req=login dlen=104
>> 180426 10:15:21 4072 root.271390:7@CLIENT XrootdResponse: 0000 sending
>> 16 data bytes
>> 180426 10:15:21 4072 XrootdXeq: root.271390:7@CLIENT pvt IPv4 login
>> 180426 10:15:21 4072 root.271390:7@CLIENT XrootdProtocol: 0100
>> req=locate dlen=8
>> 180426 10:15:21 4072 root.271390:7@CLIENT XrootdProtocol: 0100 locate
>> /xrootd/
>> 180426 10:15:21 4072 root.271390:7@CLIENT ofs_fsctl:  fn=/xrootd/
>> 180426 10:15:21 4079 Receive glogin1 4 bytes on 3071
>> 180426 10:15:21 4079 Decode glogin1 delays root.271390:7@CLIENT 5 /xrootd/
>> 180426 10:15:21 4072 root.271390:7@CLIENT XrootdProtocol: 0100 rc=5
>> locate /xrootd/
>> 180426 10:15:21 4072 root.271390:7@CLIENT XrootdProtocol: 0100 stalling
>> client for 5 sec
>> 180426 10:15:21 4072 root.271390:7@CLIENT XrootdResponse: 0100 sending 4
>> data bytes; status=4005
>> 180426 10:15:23 4247 XrdSched: Now have 4 workers
>> 180426 10:15:23 4247 XrdSched: running underused thread monitor inq=0
>> 180426 10:15:23 4247 XrdSched: 4 threads; 0 idle
>> 180426 10:15:23 4247 XrdSched: scheduling underused thread monitor in
>> 780 seconds
>> 180426 10:15:23 4249 XrdXeq: Worker thread started
>> 180426 10:15:24 4072 root.271390:7@CLIENT XrootdProtocol: 0100 request
>> timeout; read 0 of 24 bytes
>> 180426 10:15:24 4072 XrdPoll: Poller 0 enabled root.271390:7@CLIENT
>> 180426 10:15:26 4247 XrdSched: running root.271390:7@CLIENT inq=0
>> 180426 10:15:26 4247 root.271390:7@CLIENT XrootdProtocol: 0100
>> req=locate dlen=8
>> 180426 10:15:26 4247 root.271390:7@CLIENT XrootdProtocol: 0100 locate
>> /xrootd/
>> 180426 10:15:26 4247 root.271390:7@CLIENT ofs_fsctl:  fn=/xrootd/
>> 180426 10:15:26 4079 Receive glogin1 315 bytes on 4095
>> 180426 10:15:26 4079 Decode glogin1 sent root.271390:7@CLIENT
>> 'Sw[::192.168.16.146]:1094 Sw[::192.168.16.144]:1094
>> Sw[::192.168.16.127]:1094 Sw[::192.168.16.120]:1094
>> Sw[::192.168.16.147]:1094 Sw[::192.168.16.139]:1094
>> Sw[::192.168.16.97]:1094 Sw[::192.168.16.195]:1094
>> Sw[::192.168.16.196]:1094 Sw[::192.168.16.134]:1094
>> Sw[::192.168.16.121]:1094 Sw[::192.168.16.217]:1094' /xrootd/
>> 180426 10:15:26 4247 root.271390:7@CLIENT XrootdProtocol: 0100 rc=-1024
>> locate /xrootd/
>> 180426 10:15:26 4247 root.271390:7@CLIENT XrootdResponse: 0100 sending
>> 311 data bytes
>> 180426 10:15:26 4249 XrdSched: running main accept inq=0
>> 180426 10:15:26 4071 XrdInet: Accepted connection from 19@CLIENT
>> 180426 10:15:26 4071 XrdProtocol: matched protocol xrootd
>> 180426 10:15:26 4071 ?:19@CLIENT XrdPoll: FD 19 attached to poller 1; num=1
>> 180426 10:15:26 4071 ?:19@CLIENT XrootdProtocol: 0000 req=login dlen=104
>> 180426 10:15:26 4071 h21.271390:19@CLIENT XrootdResponse: 0000 sending
>> 16 data bytes
>> 180426 10:15:26 4071 XrootdXeq: h21.271390:19@CLIENT pvt IPv4 login
>> 180426 10:15:26 4071 h21.271390:19@CLIENT XrootdProtocol: 0100 req=open
>> dlen=27
>> 180426 10:15:26 4071 h21.271390:19@CLIENT XrootdProtocol: 0100 open
>> udmat /xrootd//schroete/willi.dat
>> 180426 10:15:26 4071 h21.271390:19@CLIENT ofs_open: 200-40644
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:15:26 4079 Receive glogin1 4 bytes on 5119
>> 180426 10:15:26 4079 Decode glogin1 delays h21.271390:19@CLIENT 5
>> /xrootd/schroete/willi.dat
>> 180426 10:15:26 4071 h21.271390:19@CLIENT XrootdProtocol: 0100 stalling
>> client for 5 sec
>> 180426 10:15:26 4071 h21.271390:19@CLIENT XrootdResponse: 0100 sending 4
>> data bytes; status=4005
>> 180426 10:15:26 4071 h21.271390:19@CLIENT ofs_close: use=0 fn=dummy
>> 180426 10:15:29 4247 root.271390:7@CLIENT XrootdProtocol: 0100 request
>> timeout; read 0 of 24 bytes
>> 180426 10:15:29 4247 XrdPoll: Poller 0 enabled root.271390:7@CLIENT
>> 180426 10:15:29 4071 h21.271390:19@CLIENT XrootdProtocol: 0100 request
>> timeout; read 0 of 24 bytes
>> 180426 10:15:29 4071 XrdPoll: Poller 1 enabled h21.271390:19@CLIENT
>> 180426 10:15:31 4072 XrdSched: running h21.271390:19@CLIENT inq=0
>> 180426 10:15:31 4072 h21.271390:19@CLIENT XrootdProtocol: 0100 req=open
>> dlen=27
>> 180426 10:15:31 4072 h21.271390:19@CLIENT XrootdProtocol: 0100 open
>> udmat /xrootd//schroete/willi.dat
>> 180426 10:15:31 4072 h21.271390:19@CLIENT ofs_open: 200-40644
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:15:31 4079 Receive glogin1 19 bytes on 6143
>> 180426 10:15:31 4079 Decode glogin1 redirects h21.271390:19@CLIENT to
>> 192.168.16.217:1094 /xrootd/schroete/willi.dat
>> 180426 10:15:31 4072 h21.271390:19@CLIENT XrootdProtocol: 0100
>> redirecting to 192.168.16.217:1094
>> 180426 10:15:31 4072 h21.271390:19@CLIENT XrootdResponse: 0100 sending
>> 18 data bytes; status=4004
>> 180426 10:15:31 4072 h21.271390:19@CLIENT ofs_close: use=0 fn=dummy
>> 180426 10:15:34 4072 h21.271390:19@CLIENT XrootdProtocol: 0100 request
>> timeout; read 0 of 24 bytes
>> 180426 10:15:34 4072 XrdPoll: Poller 1 enabled h21.271390:19@CLIENT
>> ```
>>
>> Trying to remove the file:
>> schroete@CLIENT:~$ xrdfs glogin1 rm /xrootd/schroete/willi.dat
>> [ERROR] Server responded with an error: [3011] Unable to write file;
>> eligible servers shunned.
>>
>> ```bash
>> 180426 10:20:15 4247 XrdSched: running main accept inq=0
>> 180426 10:20:15 4249 XrdInet: Accepted connection from 18@CLIENT
>> 180426 10:20:15 4249 XrdProtocol: matched protocol xrootd
>> 180426 10:20:15 4249 ?:18@CLIENT XrdPoll: FD 18 attached to poller 2; num=1
>> 180426 10:20:15 4249 ?:18@CLIENT XrootdProtocol: 0000 req=login dlen=101
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdResponse: 0000
>> sending 16 data bytes
>> 180426 10:20:15 4249 XrootdXeq: schroete.271507:18@CLIENT pvt IPv4 login
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdProtocol: 0100
>> req=rm dlen=26
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT ofs_remove: f
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:20:15 4079 Receive glogin1 19 bytes on 7167
>> 180426 10:20:15 4079 Decode glogin1 redirects schroete.271507:18@CLIENT
>> to 192.168.16.217:1094 /xrootd/schroete/willi.dat
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdProtocol: 0100
>> rc=-256 rm /xrootd/schroete/willi.dat
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdProtocol: 0100
>> redirecting to 192.168.16.217:1094
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdResponse: 0100
>> sending 18 data bytes; status=4004
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdProtocol: 0100
>> req=rm dlen=62
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT ofs_remove: f
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:20:15 4079 Receive glogin1 52 bytes on 8191
>> 180426 10:20:15 4079 Decode glogin1 gave schroete.271507:18@CLIENT err
>> -2 'Unable to write file; eligible servers shunned.'
>> /xrootd/schroete/willi.dat
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdProtocol: 0100
>> rc=-1 rm /xrootd/schroete/willi.dat
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrootdResponse: 0100
>> sending err 3011: Unable to write file; eligible servers shunned.
>> 180426 10:20:15 4249 XrootdXeq: schroete.271507:18@CLIENT disc 0:00:00
>> 180426 10:20:15 4249 schroete.271507:18@CLIENT XrdPoll: FD 18 detached
> >from poller 2; num=0
>> ```
>>
>>
>> Tryint to copy with xrdcp tool:
>> schroete@CLIENT:~$ xrdcp MetopA.sh
>> xroot://glogin1//xrootd/schroete/willi.dat
>> [0B/0B][100%][==================================================][0B/s]
>> Run: [ERROR] Server responded with an error: [3011] Unable to create new
>> file; file already exists.180426
>>
>> ```bash
>> 180426 10:21:03 4071 XrdSched: running h21.271390:19@CLIENT inq=0
>> 180426 10:21:03 4071 XrootdXeq: h21.271390:19@CLIENT disc 0:05:37
>> 180426 10:21:03 4071 h21.271390:19@CLIENT XrdPoll: FD 19 detached from
>> poller 1; num=0
>> 180426 10:21:03 4072 XrdSched: running root.271390:7@CLIENT inq=0
>> 180426 10:21:03 4072 XrootdXeq: root.271390:7@CLIENT disc 0:05:42
>> 180426 10:21:03 4072 root.271390:7@CLIENT XrdPoll: FD 7 detached from
>> poller 0; num=0
>> 180426 10:21:05 4247 XrdInet: Accepted connection from 21@CLIENT
>> 180426 10:21:05 4247 XrdProtocol: matched protocol xrootd
>> 180426 10:21:05 4247 ?:21@CLIENT XrdPoll: FD 21 attached to poller 0; num=1
>> 180426 10:21:05 4247 ?:21@CLIENT XrootdProtocol: 0000 req=login dlen=101
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdResponse: 0000
>> sending 16 data bytes
>> 180426 10:21:05 4247 XrootdXeq: schroete.271528:21@CLIENT pvt IPv4 login
>> 180426 10:21:05 4249 XrdSched: running main accept inq=0
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> req=stat dlen=26
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT ofs_stat:
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:21:05 4079 Receive glogin1 19 bytes on 9215
>> 180426 10:21:05 4079 Decode glogin1 redirects schroete.271528:21@CLIENT
>> to 192.168.16.217:1094 /xrootd/schroete/willi.dat
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> rc=-256 stat /xrootd/schroete/willi.dat
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> redirecting to 192.168.16.217:1094
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdResponse: 0100
>> sending 18 data bytes; status=4004
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> req=stat dlen=62
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT ofs_stat:
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:21:05 4079 Receive glogin1 47 bytes on 10239
>> 180426 10:21:05 4079 Decode glogin1 gave schroete.271528:21@CLIENT err
>> -2 'No servers are available to read the file.' /xrootd/schroete/willi.dat
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> rc=-1 stat /xrootd/schroete/willi.dat
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdResponse: 0100
>> sending err 3011: No servers are available to read the file.
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> req=open dlen=40
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100 open
>> unmat /xrootd/schroete/willi.dat?oss.asize=226
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT ofs_open: 102-40644
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:21:05 4079 Receive glogin1 4 bytes on 11263
>> 180426 10:21:05 4079 Decode glogin1 delays schroete.271528:21@CLIENT 5
>> /xrootd/schroete/willi.dat
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> stalling client for 5 sec
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT XrootdResponse: 0100
>> sending 4 data bytes; status=4005
>> 180426 10:21:05 4247 schroete.271528:21@CLIENT ofs_close: use=0 fn=dummy
>> 180426 10:21:08 4247 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> request timeout; read 0 of 24 bytes
>> 180426 10:21:08 4247 XrdPoll: Poller 0 enabled schroete.271528:21@CLIENT
>> 180426 10:21:10 4071 XrdSched: running schroete.271528:21@CLIENT inq=0
>> 180426 10:21:10 4071 schroete.271528:21@CLIENT XrootdProtocol: 0100
>> req=open dlen=40
>> 180426 10:21:10 4071 schroete.271528:21@CLIENT XrootdProtocol: 0100 open
>> unmat /xrootd/schroete/willi.dat?oss.asize=226
>> 180426 10:21:10 4071 schroete.271528:21@CLIENT ofs_open: 102-40644
>> fn=/xrootd/schroete/willi.dat
>> 180426 10:21:10 4079 Receive glogin1 52 bytes on 12287
>> 180426 10:21:10 4079 Decode glogin1 gave schroete.271528:21@CLIENT err
>> -2 'Unable to create new file; file already exists.'
>> /xrootd/schroete/willi.dat
>> 180426 10:21:10 4071 schroete.271528:21@CLIENT XrootdResponse: 0100
>> sending err 3011: Unable to create new file; file already exists.
>> 180426 10:21:10 4071 schroete.271528:21@CLIENT ofs_close: use=0 fn=dummy
>> 180426 10:21:10 4071 XrootdXeq: schroete.271528:21@CLIENT disc 0:00:05
>> 180426 10:21:10 4071 schroete.271528:21@CLIENT XrdPoll: FD 21 detached
> >from poller 0; num=0
>> 180426 10:22:23 4069 XrdBuffManager: Reshaper has 3K; target 403877K
>> ```
>>
>> ########################################################################
>> Use REPLY-ALL to reply to list
>>
>> To unsubscribe from the XROOTD-L list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>

-- 
-----------------------------------------------------------------------
Dipl.-Ing. Heiko Schröter
Institute of Environmental Physics (IUP)   phone: ++49-(0)421-218-62092
Institute of Remote Sensing (IFE)          fax:   ++49-(0)421-218-62070
University of Bremen (FB1)
P.O. Box 330440               email:  [log in to unmask]
Otto-Hahn-Allee 1
28359 Bremen
Germany
-----------------------------------------------------------------------

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
Top of Message | Previous Page | Permalink
Search Archives

Advanced Options
Options

		Log In
		Get Password

		Search Archives

		Subscribe or Unsubscribe