OK, I see the xrootd log but no cmsd log. So, it seems the attachments were incomplete. Could you redo this and really attach both logs?

Andy

From: hds1
Sent: Thursday, April 26, 2018 7:51 AM
To: xrootd/xrootd
Cc: Subscribed
Subject: Re: [xrootd/xrootd] v4.8.3-rc1 stalling client (#692)

XROOTD log:
180426 11:39:55 6099 Starting on Linux 4.13.0-38-generic
Copr. 2004-2012 Stanford University, xrd version v4.8.3-rc1
++++++ xrootd anon@REDIRECTOR initialization started.
Config using configuration file /etc/xrootd/xrootd.cf
=====> xrd.port 1094
Config maximum number of connections restricted to 4096
Config maximum number of threads restricted to 15569
180426 11:39:55 6099 XrdConfig: sendfile enabled.
180426 11:39:55 6101 XrdXeq: Buffer Manager reshaper thread started
180426 11:39:55 6099 XrdSched: scheduling underused thread monitor in 780 seconds
180426 11:39:55 6102 XrdXeq: Time scheduler thread started
180426 11:39:55 6103 XrdXeq: Worker thread started
180426 11:39:55 6099 XrdSched: Starting with 2 workers
180426 11:39:55 6104 XrdXeq: Worker thread started
180426 11:39:55 6099 XrdLink: Allocating 8 link objects at a time
180426 11:39:55 6099 XrdPoll: Starting poller 0
180426 11:39:55 6105 XrdXeq: Poller thread started
180426 11:39:55 6099 XrdPoll: Starting poller 1
180426 11:39:55 6106 XrdXeq: Poller thread started
180426 11:39:55 6099 XrdPoll: Starting poller 2
180426 11:39:55 6107 XrdXeq: Poller thread started
180426 11:39:55 6099 XrdProtocol: getting port from protocol xrootd
180426 11:39:55 6099 XrdConfig: LCL port 1094 wsz=87380 (87380)
180426 11:39:55 6099 XrdProtocol: getting protocol object xrootd
Copr. 2012 Stanford University, xrootd protocol 3.1.0 version v4.8.3-rc1
++++++ xrootd protocol initialization started.
=====> all.export /xrootd
=====> xrootd.fsoverload stall 1
Config exporting /xrootd
Config warning: 'xrootd.seclib' not specified; strong authentication disabled!
Config Routing for 192.168.16.124: local pub4 prv4
Config Route all4: 192.168.16.124 Dest=[::192.168.16.124]:1094
++++++ File system initialization started.
=====> all.role manager
++++++ Storage system initialization started.
=====> all.export /xrootd
180426 11:39:55 6099 oss_Export: warning, invalid path option rw
=====> oss.defaults rw
180426 11:39:55 6099 oss_AioInit: started AIO read signal thread; tid=499631872
180426 11:39:55 6099 oss_AioInit: started AIO write signal thread; tid=498579200
180426 11:39:55 6110 XrdXeq: cache scan thread started
Config effective /etc/xrootd/xrootd.cf oss configuration:
oss.alloc 0 0 0
oss.cachescan 600
oss.fdlimit 2048 4096
oss.maxsize 0
oss.trace fff
oss.xfr 1 deny 10800 keep 1200
oss.memfile off max 2067851264
oss.defaults r/w nocheck nodread nomig norcreate nopurge nostage xattr
oss.path /xrootd r/w nocheck nodread nomig norcreate nopurge nostage xattr
------ Storage system initialization completed.
++++++ Configuring manager role. . .
=====> all.manager REDIRECTOR:3121
180426 11:39:55 6099 Configure Global System Identification: anon-m 3121REDIRECTOR
Config 1 manager(s) started.
180426 11:39:55 6111 XrdXeq: REDIRECTOR thread started
Config effective /etc/xrootd/xrootd.cf ofs configuration:
all.role manager
ofs.maxdelay 60
ofs.persist manual hold 600 logdir /tmp/.ofs/posc.log
ofs.trace bfcd
------ File system manager initialization completed.
180426 11:39:55 6099 XrootdAioReq: Max aio/req=8; aio/srv=4096; Quantum=131072
180426 11:39:55 6099 XrootdAioReq: Adding 18 aioreq objects.
180426 11:39:55 6099 XrootdAio: Adding 18 aio objects; 4096 pending.
180426 11:39:55 6099 XrdSched: scheduling xrootd protocol anchor in 3600 seconds
180426 11:39:55 6099 XrdSched: scheduling transit protocol anchor in 3600 seconds
Config warning: 'xrootd.prepare logdir' not specified; prepare tracking disabled.
------ xrootd protocol initialization completed.
180426 11:39:55 6111 XrdInet: Connected to REDIRECTOR:3121
180426 11:39:55 6111 cms_ClientMan: Connected to suspended REDIRECTOR v 3
180426 11:39:55 6111 Hookup REDIRECTOR qt=178ms rw=2
------ xrootd anon@REDIRECTOR:1094 initialization completed.
180426 11:39:55 6103 XrdSched: running main accept inq=0
180426 11:39:55 6113 XrdXeq: Admin traffic thread started
180426 11:39:55 6112 XrdXeq: async callback thread started
180426 11:41:25 6111 Receive REDIRECTOR 0 bytes on 0
180426 11:41:25 6111 setStatus REDIRECTOR sent resume event
180426 11:41:25 6111 cms_setStatus: Manager REDIRECTOR resumed

180426 11:41:42 6104 XrdSched: Now have 3 workers
180426 11:41:42 6104 XrdSched: running main accept inq=0
180426 11:41:42 6103 XrdInet: Accepted connection from 7@CLIENT
180426 11:41:42 6103 XrdProtocol: matched protocol xrootd
180426 11:41:42 6103 ?:7@CLIENT XrdPoll: FD 7 attached to poller 0; num=1
180426 11:41:42 6103 ?:7@CLIENT XrootdProtocol: 0000 req=login dlen=101
180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdResponse: 0000 sending 16 data bytes
180426 11:41:42 6103 XrootdXeq: schroete.289158:7@CLIENT pvt IPv4 login
180426 11:41:42 6193 XrdXeq: Worker thread started
180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 req=stat dlen=26
180426 11:41:42 6103 schroete.289158:7@CLIENT ofs_stat: fn=/xrootd/schroete/willi.dat
180426 11:41:42 6111 Receive REDIRECTOR 4 bytes on 3071
180426 11:41:42 6111 Decode REDIRECTOR delays schroete.289158:7@CLIENT 5 /xrootd/schroete/willi.dat
180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 rc=5 stat /xrootd/schroete/willi.dat
180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 stalling client for 5 sec
180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdResponse: 0100 sending 4 data bytes; status=4005
180426 11:41:45 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 request timeout; read 0 of 24 bytes
180426 11:41:45 6103 XrdPoll: Poller 0 enabled schroete.289158:7@CLIENT
180426 11:41:47 6193 XrdSched: running schroete.289158:7@CLIENT inq=0
180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 req=stat dlen=26
180426 11:41:47 6193 schroete.289158:7@CLIENT ofs_stat: fn=/xrootd/schroete/willi.dat
180426 11:41:47 6111 Receive REDIRECTOR 47 bytes on 4095
180426 11:41:47 6111 Decode REDIRECTOR gave schroete.289158:7@CLIENT err -2 'No servers are available to read the file.' /xrootd/schroete/willi.dat
180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 rc=-1 stat /xrootd/schroete/willi.dat
180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdResponse: 0100 sending err 3011: No servers are available to read the file.
180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 req=open dlen=40
180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 open unmat /xrootd/schroete/willi.dat?oss.asize=226
180426 11:41:47 6193 schroete.289158:7@CLIENT ofs_open: 102-40644 fn=/xrootd/schroete/willi.dat
180426 11:41:47 6111 Receive REDIRECTOR 19 bytes on 5119
180426 11:41:47 6111 Decode REDIRECTOR redirects schroete.289158:7@CLIENT to 192.168.16.217:1094 /xrootd/schroete/willi.dat
180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 redirecting to 192.168.16.217:1094
180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdResponse: 0100 sending 18 data bytes; status=4004
180426 11:41:47 6193 schroete.289158:7@CLIENT ofs_close: use=0 fn=dummy
180426 11:41:47 6193 XrootdXeq: schroete.289158:7@CLIENT disc 0:00:05
180426 11:41:47 6193 schroete.289158:7@CLIENT XrdPoll: FD 7 detached from poller 0; num=0

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/xrootd/xrootd","title":"xrootd/xrootd","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/xrootd/xrootd"}},"updates":{"snippets":[{"icon":"PERSON","message":"@abh3 in #692: OK, I see the xrootd log but no cmsd log. So, it seems the attachments were incomplete. Could you redo this and really attach both logs?\n\nAndy\n\nFrom: hds1 \nSent: Thursday, April 26, 2018 7:51 AM\nTo: xrootd/xrootd \nCc: Subscribed \nSubject: Re: [xrootd/xrootd] v4.8.3-rc1 stalling client (#692)\n\nXROOTD log:\n180426 11:39:55 6099 Starting on Linux 4.13.0-38-generic\nCopr. 2004-2012 Stanford University, xrd version v4.8.3-rc1\n++++++ xrootd anon@REDIRECTOR initialization started.\nConfig using configuration file /etc/xrootd/xrootd.cf\n=====\u003e xrd.port 1094\nConfig maximum number of connections restricted to 4096\nConfig maximum number of threads restricted to 15569\n180426 11:39:55 6099 XrdConfig: sendfile enabled.\n180426 11:39:55 6101 XrdXeq: Buffer Manager reshaper thread started\n180426 11:39:55 6099 XrdSched: scheduling underused thread monitor in 780 seconds\n180426 11:39:55 6102 XrdXeq: Time scheduler thread started\n180426 11:39:55 6103 XrdXeq: Worker thread started\n180426 11:39:55 6099 XrdSched: Starting with 2 workers\n180426 11:39:55 6104 XrdXeq: Worker thread started\n180426 11:39:55 6099 XrdLink: Allocating 8 link objects at a time\n180426 11:39:55 6099 XrdPoll: Starting poller 0\n180426 11:39:55 6105 XrdXeq: Poller thread started\n180426 11:39:55 6099 XrdPoll: Starting poller 1\n180426 11:39:55 6106 XrdXeq: Poller thread started\n180426 11:39:55 6099 XrdPoll: Starting poller 2\n180426 11:39:55 6107 XrdXeq: Poller thread started\n180426 11:39:55 6099 XrdProtocol: getting port from protocol xrootd\n180426 11:39:55 6099 XrdConfig: LCL port 1094 wsz=87380 (87380)\n180426 11:39:55 6099 XrdProtocol: getting protocol object xrootd\nCopr. 2012 Stanford University, xrootd protocol 3.1.0 version v4.8.3-rc1\n++++++ xrootd protocol initialization started.\n=====\u003e all.export /xrootd\n=====\u003e xrootd.fsoverload stall 1\nConfig exporting /xrootd\nConfig warning: 'xrootd.seclib' not specified; strong authentication disabled!\nConfig Routing for 192.168.16.124: local pub4 prv4\nConfig Route all4: 192.168.16.124 Dest=[::192.168.16.124]:1094\n++++++ File system initialization started.\n=====\u003e all.role manager\n++++++ Storage system initialization started.\n=====\u003e all.export /xrootd\n180426 11:39:55 6099 oss_Export: warning, invalid path option rw\n=====\u003e oss.defaults rw\n180426 11:39:55 6099 oss_AioInit: started AIO read signal thread; tid=499631872\n180426 11:39:55 6099 oss_AioInit: started AIO write signal thread; tid=498579200\n180426 11:39:55 6110 XrdXeq: cache scan thread started\nConfig effective /etc/xrootd/xrootd.cf oss configuration:\noss.alloc 0 0 0\noss.cachescan 600\noss.fdlimit 2048 4096\noss.maxsize 0\noss.trace fff\noss.xfr 1 deny 10800 keep 1200\noss.memfile off max 2067851264\noss.defaults r/w nocheck nodread nomig norcreate nopurge nostage xattr\noss.path /xrootd r/w nocheck nodread nomig norcreate nopurge nostage xattr\n------ Storage system initialization completed.\n++++++ Configuring manager role. . .\n=====\u003e all.manager REDIRECTOR:3121\n180426 11:39:55 6099 Configure Global System Identification: anon-m 3121REDIRECTOR\nConfig 1 manager(s) started.\n180426 11:39:55 6111 XrdXeq: REDIRECTOR thread started\nConfig effective /etc/xrootd/xrootd.cf ofs configuration:\nall.role manager\nofs.maxdelay 60\nofs.persist manual hold 600 logdir /tmp/.ofs/posc.log\nofs.trace bfcd\n------ File system manager initialization completed.\n180426 11:39:55 6099 XrootdAioReq: Max aio/req=8; aio/srv=4096; Quantum=131072\n180426 11:39:55 6099 XrootdAioReq: Adding 18 aioreq objects.\n180426 11:39:55 6099 XrootdAio: Adding 18 aio objects; 4096 pending.\n180426 11:39:55 6099 XrdSched: scheduling xrootd protocol anchor in 3600 seconds\n180426 11:39:55 6099 XrdSched: scheduling transit protocol anchor in 3600 seconds\nConfig warning: 'xrootd.prepare logdir' not specified; prepare tracking disabled.\n------ xrootd protocol initialization completed.\n180426 11:39:55 6111 XrdInet: Connected to REDIRECTOR:3121\n180426 11:39:55 6111 cms_ClientMan: Connected to suspended REDIRECTOR v 3\n180426 11:39:55 6111 Hookup REDIRECTOR qt=178ms rw=2\n------ xrootd anon@REDIRECTOR:1094 initialization completed.\n180426 11:39:55 6103 XrdSched: running main accept inq=0\n180426 11:39:55 6113 XrdXeq: Admin traffic thread started\n180426 11:39:55 6112 XrdXeq: async callback thread started\n180426 11:41:25 6111 Receive REDIRECTOR 0 bytes on 0\n180426 11:41:25 6111 setStatus REDIRECTOR sent resume event\n180426 11:41:25 6111 cms_setStatus: Manager REDIRECTOR resumed\n\n180426 11:41:42 6104 XrdSched: Now have 3 workers\n180426 11:41:42 6104 XrdSched: running main accept inq=0\n180426 11:41:42 6103 XrdInet: Accepted connection from 7@CLIENT\n180426 11:41:42 6103 XrdProtocol: matched protocol xrootd\n180426 11:41:42 6103 ?:7@CLIENT XrdPoll: FD 7 attached to poller 0; num=1\n180426 11:41:42 6103 ?:7@CLIENT XrootdProtocol: 0000 req=login dlen=101\n180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdResponse: 0000 sending 16 data bytes\n180426 11:41:42 6103 XrootdXeq: schroete.289158:7@CLIENT pvt IPv4 login\n180426 11:41:42 6193 XrdXeq: Worker thread started\n180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 req=stat dlen=26\n180426 11:41:42 6103 schroete.289158:7@CLIENT ofs_stat: fn=/xrootd/schroete/willi.dat\n180426 11:41:42 6111 Receive REDIRECTOR 4 bytes on 3071\n180426 11:41:42 6111 Decode REDIRECTOR delays schroete.289158:7@CLIENT 5 /xrootd/schroete/willi.dat\n180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 rc=5 stat /xrootd/schroete/willi.dat\n180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 stalling client for 5 sec\n180426 11:41:42 6103 schroete.289158:7@CLIENT XrootdResponse: 0100 sending 4 data bytes; status=4005\n180426 11:41:45 6103 schroete.289158:7@CLIENT XrootdProtocol: 0100 request timeout; read 0 of 24 bytes\n180426 11:41:45 6103 XrdPoll: Poller 0 enabled schroete.289158:7@CLIENT\n180426 11:41:47 6193 XrdSched: running schroete.289158:7@CLIENT inq=0\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 req=stat dlen=26\n180426 11:41:47 6193 schroete.289158:7@CLIENT ofs_stat: fn=/xrootd/schroete/willi.dat\n180426 11:41:47 6111 Receive REDIRECTOR 47 bytes on 4095\n180426 11:41:47 6111 Decode REDIRECTOR gave schroete.289158:7@CLIENT err -2 'No servers are available to read the file.' /xrootd/schroete/willi.dat\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 rc=-1 stat /xrootd/schroete/willi.dat\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdResponse: 0100 sending err 3011: No servers are available to read the file.\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 req=open dlen=40\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 open unmat /xrootd/schroete/willi.dat?oss.asize=226\n180426 11:41:47 6193 schroete.289158:7@CLIENT ofs_open: 102-40644 fn=/xrootd/schroete/willi.dat\n180426 11:41:47 6111 Receive REDIRECTOR 19 bytes on 5119\n180426 11:41:47 6111 Decode REDIRECTOR redirects schroete.289158:7@CLIENT to 192.168.16.217:1094 /xrootd/schroete/willi.dat\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdProtocol: 0100 redirecting to 192.168.16.217:1094\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrootdResponse: 0100 sending 18 data bytes; status=4004\n180426 11:41:47 6193 schroete.289158:7@CLIENT ofs_close: use=0 fn=dummy\n180426 11:41:47 6193 XrootdXeq: schroete.289158:7@CLIENT disc 0:00:05\n180426 11:41:47 6193 schroete.289158:7@CLIENT XrdPoll: FD 7 detached from poller 0; num=0\n\n—\nYou are receiving this because you are subscribed to this thread.\nReply to this email directly, view it on GitHub, or mute the thread.\n"}],"action":{"name":"View Issue","url":"https://github.com/xrootd/xrootd/issues/692#issuecomment-384845008"}}}

Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1