Hi Andy, Here are the cmsd log with the `-d` option in the command line. manager (cmsxrootd.hep.wisc.edu) supervisor (s15n01.hep.wisc.edu) dataservers (g??n??.hep.wisc.edu) ``` 150409 11:15:07 21282 Protocol: Primary supervisor.18448:29@s15n01:31094 logged in suspended. =====> Routing for s15n01.hep.wisc.edu: local pub4 prv4 pub6 prv6 =====> Route all4: s15n01.hep.wisc.edu Dest=[::144.92.181.127]:31094 =====> Route all6: s15n01.hep.wisc.edu Dest=[2607:f388:101c:1000::335]:31094 .......... ........ ........ 150409 11:17:04 21344 XrdInet: Accepted connection from [log in to unmask] 150409 11:17:04 21332 XrdSched: running main accept inq=0 150409 11:17:04 21344 XrdProtocol: matched protocol cmsd 150409 11:17:04 21344 ?:80@g18n22 XrdPoll: FD 80 attached to poller 2; num=22 150409 11:17:04 21344 Add server.23104:80@g18n22 redirected; too many subscribers. 150409 11:17:04 21344 server.23104:80@g18n22 XrdPoll: FD 80 detached from poller 2; num=21 ``` From the supervisor: ``` Copr. 2012 Stanford University, xrootd protocol 3.0.0 version v4.1.1 ++++++ xrootd protocol initialization started. =====> all.export / nostage =====> xrootd.trace emsg login stall redirect =====> xrootd.seclib /usr/lib64/libXrdSec.so Config warning: ignoring fslib; libXrdOfs.so is built-in. =====> xrootd.fslib /usr/lib64/libXrdOfs.so =====> all.pidpath /var/run/xrootd =====> xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest files io info user xrootd.t2.ucsd.edu:9930 Config exporting / 150409 11:05:53 18221 XrootdProtocol: Loading security library /usr/lib64/libXrdSec.so Plugin loaded ++++++ Authentication system initialization started. Config 0 authentication directives processed in /etc/xrootd/xrootd.cfg Config warning: No protocols defined; only host authentication available. 150409 11:05:53 18221 sec_ProtBind_Complete: Default sectoken built: '' ------ Authentication system initialization completed. Config Routing for s15n01.hep.wisc.edu: local pub4 prv4 pub6 prv6 Config Route all4: s15n01.hep.wisc.edu Dest=[::144.92.181.127]:31094 Config Route all6: s15n01.hep.wisc.edu Dest=[2607:f388:101c:1000::335]:31094 ++++++ File system initialization started. =====> all.role server =====> all.role supervisor if s15*.hep.wisc.edu Config warning: ignoring invalid trace option 'none'. =====> ofs.trace none =====> ofs.authorize =====> ofs.osslib /usr/lib64/libXrdHdfs.so Plugin No such file or directory loading osslib /usr/lib64/libXrdHdfs-4.so Config Falling back to using /usr/lib64/libXrdHdfs.so Plugin loaded Copr. 2009, Brian Bockelman, Hdfs Version 150409 11:05:53 18221 hdfs_Config: Copr. 2009, Brian Bockelman, Hdfs Version 150409 11:05:53 18221 hdfs_Config: Configuring HDFS. =====> oss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage.xml?protocol=hadoop Copr. 2009 University of Nebraska-Lincoln TFC plugin v 1.0 Params: file:/etc/xrootd/storage.xml?protocol=hadoop Xerces-c has been initialized. Connecting to the catalog file:/etc/xrootd/storage.xml?protocol=hadoop Using catalog file /etc/xrootd/storage.xml ------ HDFS storage system initialization completed. 150409 11:05:53 18221 hdfs_HDFS storage system initialization.: completed. ++++++ Authorization system initialization started. 150409 11:05:53 18221 acc_Config: Authorization system using configuration in /etc/xrootd/xrootd.cfg =====> acc.authdb /etc/xrootd/Authfile =====> acc.audit deny grant Config 2 authorization directives processed in /etc/xrootd/xrootd.cfg Config 1 auth entries processed in /etc/xrootd/Authfile ------ Authorization system initialization completed. ++++++ Configuring supervisor role. . . =====> all.manager all cmsxrootd.hep.wisc.edu:1213 =====> cms.trace all =====> all.adminpath /var/run/xrootd 150409 11:05:53 18221 Configure Global System Identification: anon-u 1213cmsxrootd.hep.wisc.edu Config 1 manager(s) started. 150409 11:05:53 18237 XrdXeq: /var/run/xrootd/.olb/olbd.super thread started 150409 11:05:53 18238 XrdXeq: async callback thread started 150409 11:05:53 18237 XrdOpen: Unable to connect socket to /var/run/xrootd/.olb/olbd.super; connection refused 150409 11:05:53 18239 XrdXeq: cms i/f thread started Config effective /etc/xrootd/xrootd.cfg ofs configuration: all.role supervisor ofs.authorize ofs.maxdelay 60 ofs.persist manual hold 600 logdir /var/run/xrootd/.ofs/posc.log ofs.trace 0 ofs.osslib /usr/lib64/libXrdHdfs.so ------ File system supervisor initialization completed. 150409 11:05:53 18239 cms_Open: Unable to connect socket to /var/run/xrootd/.olb/olbd.nimda; connection refused 150409 11:05:53 18221 XrootdAioReq: Max aio/req=8; aio/srv=4096; Quantum=131072 150409 11:05:53 18221 XrootdAioReq: Adding 18 aioreq objects. 150409 11:05:53 18221 XrootdAio: Adding 18 aio objects; 4096 pending. 150409 11:05:53 18221 XrdSched: scheduling xrootd protocol anchor in 3600 seconds Config warning: 'xrootd.prepare logdir' not specified; prepare tracking disabled. 150409 11:05:53 18221 XrdSched: scheduling monitor window clock in 5 seconds 150409 11:05:53 18225 XrdSched: running monitor ident inq=0 150409 11:05:53 18225 XrootdMonitor: 122 bytes sent to xrootd.t2.ucsd.edu:9930 rc=0 150409 11:05:53 18225 XrdSched: scheduling monitor ident in 3600 seconds 150409 11:05:53 18240 XrdXeq: Admin traffic thread started ------ xrootd protocol initialization completed. 150409 11:05:53 18221 XrdSched: scheduling stats reporter in 30 seconds ------ xrootd [log in to unmask]:31094 initialization completed. 150409 11:05:53 18226 XrdSched: running main accept inq=0 150409 11:05:58 18225 XrdSched: Now have 3 workers 150409 11:05:58 18225 XrdSched: running monitor window clock inq=0 150409 11:05:58 18261 XrdXeq: Worker thread started 150409 11:05:58 18225 XrdSched: scheduling monitor window clock in 5 seconds 150409 11:06:03 18261 XrdSched: running monitor window clock inq=0 150409 11:06:03 18261 XrdSched: scheduling monitor window clock in 5 seconds 150409 11:06:08 18225 XrdSched: running monitor window clock inq=0 150409 11:06:08 18225 XrdSched: scheduling monitor window clock in 5 seconds 150409 11:06:13 18261 XrdSched: running monitor window clock inq=0 150409 11:06:13 18261 XrdSched: scheduling monitor window clock in 5 seconds ``` From one of the data servers: ``` 150409 11:21:40 21859 Remove completed cmsxrootd.hep.wisc.edu manager 0.121 150409 11:21:40 21859 Manager: manager.0:21@cmsxrootd removed; redirected 150409 11:21:40 21859 Pander trying to connect to lvl 1 [2607:34757 150409 11:21:40 21859 XrdOpen: Unable to create socket for ' [2607 '; invalid IPv6 address 150409 11:21:46 21859 Pander trying to connect to lvl 0 cmsxrootd.hep.wisc.edu:1213 150409 11:21:46 21859 XrdInet: Connected to cmsxrootd.hep.wisc.edu:1213 150409 11:21:46 21859 Add cmsxrootd.hep.wisc.edu to manager config; id=0 150409 11:21:46 21859 ManTree: Now connected to 1 root node(s) 150409 11:21:46 21859 Protocol: Logged into cmsxrootd 150409 11:21:46 21859 Dispatch manager.0:21@cmsxrootd for try dlen=2635 150409 11:21:46 21859 manager.0:21@cmsxrootd do_Try: [2607:f388:101c:1000::340]:37544 [2607:f388:101c:1000::336]:41069 [2607:f388:101c:1000::344]:33020 [2607:f388:101c:1000::335]:51546 [2607:f388:101c:1000::337]:53061 [2607:f388:101c:1000::343]:42818 [2607:f388:101c:1000::342]:58302 [2607:f388:101c:1000::339]:59102 [2607:f388:101c:1000::338]:46712 150409 11:21:46 21859 Remove completed cmsxrootd.hep.wisc.edu manager 0.122 150409 11:21:46 21859 Manager: manager.0:21@cmsxrootd removed; redirected 150409 11:21:46 21859 Pander trying to connect to lvl 1 [2607:34757 150409 11:21:46 21859 XrdOpen: Unable to create socket for ' [2607 '; invalid IPv6 address 150409 11:21:52 21859 Pander trying to connect to lvl 0 cmsxrootd.hep.wisc.edu:1213 150409 11:21:52 21859 XrdInet: Connected to cmsxrootd.hep.wisc.edu:1213 150409 11:21:52 21859 Add cmsxrootd.hep.wisc.edu to manager config; id=0 150409 11:21:52 21859 ManTree: Now connected to 1 root node(s) 150409 11:21:52 21859 Protocol: Logged into cmsxrootd 150409 11:21:52 21859 Dispatch manager.0:21@cmsxrootd for try dlen=2635 150409 11:21:52 21859 manager.0:21@cmsxrootd do_Try: ``` --- Reply to this email directly or view it on GitHub: https://github.com/xrootd/xrootd/issues/227#issuecomment-91280442 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the XROOTD-DEV list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1