Hello,
We recently upgraded to xrootd 4.0.4 at Purdue and enabled IPv6 on our
xrootd redirector and servers. We see an issue where cmsd is unable to
connect to xrootd.unl.edu (another IPv6 enabled redirector). I attached
our xrootd config. We point to the FNAL redirector for AAA.
If I simply restart xrootd/cmsd on our redirector, any connection from
either the CERN or FNAL redirector ends with a '[3011] No servers are
available to read the file'.
In the cmsd log I see this repeated every few seconds:
150220 10:27:34 34373 Login: xrootd.unl.edu login failed;
rejected
150220 10:27:34 34373 Remove completed xrootd.unl.edu manager
1.17
150220 10:27:34 34373 Manager: manager.0:[log in to unmask] removed; lost
connection
If I disable ipv6 on our redirector, cmsd will immediately connect to
xrootd.unl.edu using ipv4.
150220 10:28:01 34373 Add xrootd.unl.edu to manager config;
id=1
150220 10:28:01 34373 ManTree: Now connected to 2 root
node(s)
150220 10:28:01 34373 Protocol: Logged into xrootd.unl.edu
Then if I enable ipv6 and restart the network service I am able to do
both v4/v6 transfers using both CERN/FNAL redirectors.
It seems like for AAA access, there is a requirement for me to have a
cmsd connection to xrootd.unl.edu and it does not work over IPv6.
Before I do the disable/enable v6 thing, I do not see a connection open
between Purdue and UNL. I do see an ipv4 one between Purdue and FNAL
without intervention on my part.
After I disable/enable v6, I see this and things start working.
cmsd 26416 xrootd 23u IPv4 2179617 0t0 TCP
xrootd.rcac.purdue.edu:47154->xrootd.unl.edu:mpc-lifenet (ESTABLISHED)
If the UNL redirector gets restarted, that connection is lost and I have
to the restart/enable/disable steps again for redirection from CERN or
FNAL to work.
It seems like there is some ipv6 weirdness between the UNL and Purdue
redirector. Is this a known issue? Perhaps it is already solved in the
4.1.1 release? If so, we can just wait for OSG to release it and
upgrade. But, I figured I should let you know what I found just in case
you had not seen this issue before.
Thanks,
-Erik
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
# Specify which port to use
xrd.port 1094
# The export directive indicates which paths are to be exported. While the
# default is '/tmp', we indicate it anyway and add the 'stages attribute
# to allow you to start the frm_xfrd to bring in missing files into '/tmp'.
# Remove this attribute if you don't want to enable this feature.
#
all.export / nostage
all.role server
all.role supervisor if cms-d*.rcac.purdue.edu
all.role manager if xrootd.rcac.purdue.edu
all.manager xrootd.rcac.purdue.edu:3121
all.manager meta all cmsxrootd.fnal.gov+ 1213
all.sitename T2_US_Purdue
cms.space min 2g 5g
cms.allow host xrootd.rcac.purdue.edu
cms.allow host cms*.rcac.purdue.edu
#authorization
ofs.authorize 1
acc.authdb /etc/xrootd/Authfile
acc.audit deny grant
#logging
xrootd.trace emsg login stall redirect
ofs.trace none
xrd.trace conn
cms.trace all
# Security configuration
sec.protocol /usr/lib64 gsi -certdir:/etc/grid-security/certificates -cert:/etc/grid-security/xrd/xrdcert.pem -key:/etc/grid-security/xrd/xrdkey.pem -crl:3 -authzfun:libXrdLcmaps.so -authzfunparms:--osg,--lcmapscfg,/etc/xrootd/lcmaps.cfg,--loglevel,0|useglobals -gmapopt:10 -gmapto:0
xrootd.seclib /usr/lib64/libXrdSec.so
xrootd.fslib /usr/lib64/libXrdOfs.so
ofs.osslib /usr/lib64/libXrdHdfs.so
all.adminpath /var/run/xrootd
all.pidpath /var/run/xrootd
cms.delay startup 10
cms.fxhold 60s
if xrootd.rcac.purdue.edu
cms.delay startup 10 qdl 30
cms.dfs lookup distrib mdhold 10m redirect immed
fi
oss.namelib /usr/lib64/libXrdCmsTfc.so file:/apps/osg/cmssoft/cms/SITECONF/T2_US_Purdue/PhEDEx/storage.xml?protocol=hadoop
if exec xrootd
xrd.report xrootd.t2.ucsd.edu:9931 every 30s all
xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest files io info user xrootd.t2.ucsd.edu:9930
fi
# The copycmd directive tells the frm_xfrd what to use to copy files into
# an exported path with the 'stage' attribute. Here we just say this will
# be '/bin/cp' to allow the frm_xfrd to actual start to show that it works.
# Here missing files are created in /tmp as zero-length files.
#
frm.xfr.copycmd /bin/cp /dev/null $PFN
# The adminpath and pidpath variables indicate where the pid and various
# IPC files should be placed
#
all.adminpath /var/spool/xrootd
all.pidpath /var/run/xrootd
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
|