Hi Brian,
Best to get a gcore on this one. Seems like the monitoring did not
initialize correctly as it's trying to send to fd 0.
Andy
-----Original Message-----
From: Brian Bockelman
Sent: Tuesday, August 28, 2012 7:15 PM
To: <[log in to unmask]>
Subject: Strange detailed monitoring issue
After a power outage locally, Matevz noticed he is not receiving monitoring
messages.
Sure enough, from strace:
[pid 1705] sendto(0,
"t8\5\270\0\0\0\0\340\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\200\0\0\0\302^v#"...,
1464, 0, {sa_family=AF_UNSPEC, sa_data="\0\0\0\0\0\0\0\0\0\0\0\0\0\0"}, 16)
= -1 ENOTSOCK (Socket operation on non-socket)
Version info:
[root@red-gridftp3 ~]# rpm -q xrootd-server
xrootd-server-3.2.2-1.osg.el5.xu
Log startup is below. Config file snippet is:
xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest files io info
user xrootd.t2.ucsd.edu:9930
xrd.report xrootd.t2.ucsd.edu:9931 every 30s all sync
Any ideas? We are at a loss as to what might be happening.
Brian
120828 21:07:13 1663 Scalla is starting. . .
Copr. 2010 Stanford University, xrd version v3.2.2
++++++ xrootd [log in to unmask] initialization started.
Config using configuration file /etc/xrootd/xrootd-clustered.cfg
=====> xrd.port 1094
=====> xrd.trace conn
=====> all.adminpath /var/run/xrootd
=====> xrd.report xrootd.t2.ucsd.edu:9931 every 30s all sync
Config maximum number of connections restricted to 65536
Copr. 2007 Stanford University, xrootd version 2.9.7 build v3.2.2
++++++ xrootd protocol initialization started.
=====> all.export / nostage
=====> xrootd.trace emsg login stall redirect
=====> xrootd.seclib /usr/lib64/libXrdSec.so
Config warning: ignoring fslib; libXrdOfs.so is built-in.
=====> xrootd.fslib /usr/lib64/libXrdOfs.so
=====> all.pidpath /var/run/xrootd
=====> xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest files io
info user xrootd.t2.ucsd.edu:9930
Config exporting /
++++++ Authentication system initialization started.
120828 21:07:13 1663 secgsi_InitOpts:
*** ------------------------------------------------------------ ***
120828 21:07:13 1663 secgsi_InitOpts: Mode: server
120828 21:07:13 1663 secgsi_InitOpts: Debug: -1
120828 21:07:13 1663 secgsi_InitOpts: CA dir:
/etc/grid-security/certificates
120828 21:07:13 1663 secgsi_InitOpts: CA verification level: 1
120828 21:07:13 1663 secgsi_InitOpts: CRL dir:
/etc/grid-security/certificates/
120828 21:07:13 1663 secgsi_InitOpts: CRL extension: .r0
120828 21:07:13 1663 secgsi_InitOpts: CRL check level: 1
120828 21:07:13 1663 secgsi_InitOpts: CRL refresh time: 86400
120828 21:07:13 1663 secgsi_InitOpts: Certificate:
/etc/grid-security/xrd/xrdcert.pem
120828 21:07:13 1663 secgsi_InitOpts: Key:
/etc/grid-security/xrd/xrdkey.pem
120828 21:07:13 1663 secgsi_InitOpts: Proxy delegation option: 0
120828 21:07:13 1663 secgsi_InitOpts: GRIDmap file:
/etc/grid-security/grid-mapfile
120828 21:07:13 1663 secgsi_InitOpts: GRIDmap option: 10
120828 21:07:13 1663 secgsi_InitOpts: GRIDmap cache entries expiration
(secs): 0
120828 21:07:13 1663 secgsi_InitOpts: Authorization function:
libXrdLcmaps.so
120828 21:07:13 1663 secgsi_InitOpts: Authorization function
parms: --osg,--lcmapscfg,/etc/xrootd/lcmaps.cfg,--loglevel,0|useglobals
120828 21:07:13 1663 secgsi_InitOpts: Authorization cache entries
expiration (secs): -1
120828 21:07:13 1663 secgsi_InitOpts: Client proxy availability in
XrdSecEntity.endorsement: 0
120828 21:07:13 1663 secgsi_InitOpts: VOMS option: 1
120828 21:07:13 1663 secgsi_InitOpts: MonInfo option: 0
120828 21:07:13 1663 secgsi_InitOpts: Crypto modules: ssl
120828 21:07:13 1663 secgsi_InitOpts: Ciphers:
aes-128-cbc:bf-cbc:des-ede3-cbc
120828 21:07:13 1663 secgsi_InitOpts: MDigests: sha1:md5
120828 21:07:13 1663 secgsi_InitOpts:
*** ------------------------------------------------------------ ***
120828 21:07:13 1663 secgsi_LoadAuthzFun: using 'XrdSecgsiAuthzFun()' from
libXrdLcmaps.so
=====> sec.protocol /usr/lib64
gsi -certdir:/etc/grid-security/certificates -cert:/etc/grid-security/xrd/xrdcert.pem
-key:/etc/grid-security/xrd/xrdkey.pem -crl:1 -authzfun:libXrdLcmaps.so -authzfunparms:--osg,--lcmapscfg,/et
Config 1 authentication directives processed in
/etc/xrootd/xrootd-clustered.cfg
------ Authentication system initialization completed.
++++++ File system initialization started.
=====> all.role server
Config warning: ignoring invalid trace option 'none'.
=====> ofs.trace none
=====> ofs.authorize
=====> ofs.osslib /usr/lib64/libXrdHdfs.so
++++++ Authorization system initialization started.
120828 21:07:13 1663 acc_Config: Authorization system using configuration in
/etc/xrootd/xrootd-clustered.cfg
=====> acc.authdb /etc/xrootd/Authfile
=====> acc.audit deny grant
Config 2 authorization directives processed in
/etc/xrootd/xrootd-clustered.cfg
Config 1 auth entries processed in /etc/xrootd/Authfile
------ Authorization system initialization completed.
Copr. 2009, Brian Bockelman, Hdfs Version
120828 21:07:13 1663 hdfs_Config: Copr. 2009, Brian Bockelman, Hdfs Version
120828 21:07:13 1663 hdfs_Config: Configuring HDFS.
=====> oss.namelib /usr/lib64/libXrdCmsTfc.so
file:/etc/xrootd/storage.xml?protocol=hadoop
Copr. 2009 University of Nebraska-Lincoln TFC plugin v 1.0
Params: file:/etc/xrootd/storage.xml?protocol=hadoop
Xerces-c has been initialized.
Connecting to the catalog file:/etc/xrootd/storage.xml?protocol=hadoop
Using catalog file /etc/xrootd/storage.xml
------ HDFS storage system initialization completed.
120828 21:07:13 1663 hdfs_HDFS storage system initialization.: completed.
++++++ Configuring server role. . .
=====> all.manager srm.unl.edu:1213
=====> cms.trace all
=====> all.adminpath /var/run/xrootd
120828 21:07:13 1663 Configure Global System Identification: anon-s
1213srm.unl.edu
Config effective /etc/xrootd/xrootd-clustered.cfg ofs configuration:
ofs.role server
ofs.authorize
ofs.maxdelay 60
ofs.osslib /usr/lib64/libXrdHdfs.so
ofs.persist manual hold 600 logdir /var/run/xrootd/.ofs/posc.log
ofs.trace 0
------ File system server initialization completed.
Config warning: 'xrootd.prepare logdir' not specified; prepare tracking
disabled.
120828 21:07:13 1675 cms_Finder: Connected to cmsd via
/var/run/xrootd/.olb/olbd.admin
------ xrootd protocol initialization completed.
------ xrootd [log in to unmask]:1094 initialization completed.
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
