Yes, but I won't manage today. Is Monday fine with you? Lukasz On Friday, August 31, 2012 07:34:44 AM Brian Bockelman wrote: > Can we cut a 3.2.3 patch release with these two fixes? > > Brian > > On Aug 31, 2012, at 12:14 AM, "Yang, Wei" <[log in to unmask]> wrote: > > I tested the second. I didn't get a chance to test the 1st before I lost > > the window of restarting the cluster. But I have sendfile() turned off > > and I do get correct results, so it implicitly confirms the 1st one. > > > > regards, > > Wei Yang | [log in to unmask] | 650-926-3338(O) > > > > On Aug 30, 2012, at 9:29 PM, Wilko Kroeger wrote: > >> Hello Brian > >> > >> Yes, we also noticed that the detailed monitoring is not working in > >> v3.2.2. We build a version on top of v3.2.2 adding the two commits: > >> > >> commit e0ad3459c89a163e600070a15936b8fd5d26ff35 > >> Author: Andrew Hanushevsky <[log in to unmask]> > >> Date: Wed Aug 22 18:56:19 2012 -0700 > >> > >> Make sure read statistics are updated for sendfile() and mmap I/O. > >> > >> commit e51db4bb0178a21bbe87ccf7c9349b079c2d7455 > >> Author: Andrew Hanushevsky <[log in to unmask]> > >> Date: Mon Jul 30 16:52:56 2012 -0700 > >> > >> Correct monitor initialization test to start monitor under all > >> configs. > >> > >> As far as I can tell the detailed monitoring is now working. Wei might > >> have done more testing. > >> > >> Cheers, > >> > >> Wilko > >> > >> On Thu, 30 Aug 2012, Brian Bockelman wrote: > >>> Hi Andy, > >>> > >>> The core wasn't interesting. However, I tracked it down to this change > >>> (line 334 in XrdXrootdConfig.cc): > >>> > >>> if ((!isRedir || (RQList.Next() != 0 && XrdXrootdMonitor::Redirect()))) > >>> > >>> became: > >>> > >>> if ((!isRedir || (RQList.Next() != 0)) && XrdXrootdMonitor::Redirect()) > >>> > >>> (in 3.2.2). In master, it is this test: > >>> > >>> if (!isRedir || XrdXrootdMonitor::Redirect()) > >>> > >>> Note that XrdXrootdMonitor::Redirect always returns 0 (I suspect the bug > >>> is this). > >>> > >>> So, basically, I think detailed monitoring is broken in the 3.2.2 > >>> release. Matevz, take note... > >>> > >>> What's the minimal patch? I can ask OSG to push this out ASAP. > >>> > >>> Brian > >>> > >>> On Aug 28, 2012, at 9:26 PM, Andrew Hanushevsky <[log in to unmask]> wrote: > >>>> Hi Brian, > >>>> > >>>> Best to get a gcore on this one. Seems like the monitoring did not > >>>> initialize correctly as it's trying to send to fd 0. > >>>> > >>>> Andy > >>>> > >>>> -----Original Message----- From: Brian Bockelman > >>>> Sent: Tuesday, August 28, 2012 7:15 PM > >>>> To: <[log in to unmask]> > >>>> Subject: Strange detailed monitoring issue > >>>> > >>>> After a power outage locally, Matevz noticed he is not receiving > >>>> monitoring messages. > >>>> > >>>> Sure enough, from strace: > >>>> > >>>> [pid 1705] sendto(0, > >>>> "t8\5\270\0\0\0\0\340\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\200\0\0\0\302^v#". > >>>> .., 1464, 0, {sa_family=AF_UNSPEC, > >>>> sa_data="\0\0\0\0\0\0\0\0\0\0\0\0\0\0"}, 16) = -1 ENOTSOCK (Socket > >>>> operation on non-socket) > >>>> > >>>> Version info: > >>>> > >>>> [root@red-gridftp3 ~]# rpm -q xrootd-server > >>>> xrootd-server-3.2.2-1.osg.el5.xu > >>>> > >>>> Log startup is below. Config file snippet is: > >>>> > >>>> xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest files io > >>>> info user xrootd.t2.ucsd.edu:9930 xrd.report xrootd.t2.ucsd.edu:9931 > >>>> every 30s all sync > >>>> > >>>> Any ideas? We are at a loss as to what might be happening. > >>>> > >>>> Brian > >>>> > >>>> 120828 21:07:13 1663 Scalla is starting. . . > >>>> Copr. 2010 Stanford University, xrd version v3.2.2 > >>>> ++++++ xrootd [log in to unmask] initialization started. > >>>> Config using configuration file /etc/xrootd/xrootd-clustered.cfg > >>>> =====> xrd.port 1094 > >>>> =====> xrd.trace conn > >>>> =====> all.adminpath /var/run/xrootd > >>>> =====> xrd.report xrootd.t2.ucsd.edu:9931 every 30s all sync > >>>> Config maximum number of connections restricted to 65536 > >>>> Copr. 2007 Stanford University, xrootd version 2.9.7 build v3.2.2 > >>>> ++++++ xrootd protocol initialization started. > >>>> =====> all.export / nostage > >>>> =====> xrootd.trace emsg login stall redirect > >>>> =====> xrootd.seclib /usr/lib64/libXrdSec.so > >>>> Config warning: ignoring fslib; libXrdOfs.so is built-in. > >>>> =====> xrootd.fslib /usr/lib64/libXrdOfs.so > >>>> =====> all.pidpath /var/run/xrootd > >>>> =====> xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest > >>>> files io info user xrootd.t2.ucsd.edu:9930 Config exporting / > >>>> ++++++ Authentication system initialization started. > >>>> 120828 21:07:13 1663 secgsi_InitOpts: *** > >>>> ------------------------------------------------------------ *** > >>>> 120828 21:07:13 1663 secgsi_InitOpts: Mode: server > >>>> 120828 21:07:13 1663 secgsi_InitOpts: Debug: -1 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: CA dir: > >>>> /etc/grid-security/certificates 120828 21:07:13 1663 secgsi_InitOpts: > >>>> CA verification level: 1 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: CRL dir: > >>>> /etc/grid-security/certificates/ 120828 21:07:13 1663 secgsi_InitOpts: > >>>> CRL extension: .r0 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: CRL check level: 1 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: CRL refresh time: 86400 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: Certificate: > >>>> /etc/grid-security/xrd/xrdcert.pem 120828 21:07:13 1663 > >>>> secgsi_InitOpts: Key: /etc/grid-security/xrd/xrdkey.pem 120828 > >>>> 21:07:13 1663 secgsi_InitOpts: Proxy delegation option: 0 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: GRIDmap file: > >>>> /etc/grid-security/grid-mapfile 120828 21:07:13 1663 secgsi_InitOpts: > >>>> GRIDmap option: 10 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: GRIDmap cache entries expiration > >>>> (secs): 0 120828 21:07:13 1663 secgsi_InitOpts: Authorization > >>>> function: libXrdLcmaps.so 120828 21:07:13 1663 secgsi_InitOpts: > >>>> Authorization function parms: > >>>> --osg,--lcmapscfg,/etc/xrootd/lcmaps.cfg,--loglevel,0|useglobals > >>>> 120828 21:07:13 1663 secgsi_InitOpts: Authorization cache entries > >>>> expiration (secs): -1 120828 21:07:13 1663 secgsi_InitOpts: Client > >>>> proxy availability in XrdSecEntity.endorsement: 0 120828 21:07:13 1663 > >>>> secgsi_InitOpts: VOMS option: 1 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: MonInfo option: 0 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: Crypto modules: ssl > >>>> 120828 21:07:13 1663 secgsi_InitOpts: Ciphers: > >>>> aes-128-cbc:bf-cbc:des-ede3-cbc 120828 21:07:13 1663 secgsi_InitOpts: > >>>> MDigests: sha1:md5 > >>>> 120828 21:07:13 1663 secgsi_InitOpts: *** > >>>> ------------------------------------------------------------ *** > >>>> 120828 21:07:13 1663 secgsi_LoadAuthzFun: using 'XrdSecgsiAuthzFun()' > >>>> from libXrdLcmaps.so =====> sec.protocol /usr/lib64 gsi > >>>> -certdir:/etc/grid-security/certificates > >>>> -cert:/etc/grid-security/xrd/xrdcert.pem > >>>> -key:/etc/grid-security/xrd/xrdkey.pem -crl:1 > >>>> -authzfun:libXrdLcmaps.so -authzfunparms:--osg,--lcmapscfg,/et Config > >>>> 1 authentication directives processed in > >>>> /etc/xrootd/xrootd-clustered.cfg ------ Authentication system > >>>> initialization completed. > >>>> ++++++ File system initialization started. > >>>> =====> all.role server > >>>> Config warning: ignoring invalid trace option 'none'. > >>>> =====> ofs.trace none > >>>> =====> ofs.authorize > >>>> =====> ofs.osslib /usr/lib64/libXrdHdfs.so > >>>> ++++++ Authorization system initialization started. > >>>> 120828 21:07:13 1663 acc_Config: Authorization system using > >>>> configuration in /etc/xrootd/xrootd-clustered.cfg =====> acc.authdb > >>>> /etc/xrootd/Authfile > >>>> =====> acc.audit deny grant > >>>> Config 2 authorization directives processed in > >>>> /etc/xrootd/xrootd-clustered.cfg Config 1 auth entries processed in > >>>> /etc/xrootd/Authfile > >>>> ------ Authorization system initialization completed. > >>>> Copr. 2009, Brian Bockelman, Hdfs Version > >>>> 120828 21:07:13 1663 hdfs_Config: Copr. 2009, Brian Bockelman, Hdfs > >>>> Version > >>>> 120828 21:07:13 1663 hdfs_Config: Configuring HDFS. > >>>> =====> oss.namelib /usr/lib64/libXrdCmsTfc.so > >>>> file:/etc/xrootd/storage.xml?protocol=hadoop Copr. 2009 University of > >>>> Nebraska-Lincoln TFC plugin v 1.0 > >>>> Params: file:/etc/xrootd/storage.xml?protocol=hadoop > >>>> Xerces-c has been initialized. > >>>> Connecting to the catalog file:/etc/xrootd/storage.xml?protocol=hadoop > >>>> Using catalog file /etc/xrootd/storage.xml > >>>> ------ HDFS storage system initialization completed. > >>>> 120828 21:07:13 1663 hdfs_HDFS storage system initialization.: > >>>> completed. > >>>> ++++++ Configuring server role. . . > >>>> =====> all.manager srm.unl.edu:1213 > >>>> =====> cms.trace all > >>>> =====> all.adminpath /var/run/xrootd > >>>> 120828 21:07:13 1663 Configure Global System Identification: anon-s > >>>> 1213srm.unl.edu>>>> > >>>> Config effective /etc/xrootd/xrootd-clustered.cfg ofs configuration: > >>>> ofs.role server > >>>> ofs.authorize > >>>> ofs.maxdelay 60 > >>>> ofs.osslib /usr/lib64/libXrdHdfs.so > >>>> ofs.persist manual hold 600 logdir /var/run/xrootd/.ofs/posc.log > >>>> ofs.trace 0 > >>>> > >>>> ------ File system server initialization completed. > >>>> Config warning: 'xrootd.prepare logdir' not specified; prepare tracking > >>>> disabled. 120828 21:07:13 1675 cms_Finder: Connected to cmsd via > >>>> /var/run/xrootd/.olb/olbd.admin ------ xrootd protocol initialization > >>>> completed. > >>>> ------ xrootd [log in to unmask]:1094 initialization completed. > >>>> > >>>> > >>>> ####################################################################### > >>>> # > >>>> Use REPLY-ALL to reply to list > >>>> > >>>> To unsubscribe from the XROOTD-DEV list, click the following link: > >>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 > >>> > >>> ######################################################################## > >>> Use REPLY-ALL to reply to list > >>> > >>> To unsubscribe from the XROOTD-DEV list, click the following link: > >>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 > >> > >> ######################################################################## > >> Use REPLY-ALL to reply to list > >> > >> To unsubscribe from the XROOTD-DEV list, click the following link: > >> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 > > > > ######################################################################## > > Use REPLY-ALL to reply to list > > > > To unsubscribe from the XROOTD-DEV list, click the following link: > > https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 > > <winmail.dat> > > ######################################################################## > Use REPLY-ALL to reply to list > > To unsubscribe from the XROOTD-DEV list, click the following link: > https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the XROOTD-DEV list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1