it is important to me since I have turned on "sss" for production level evaluation. There are two more I would like to get into 3.2.3 commit 9b6b3c95883d89d7c96e84e34bf82ad5725a3efc Author: Wei Yang <[log in to unmask]> Date: Mon Aug 20 00:37:32 2012 -0700 fix a memory leak in XrdClientPhyConnection::DoHandShake() commit 0da3ff747f61e15ea9f9fe67abcb670e49236ee0 Author: Wei Yang <[log in to unmask]> Date: Mon Aug 20 00:41:24 2012 -0700 In XrdFfsMisc.cc, use default TTL values for data server connection and load balance server connection. regards, Wei Yang | [log in to unmask] | 650-926-3338(O) On Aug 31, 2012, at 8:26 AM, Wilko Kroeger wrote: > > We are also using the commit > > commit c7b162a1a96287a6ebd8f7d9301904c46f3586f5 > Author: Andrew Hanushevsky <[log in to unmask]> > Date: Thu Aug 16 16:48:48 2012 -0700 > Make sure refresh thread is dead before deleting deleting the keytab. > > I am not sure how important this one is but Wei is using it. > > Cheers, > Wilko > > > > On Fri, 31 Aug 2012, Brian Bockelman wrote: > >> Perfectly fine by me. >> >> So: >> 1) Detailed monitoring fix. >> 2) Sendfile monitoring fix. >> >> I can't think of anything else? >> >> Brian >> >> On Aug 31, 2012, at 9:58 AM, Lukasz Janyst <[log in to unmask]> wrote: >> >>> Yes, but I won't manage today. Is Monday fine with you? >>> >>> Lukasz >>> >>> On Friday, August 31, 2012 07:34:44 AM Brian Bockelman wrote: >>>> Can we cut a 3.2.3 patch release with these two fixes? >>>> >>>> Brian >>>> >>>> On Aug 31, 2012, at 12:14 AM, "Yang, Wei" <[log in to unmask]> wrote: >>>>> I tested the second. I didn't get a chance to test the 1st before I lost >>>>> the window of restarting the cluster. But I have sendfile() turned off >>>>> and I do get correct results, so it implicitly confirms the 1st one. >>>>> >>>>> regards, >>>>> Wei Yang | [log in to unmask] | 650-926-3338(O) >>>>> >>>>> On Aug 30, 2012, at 9:29 PM, Wilko Kroeger wrote: >>>>>> Hello Brian >>>>>> >>>>>> Yes, we also noticed that the detailed monitoring is not working in >>>>>> v3.2.2. We build a version on top of v3.2.2 adding the two commits: >>>>>> >>>>>> commit e0ad3459c89a163e600070a15936b8fd5d26ff35 >>>>>> Author: Andrew Hanushevsky <[log in to unmask]> >>>>>> Date: Wed Aug 22 18:56:19 2012 -0700 >>>>>> >>>>>> Make sure read statistics are updated for sendfile() and mmap I/O. >>>>>> >>>>>> commit e51db4bb0178a21bbe87ccf7c9349b079c2d7455 >>>>>> Author: Andrew Hanushevsky <[log in to unmask]> >>>>>> Date: Mon Jul 30 16:52:56 2012 -0700 >>>>>> >>>>>> Correct monitor initialization test to start monitor under all >>>>>> configs. >>>>>> >>>>>> As far as I can tell the detailed monitoring is now working. Wei might >>>>>> have done more testing. >>>>>> >>>>>> Cheers, >>>>>> >>>>>> Wilko >>>>>> >>>>>> On Thu, 30 Aug 2012, Brian Bockelman wrote: >>>>>>> Hi Andy, >>>>>>> >>>>>>> The core wasn't interesting. However, I tracked it down to this change >>>>>>> (line 334 in XrdXrootdConfig.cc): >>>>>>> >>>>>>> if ((!isRedir || (RQList.Next() != 0 && XrdXrootdMonitor::Redirect()))) >>>>>>> >>>>>>> became: >>>>>>> >>>>>>> if ((!isRedir || (RQList.Next() != 0)) && XrdXrootdMonitor::Redirect()) >>>>>>> >>>>>>> (in 3.2.2). In master, it is this test: >>>>>>> >>>>>>> if (!isRedir || XrdXrootdMonitor::Redirect()) >>>>>>> >>>>>>> Note that XrdXrootdMonitor::Redirect always returns 0 (I suspect the bug >>>>>>> is this). >>>>>>> >>>>>>> So, basically, I think detailed monitoring is broken in the 3.2.2 >>>>>>> release. Matevz, take note... >>>>>>> >>>>>>> What's the minimal patch? I can ask OSG to push this out ASAP. >>>>>>> >>>>>>> Brian >>>>>>> >>>>>>> On Aug 28, 2012, at 9:26 PM, Andrew Hanushevsky <[log in to unmask]> wrote: >>>>>>>> Hi Brian, >>>>>>>> >>>>>>>> Best to get a gcore on this one. Seems like the monitoring did not >>>>>>>> initialize correctly as it's trying to send to fd 0. >>>>>>>> >>>>>>>> Andy >>>>>>>> >>>>>>>> -----Original Message----- From: Brian Bockelman >>>>>>>> Sent: Tuesday, August 28, 2012 7:15 PM >>>>>>>> To: <[log in to unmask]> >>>>>>>> Subject: Strange detailed monitoring issue >>>>>>>> >>>>>>>> After a power outage locally, Matevz noticed he is not receiving >>>>>>>> monitoring messages. >>>>>>>> >>>>>>>> Sure enough, from strace: >>>>>>>> >>>>>>>> [pid 1705] sendto(0, >>>>>>>> "t8\5\270\0\0\0\0\340\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\200\0\0\0\302^v#". >>>>>>>> .., 1464, 0, {sa_family=AF_UNSPEC, >>>>>>>> sa_data="\0\0\0\0\0\0\0\0\0\0\0\0\0\0"}, 16) = -1 ENOTSOCK (Socket >>>>>>>> operation on non-socket) >>>>>>>> >>>>>>>> Version info: >>>>>>>> >>>>>>>> [root@red-gridftp3 ~]# rpm -q xrootd-server >>>>>>>> xrootd-server-3.2.2-1.osg.el5.xu >>>>>>>> >>>>>>>> Log startup is below. Config file snippet is: >>>>>>>> >>>>>>>> xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest files io >>>>>>>> info user xrootd.t2.ucsd.edu:9930 xrd.report xrootd.t2.ucsd.edu:9931 >>>>>>>> every 30s all sync >>>>>>>> >>>>>>>> Any ideas? We are at a loss as to what might be happening. >>>>>>>> >>>>>>>> Brian >>>>>>>> >>>>>>>> 120828 21:07:13 1663 Scalla is starting. . . >>>>>>>> Copr. 2010 Stanford University, xrd version v3.2.2 >>>>>>>> ++++++ xrootd [log in to unmask] initialization started. >>>>>>>> Config using configuration file /etc/xrootd/xrootd-clustered.cfg >>>>>>>> =====> xrd.port 1094 >>>>>>>> =====> xrd.trace conn >>>>>>>> =====> all.adminpath /var/run/xrootd >>>>>>>> =====> xrd.report xrootd.t2.ucsd.edu:9931 every 30s all sync >>>>>>>> Config maximum number of connections restricted to 65536 >>>>>>>> Copr. 2007 Stanford University, xrootd version 2.9.7 build v3.2.2 >>>>>>>> ++++++ xrootd protocol initialization started. >>>>>>>> =====> all.export / nostage >>>>>>>> =====> xrootd.trace emsg login stall redirect >>>>>>>> =====> xrootd.seclib /usr/lib64/libXrdSec.so >>>>>>>> Config warning: ignoring fslib; libXrdOfs.so is built-in. >>>>>>>> =====> xrootd.fslib /usr/lib64/libXrdOfs.so >>>>>>>> =====> all.pidpath /var/run/xrootd >>>>>>>> =====> xrootd.monitor all auth flush 30s mbuff 1472 window 5s dest >>>>>>>> files io info user xrootd.t2.ucsd.edu:9930 Config exporting / >>>>>>>> ++++++ Authentication system initialization started. >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: *** >>>>>>>> ------------------------------------------------------------ *** >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: Mode: server >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: Debug: -1 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: CA dir: >>>>>>>> /etc/grid-security/certificates 120828 21:07:13 1663 secgsi_InitOpts: >>>>>>>> CA verification level: 1 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: CRL dir: >>>>>>>> /etc/grid-security/certificates/ 120828 21:07:13 1663 secgsi_InitOpts: >>>>>>>> CRL extension: .r0 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: CRL check level: 1 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: CRL refresh time: 86400 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: Certificate: >>>>>>>> /etc/grid-security/xrd/xrdcert.pem 120828 21:07:13 1663 >>>>>>>> secgsi_InitOpts: Key: /etc/grid-security/xrd/xrdkey.pem 120828 >>>>>>>> 21:07:13 1663 secgsi_InitOpts: Proxy delegation option: 0 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: GRIDmap file: >>>>>>>> /etc/grid-security/grid-mapfile 120828 21:07:13 1663 secgsi_InitOpts: >>>>>>>> GRIDmap option: 10 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: GRIDmap cache entries expiration >>>>>>>> (secs): 0 120828 21:07:13 1663 secgsi_InitOpts: Authorization >>>>>>>> function: libXrdLcmaps.so 120828 21:07:13 1663 secgsi_InitOpts: >>>>>>>> Authorization function parms: >>>>>>>> --osg,--lcmapscfg,/etc/xrootd/lcmaps.cfg,--loglevel,0|useglobals >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: Authorization cache entries >>>>>>>> expiration (secs): -1 120828 21:07:13 1663 secgsi_InitOpts: Client >>>>>>>> proxy availability in XrdSecEntity.endorsement: 0 120828 21:07:13 1663 >>>>>>>> secgsi_InitOpts: VOMS option: 1 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: MonInfo option: 0 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: Crypto modules: ssl >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: Ciphers: >>>>>>>> aes-128-cbc:bf-cbc:des-ede3-cbc 120828 21:07:13 1663 secgsi_InitOpts: >>>>>>>> MDigests: sha1:md5 >>>>>>>> 120828 21:07:13 1663 secgsi_InitOpts: *** >>>>>>>> ------------------------------------------------------------ *** >>>>>>>> 120828 21:07:13 1663 secgsi_LoadAuthzFun: using 'XrdSecgsiAuthzFun()' >>>>>>>> from libXrdLcmaps.so =====> sec.protocol /usr/lib64 gsi >>>>>>>> -certdir:/etc/grid-security/certificates >>>>>>>> -cert:/etc/grid-security/xrd/xrdcert.pem >>>>>>>> -key:/etc/grid-security/xrd/xrdkey.pem -crl:1 >>>>>>>> -authzfun:libXrdLcmaps.so -authzfunparms:--osg,--lcmapscfg,/et Config >>>>>>>> 1 authentication directives processed in >>>>>>>> /etc/xrootd/xrootd-clustered.cfg ------ Authentication system >>>>>>>> initialization completed. >>>>>>>> ++++++ File system initialization started. >>>>>>>> =====> all.role server >>>>>>>> Config warning: ignoring invalid trace option 'none'. >>>>>>>> =====> ofs.trace none >>>>>>>> =====> ofs.authorize >>>>>>>> =====> ofs.osslib /usr/lib64/libXrdHdfs.so >>>>>>>> ++++++ Authorization system initialization started. >>>>>>>> 120828 21:07:13 1663 acc_Config: Authorization system using >>>>>>>> configuration in /etc/xrootd/xrootd-clustered.cfg =====> acc.authdb >>>>>>>> /etc/xrootd/Authfile >>>>>>>> =====> acc.audit deny grant >>>>>>>> Config 2 authorization directives processed in >>>>>>>> /etc/xrootd/xrootd-clustered.cfg Config 1 auth entries processed in >>>>>>>> /etc/xrootd/Authfile >>>>>>>> ------ Authorization system initialization completed. >>>>>>>> Copr. 2009, Brian Bockelman, Hdfs Version >>>>>>>> 120828 21:07:13 1663 hdfs_Config: Copr. 2009, Brian Bockelman, Hdfs >>>>>>>> Version >>>>>>>> 120828 21:07:13 1663 hdfs_Config: Configuring HDFS. >>>>>>>> =====> oss.namelib /usr/lib64/libXrdCmsTfc.so >>>>>>>> file:/etc/xrootd/storage.xml?protocol=hadoop Copr. 2009 University of >>>>>>>> Nebraska-Lincoln TFC plugin v 1.0 >>>>>>>> Params: file:/etc/xrootd/storage.xml?protocol=hadoop >>>>>>>> Xerces-c has been initialized. >>>>>>>> Connecting to the catalog file:/etc/xrootd/storage.xml?protocol=hadoop >>>>>>>> Using catalog file /etc/xrootd/storage.xml >>>>>>>> ------ HDFS storage system initialization completed. >>>>>>>> 120828 21:07:13 1663 hdfs_HDFS storage system initialization.: >>>>>>>> completed. >>>>>>>> ++++++ Configuring server role. . . >>>>>>>> =====> all.manager srm.unl.edu:1213 >>>>>>>> =====> cms.trace all >>>>>>>> =====> all.adminpath /var/run/xrootd >>>>>>>> 120828 21:07:13 1663 Configure Global System Identification: anon-s >>>>>>>> 1213srm.unl.edu>>>> >>>>>>>> Config effective /etc/xrootd/xrootd-clustered.cfg ofs configuration: >>>>>>>> ofs.role server >>>>>>>> ofs.authorize >>>>>>>> ofs.maxdelay 60 >>>>>>>> ofs.osslib /usr/lib64/libXrdHdfs.so >>>>>>>> ofs.persist manual hold 600 logdir /var/run/xrootd/.ofs/posc.log >>>>>>>> ofs.trace 0 >>>>>>>> >>>>>>>> ------ File system server initialization completed. >>>>>>>> Config warning: 'xrootd.prepare logdir' not specified; prepare tracking >>>>>>>> disabled. 120828 21:07:13 1675 cms_Finder: Connected to cmsd via >>>>>>>> /var/run/xrootd/.olb/olbd.admin ------ xrootd protocol initialization >>>>>>>> completed. >>>>>>>> ------ xrootd [log in to unmask]:1094 initialization completed. >>>>>>>> >>>>>>>> >>>>>>>> ####################################################################### >>>>>>>> # >>>>>>>> Use REPLY-ALL to reply to list >>>>>>>> >>>>>>>> To unsubscribe from the XROOTD-DEV list, click the following link: >>>>>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 >>>>>>> >>>>>>> ######################################################################## >>>>>>> Use REPLY-ALL to reply to list >>>>>>> >>>>>>> To unsubscribe from the XROOTD-DEV list, click the following link: >>>>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 >>>>>> >>>>>> ######################################################################## >>>>>> Use REPLY-ALL to reply to list >>>>>> >>>>>> To unsubscribe from the XROOTD-DEV list, click the following link: >>>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 >>>>> >>>>> ######################################################################## >>>>> Use REPLY-ALL to reply to list >>>>> >>>>> To unsubscribe from the XROOTD-DEV list, click the following link: >>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 >>>>> <winmail.dat> >>>> >>>> ######################################################################## >>>> Use REPLY-ALL to reply to list >>>> >>>> To unsubscribe from the XROOTD-DEV list, click the following link: >>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 >>> >>> >>> Use REPLY-ALL to reply to list >>> >>> To unsubscribe from the XROOTD-DEV list, click the following link: >>> >>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1 >>> >> >> ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the XROOTD-DEV list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1