Print

Print


Hi,

I am seeing memory keep increasing on XRootD process. Some details below:

Services are running since (2020-04-16):

Redirecting to /bin/systemctl status [log in to unmask][log in to unmask] - XRootD xrootd daemon instance clustered
   Loaded: loaded ([log in to unmask]; disabled; vendor preset: disabled)
   Active: active (running) since Thu 2020-04-16 16:28:10 PDT; 2 weeks 3 days ago
     Docs: man:xrootd(8)
           http://xrootd.org/docs.html
 Main PID: 2749 (xrootd)
   CGroup: [log in to unmask]
           └─2749 /usr/bin/xrootd -l /var/log/xrootd/xrootd.log -c /etc/xrootd/xrootd-clustered.cfg -k fifo -s /var/run/xrootd/xrootd-clustered.pid -n clustered
[root@transfer-2 xrootd]# service cmsd@clustered status
Redirecting to /bin/systemctl status [log in to unmask][log in to unmask] - XRootD cmsd daemon instance clustered
   Loaded: loaded ([log in to unmask]; disabled; vendor preset: disabled)
   Active: active (running) since Thu 2020-04-16 16:28:10 PDT; 2 weeks 3 days ago
     Docs: man:cmsd(8)
           http://xrootd.org/docs.html
 Main PID: 2670 (cmsd)
   CGroup: [log in to unmask]
           └─2670 /usr/bin/cmsd -l /var/log/xrootd/cmsd.log -c /etc/xrootd/xrootd-clustered.cfg -k fifo -s /var/run/xrootd/cmsd-clustered.pid -n clustered

Apr 16 16:28:10 transfer-2.ultralight.org systemd[1]: Started XRootD cmsd daemon instance clustered.

Current XRootd version installed:

[root@transfer-2 XRootD]# yum list installed | grep xrootd
gfal2-plugin-xrootd.x86_64            2.17.2-1.el7                     @epel
xrootd.x86_64                         1:4.11.2-1.osg35.el7             @osg
xrootd-client.x86_64                  1:4.11.2-1.osg35.el7             @osg
xrootd-client-libs.x86_64             1:4.11.2-1.osg35.el7             @osg
xrootd-cmstfc.x86_64                  1.5.2-4.osg35.el7                @osg-contrib
xrootd-fuse.x86_64                    1:4.11.2-1.osg35.el7             @osg
xrootd-hdfs.x86_64                    2.1.7-2.osg35.el7                @osg
xrootd-lcmaps.x86_64                  1.7.5-1.osg35.el7                @osg
xrootd-libs.x86_64                    1:4.11.2-1.osg35.el7             @osg
xrootd-scitokens.x86_64               1.2.0-2.osg35.el7                @osg
xrootd-selinux.noarch                 1:4.11.2-1.osg35.el7             @osg
xrootd-server.x86_64                  1:4.11.2-1.osg35.el7             @osg
xrootd-server-libs.x86_64             1:4.11.2-1.osg35.el7             @osg

XRootd Server Config:

all.adminpath /var/spool/xrootd
all.pidpath /var/run/xrootd

# HDFS support

ofs.osslib /usr/lib64/libXrdHdfs.so
xrootd.seclib /usr/lib64/libXrdSec.so
sec.protocol /usr/lib64 gsi -certdir:/etc/grid-security/certificates -cert:/etc/grid-security/xrootd/xrootdcert.pem -key:/etc/grid-security/xrootd/xrootdkey.pem -crl:3 -authzfun:libXrdLcmaps.so -authzfunparms:--lcmapscfg,/etc/xrootd/lcmaps.cfg,--loglevel,0 -gmapopt:10 -gmapto:0
acc.authdb /etc/xrootd/auth_file
ofs.authorize

# Integrate with CMS TFC, placed in /etc/storage.xml
oss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage.xml?protocol=hadoop

# Monitoring for AAA Dashboard :
xrd.report xrootd.t2.ucsd.edu:9931 every 60s all sync
xrootd.monitor all auth flush io 60s ident 5m mbuff 8k rbuff 4k rnums 3 window 10s dest files io info user redir xrootd.t2.ucsd.edu:9930

# The roles this server will play.
all.role server
all.manager transfer-1.ultralight.org:1213
# The known managers
all.manager meta transfer-1.ultralight.org:1213

# Setting site name
all.sitename T2_US_Caltech

# Allow any path to be exported; this is further refined in the authfile.
all.export /

# Hosts allowed to use this xrootd cluster
cms.allow host *

xrd.port 1094

xrootd.chksum max 2 md5 adler32 crc32
# Below line is only necessary for HDFS sites
ofs.ckslib * /usr/lib64/libXrdHdfs.so

macaroons.secretkey /etc/xrootd/macaroon-secret
ofs.authlib libXrdMacaroons.so libXrdAccSciTokens.so

# Enable https over XrootD
if exec xrootd
  xrd.protocol http:1094 /usr/lib64/libXrdHttp.so
  http.cadir /etc/grid-security/certificates
  http.cert /etc/grid-security/xrootd/xrootdcert.pem
  http.key /etc/grid-security/xrootd/xrootdkey.pem
  http.secxtractor /usr/lib64/libXrdLcmaps.so
  # Enable third-party-copy
  http.exthandler xrdtpc libXrdHttpTPC.so
  # Pass the bearer token to the Xrootd authorization framework.
  http.header2cgi Authorization authz
  http.listingdeny yes
  http.desthttps yes
  http.selfhttps2http no
  http.staticpreload http://static/robots.txt /etc/xrootd/robots.txt
  http.exthandler xrdmacaroons libXrdMacaroons.so
fi

Here is the plot below for RSS Usage for XrootD and CMSd process:
image

RSS Usage is monitored using telegrafs inputs.procstat module.


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

[ { "@context": "http://schema.org", "@type": "EmailMessage", "potentialAction": { "@type": "ViewAction", "target": "https://github.com/xrootd/xrootd/issues/1189", "url": "https://github.com/xrootd/xrootd/issues/1189", "name": "View Issue" }, "description": "View this Issue on GitHub", "publisher": { "@type": "Organization", "name": "GitHub", "url": "https://github.com" } } ]

Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1