Quick question. Are you running the daemon with jemalloc or tcmalloc?
Andy
On Mon, 4 May 2020, Justas Bal?as wrote:
> Hi,
>
> I am seeing memory keep increasing on XRootD process. Some details below:
>
> Services are running since (2020-04-16):
> ```
> Redirecting to /bin/systemctl status [log in to unmask]
> ? [log in to unmask] - XRootD xrootd daemon instance clustered
> Loaded: loaded ([log in to unmask]; disabled; vendor preset: disabled)
> Active: active (running) since Thu 2020-04-16 16:28:10 PDT; 2 weeks 3 days ago
> Docs: man:xrootd(8)
> http://xrootd.org/docs.html
> Main PID: 2749 (xrootd)
> CGroup: [log in to unmask]
> ??2749 /usr/bin/xrootd -l /var/log/xrootd/xrootd.log -c /etc/xrootd/xrootd-clustered.cfg -k fifo -s /var/run/xrootd/xrootd-clustered.pid -n clustered
> [root@transfer-2 xrootd]# service cmsd@clustered status
> Redirecting to /bin/systemctl status [log in to unmask]
> ? [log in to unmask] - XRootD cmsd daemon instance clustered
> Loaded: loaded ([log in to unmask]; disabled; vendor preset: disabled)
> Active: active (running) since Thu 2020-04-16 16:28:10 PDT; 2 weeks 3 days ago
> Docs: man:cmsd(8)
> http://xrootd.org/docs.html
> Main PID: 2670 (cmsd)
> CGroup: [log in to unmask]
> ??2670 /usr/bin/cmsd -l /var/log/xrootd/cmsd.log -c /etc/xrootd/xrootd-clustered.cfg -k fifo -s /var/run/xrootd/cmsd-clustered.pid -n clustered
>
> Apr 16 16:28:10 transfer-2.ultralight.org systemd[1]: Started XRootD cmsd daemon instance clustered.
> ```
>
>
> Current XRootd version installed:
> ```
> [root@transfer-2 XRootD]# yum list installed | grep xrootd
> gfal2-plugin-xrootd.x86_64 2.17.2-1.el7 @epel
> xrootd.x86_64 1:4.11.2-1.osg35.el7 @osg
> xrootd-client.x86_64 1:4.11.2-1.osg35.el7 @osg
> xrootd-client-libs.x86_64 1:4.11.2-1.osg35.el7 @osg
> xrootd-cmstfc.x86_64 1.5.2-4.osg35.el7 @osg-contrib
> xrootd-fuse.x86_64 1:4.11.2-1.osg35.el7 @osg
> xrootd-hdfs.x86_64 2.1.7-2.osg35.el7 @osg
> xrootd-lcmaps.x86_64 1.7.5-1.osg35.el7 @osg
> xrootd-libs.x86_64 1:4.11.2-1.osg35.el7 @osg
> xrootd-scitokens.x86_64 1.2.0-2.osg35.el7 @osg
> xrootd-selinux.noarch 1:4.11.2-1.osg35.el7 @osg
> xrootd-server.x86_64 1:4.11.2-1.osg35.el7 @osg
> xrootd-server-libs.x86_64 1:4.11.2-1.osg35.el7 @osg
> ```
> XRootd Server Config:
> ```
> all.adminpath /var/spool/xrootd
> all.pidpath /var/run/xrootd
>
> # HDFS support
>
> ofs.osslib /usr/lib64/libXrdHdfs.so
> xrootd.seclib /usr/lib64/libXrdSec.so
> sec.protocol /usr/lib64 gsi -certdir:/etc/grid-security/certificates -cert:/etc/grid-security/xrootd/xrootdcert.pem -key:/etc/grid-security/xrootd/xrootdkey.pem -crl:3 -authzfun:libXrdLcmaps.so -authzfunparms:--lcmapscfg,/etc/xrootd/lcmaps.cfg,--loglevel,0 -gmapopt:10 -gmapto:0
> acc.authdb /etc/xrootd/auth_file
> ofs.authorize
>
> # Integrate with CMS TFC, placed in /etc/storage.xml
> oss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage.xml?protocol=hadoop
>
> # Monitoring for AAA Dashboard :
> xrd.report xrootd.t2.ucsd.edu:9931 every 60s all sync
> xrootd.monitor all auth flush io 60s ident 5m mbuff 8k rbuff 4k rnums 3 window 10s dest files io info user redir xrootd.t2.ucsd.edu:9930
>
> # The roles this server will play.
> all.role server
> all.manager transfer-1.ultralight.org:1213
> # The known managers
> all.manager meta transfer-1.ultralight.org:1213
>
> # Setting site name
> all.sitename T2_US_Caltech
>
> # Allow any path to be exported; this is further refined in the authfile.
> all.export /
>
> # Hosts allowed to use this xrootd cluster
> cms.allow host *
>
> xrd.port 1094
>
> xrootd.chksum max 2 md5 adler32 crc32
> # Below line is only necessary for HDFS sites
> ofs.ckslib * /usr/lib64/libXrdHdfs.so
>
> macaroons.secretkey /etc/xrootd/macaroon-secret
> ofs.authlib libXrdMacaroons.so libXrdAccSciTokens.so
>
> # Enable https over XrootD
> if exec xrootd
> xrd.protocol http:1094 /usr/lib64/libXrdHttp.so
> http.cadir /etc/grid-security/certificates
> http.cert /etc/grid-security/xrootd/xrootdcert.pem
> http.key /etc/grid-security/xrootd/xrootdkey.pem
> http.secxtractor /usr/lib64/libXrdLcmaps.so
> # Enable third-party-copy
> http.exthandler xrdtpc libXrdHttpTPC.so
> # Pass the bearer token to the Xrootd authorization framework.
> http.header2cgi Authorization authz
> http.listingdeny yes
> http.desthttps yes
> http.selfhttps2http no
> http.staticpreload http://static/robots.txt /etc/xrootd/robots.txt
> http.exthandler xrdmacaroons libXrdMacaroons.so
> fi
> ```
> Here is the plot below for RSS Usage for XrootD and CMSd process:
> 
>
> RSS Usage is monitored using telegrafs inputs.procstat module.
>
> --
> You are receiving this because you are subscribed to this thread.
> Reply to this email directly or view it on GitHub:
> https://github.com/xrootd/xrootd/issues/1189
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/xrootd/xrootd/issues/1189#issuecomment-623661288",
"url": "https://github.com/xrootd/xrootd/issues/1189#issuecomment-623661288",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1