 |
 |
It appears that if the xrootd daemon is started with the nprocess limit set to UNLIMITED, it gets upside down:
Config maximum number of threads restricted to -1
<snip>
150916 13:04:40 12143 XrdScheduler: Thread limit has been reached!
(full log at bottom)
(shoutout to @bbockelm who noticed what I had just skimmed right past. 
)
The behavior changed somehow between 3.x and 4.2.2 - the same box worked fine until xrootd was upgraded.
Copr. 2004-2012 Stanford University, xrd version v4.2.2
++++++ cmsd [log in to unmask] initialization started.
Config using configuration file /etc/xrootd/xrootd-lfs.cfg
=====> xrd.port 1094
=====> xrd.trace conn
=====> all.adminpath /var/run/xrootd
Config maximum number of connections restricted to 65536
Config maximum number of threads restricted to -1
150916 13:04:40 12143 XrdConfig: sendfile enabled.
150916 13:04:40 12145 XrdXeq: Buffer Manager reshaper thread started
150916 13:04:40 12143 XrdSched: scheduling underused thread monitor in 780 seconds
150916 13:04:40 12146 XrdXeq: Time scheduler thread started
150916 13:04:40 12143 XrdScheduler: Thread limit has been reached!
150916 13:04:40 12143 XrdSched: Starting with 0 workers
150916 13:04:40 12143 XrdLink: Allocating 8 link objects at a time
150916 13:04:40 12143 XrdPoll: Starting poller 0
150916 13:04:40 12147 XrdXeq: Poller thread started
150916 13:04:40 12143 XrdPoll: Starting poller 1
150916 13:04:40 12148 XrdXeq: Poller thread started
150916 13:04:40 12143 XrdPoll: Starting poller 2
150916 13:04:40 12149 XrdXeq: Poller thread started
150916 13:04:40 12143 XrdProtocol: getting port from protocol cmsd
Copr. 2007 Stanford University/SLAC cmsd.
++++++ [log in to unmask] phase 1 initialization started.
=====> all.role server
=====> all.manager se1.accre.vanderbilt.edu:1214
Config cms-xrd-transit.cern.ch -> all.manager vocms027.cern.ch
=====> all.manager cms-xrd-transit.cern.ch+ 1213
=====> oss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage-lfs.xml?protocol=direct
=====> all.export / nostage
=====> cms.trace all debug
=====> all.adminpath /var/run/xrootd
=====> all.pidpath /var/run/xrootd
The following paths are available to the redirector:
w /
------ [log in to unmask] phase 1 server initialization completed.
150916 13:04:40 12143 XrdConfig: LCL port 55165 wsz=10000000 (10000000)
150916 13:04:40 12143 XrdProtocol: getting protocol object cmsd
++++++ [log in to unmask] phase 2 server initialization started.
150916 13:04:40 12143 Configure2 Global System Identification: lfs-s 1214se1.accre.vanderbilt.edu1213vocms027.cern.ch
++++++ Storage system initialization started.
=====> oss.namelib /usr/lib64/libXrdCmsTfc.so file:/etc/xrootd/storage-lfs.xml?protocol=direct
=====> all.export / nostage
Plugin No such file or directory loading namelib /usr/lib64/libXrdCmsTfc-4.so
Config Falling back to using /usr/lib64/libXrdCmsTfc.so
Plugin loaded unversioned XrdOucgetName2Name from namelib /usr/lib64/libXrdCmsTfc.so
Copr. 2009 University of Nebraska-Lincoln TFC plugin v 1.0
Params: file:/etc/xrootd/storage-lfs.xml?protocol=direct
Xerces-c has been initialized.
Connecting to the catalog file:/etc/xrootd/storage-lfs.xml?protocol=direct
Using catalog file /etc/xrootd/storage-lfs.xml
++++++ Configuring standalone mode . . .
150916 13:04:40 12143 oss_AioInit: started AIO read signal thread; tid=889157376
150916 13:04:40 12143 oss_AioInit: started AIO write signal thread; tid=888104704
No lfn2pfn mapping for /
No lfn2pfn mapping for /
No lfn2pfn mapping for /
Config effective /etc/xrootd/xrootd-lfs.cfg oss configuration:
oss.alloc 0 0 0
oss.cachescan 600
oss.fdlimit 32768 65536
oss.maxsize 0
oss.namelib /usr/lib64/libXrdCmsTfc.so
oss.trace fff
oss.xfr 1 deny 10800 keep 1200
oss.memfile off max 33751543808
oss.defaults r/w nocheck nodread nomig norcreate nopurge nostage xattr
oss.path / r/w nocheck nodread nomig norcreate nopurge nostage xattr
------ Storage system initialization completed.
150916 13:04:40 12143 Start Srv=0 dfs=0 lcl=0 Pre=1 dmLife=0 0
150916 13:04:40 12143 Start Lim=0 0 fix=0 Qmax=1
150916 13:04:40 12143 calcSpace New fs info; maxfree=819722MB utilized=7%
150916 13:04:40 12143 Meter: Found 1 filesystem(s); 854GB total (7% util); 800GB free (800GB max)
150916 13:04:40 12220 XrdXeq: FS meter thread started
------ [log in to unmask] phase 2 server initialization completed.
------ cmsd [log in to unmask]:55165 initialization completed.
150916 13:24:40 12145 XrdBuffManager: Reshaper has 0K; target 6592098K
150916 13:44:40 12145 XrdBuffManager: Reshaper has 0K; target 6592098K
150916 14:04:40 12145 XrdBuffManager: Reshaper has 0K; target 6592098K
150916 14:24:40 12145 XrdBuffManager: Reshaper has 0K; target 6592098K
150916 14:44:40 12145 XrdBuffManager: Reshaper has 0K; target 6592098K
—
Reply to this email directly or view it on GitHub.
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1