Here you go, attached. Both from xrootd and cmsd.
Thanks,
ksb
On 12/16/11 11:55 PM, Wilko Kroeger wrote:
>
> Hello Keith
>
> I am using the release 3.1.0 at slac with cache systems (using oss.space
> public ...) and files are placed in all cache systems.
> Could you maybe post the startup message from the xrdlog?
>
> Cheers,
> Wilko
>
>
>
> On Fri, 16 Dec 2011, Keith Beattie wrote:
>
>> Hi Andy,
>>
>> I'm using 3.1.0, built from source. I tried doubling the oss.cache
>> lines and the servers failed to start. When using oss.space rather
>> than oss.cache, doubling those lines isn't fatal, but regardless I get
>> the same behavior - data only to the first entry.
>>
>> Thanks,
>> ksb
>>
>> On 12/16/11 6:06 PM, Andrew Hanushevsky wrote:
>>> Hi Keith,
>>>
>>> You may not be missing anything, depending on what version you are
>>> using. There was a bug that exhibited exactly this behaviour. The bypass
>>> (other than upgrading to atleast 3.0.2) is to list the oss.cache entries
>>> twice for each path.
>>>
>>> Andy
>>>
>>> On Fri, 16 Dec 2011, Keith Beattie wrote:
>>>
>>>> Hello all,
>>>>
>>>> This seems like I'm missing something simple but can't seem to find it.
>>>>
>>>> On my data servers nodes, only the first 'oss.cache' entry is getting
>>>> data, the following disks don't seem to ever get written to. Below is
>>>> an example of what the config looks like on the data nodes (not santa
>>>> where the manager is running). What am I missing?
>>>>
>>>> ----
>>>> all.role server
>>>> all.manager santa 3121
>>>>
>>>> all.export /
>>>> oss.localroot /data/ns
>>>> oss.cache public /data/xrddata
>>>> oss.cache public /data1/xrddata
>>>> ----
>>>>
>>>> i.e. /data/xrddata gets filled, /data1/xrddata does not.
>>>>
>>>> Thanks,
>>>> ksb
>>>>
>>>> ########################################################################
>>>>
>>>> Use REPLY-ALL to reply to list
>>>>
>>>> To unsubscribe from the XROOTD-L list, click the following link:
>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>>>>
>>>
>>> ########################################################################
>>> Use REPLY-ALL to reply to list
>>>
>>> To unsubscribe from the XROOTD-L list, click the following link:
>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>>
>> ########################################################################
>> Use REPLY-ALL to reply to list
>>
>> To unsubscribe from the XROOTD-L list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
>>
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
111217 08:44:42 001 Scalla is starting. . .
Copr. 2010 Stanford University, xrd version v3.1.0
++++++ xrootd [log in to unmask] initialization started.
Config using configuration file /common/star/xrootd/etc/xrootd.pc2404.cf
=====> all.adminpath /export/data/star/xrootd/admin
Config maximum number of connections restricted to 65500
111217 08:44:42 001 XrdConfig: sendfile disabled!
111217 08:44:42 001 XrdSched: scheduling underused thread monitor in 780 seconds
111217 08:44:42 9505 XrdXeq: Buffer Manager reshaper thread started
111217 08:44:42 001 XrdSched: Starting with 2 workers
111217 08:44:42 9505 XrdXeq: Worker thread started
111217 08:44:42 001 XrdLink: Allocating 8 link objects at a time
111217 08:44:42 9505 XrdXeq: Time scheduler thread started
111217 08:44:42 9505 XrdXeq: Worker thread started
111217 08:44:42 001 XrdPoll: Starting poller 0
111217 08:44:42 9505 XrdXeq: Poller thread started
111217 08:44:42 001 XrdPoll: Starting poller 1
111217 08:44:42 9505 XrdXeq: Poller thread started
111217 08:44:42 001 XrdPoll: Starting poller 2
111217 08:44:42 9505 XrdXeq: Poller thread started
111217 08:44:42 001 XrdProtocol: getting port from protocol xrootd
111217 08:44:42 001 XrdConfig: LCL port 1094 wsz=87380 (87380)
111217 08:44:42 001 XrdProtocol: getting protocol object xrootd
Copr. 2007 Stanford University, xrootd version 2.9.7 build v3.1.0
++++++ xrootd protocol initialization started.
=====> all.pidpath /export/data/star/xrootd/admin
=====> all.export / nostage
Config exporting /
Config warning: 'xrootd.seclib' not specified; strong authentication disabled!
++++++ File system initialization started.
=====> all.role server
111217 08:44:42 9505 XrdXeq: Event receiver thread started
++++++ Configuring server role. . .
=====> all.manager pdsfgrid2 3121
=====> all.adminpath /export/data/star/xrootd/admin
111217 08:44:42 001 Configure Global System Identification: anon-s 3121pdsfgrid2.nersc.gov
111217 08:44:42 9505 XrdXeq: Event flusher thread started
111217 08:44:42 9505 XrdXeq: cms i/f thread started
++++++ Storage system initialization started.
=====> all.export / nostage
=====> oss.localroot /export/data/star/reco
111217 08:44:42 9505 cms_Open: Unable to connect socket to /export/data/star/xrootd/admin/.olb/olbd.admin; connection refused
=====> oss.space public /export/data/star/xrddata
=====> oss.space public /export/data/star/xrddata
=====> oss.space public /export/data1/star/xrddata
=====> oss.space public /export/data1/star/xrddata
111217 08:44:42 001 oss_AioInit: started AIO read signal thread; tid=1106004288
111217 08:44:42 001 oss_AioInit: started AIO write signal thread; tid=1108154688
111217 08:44:42 9505 XrdXeq: cache scan thread started
Config effective /common/star/xrootd/etc/xrootd.pc2404.cf oss configuration:
oss.alloc 0 0 0
oss.cachescan 600
oss.fdlimit 32750 65500
oss.maxsize 0
oss.localroot /export/data/star/reco
oss.trace fff
oss.xfr 1 deny 10800 keep 1200
oss.memfile off max 2077915136
oss.space public /export/data/star/xrddata
oss.space public /export/data/star/xrddata
oss.space public /export/data1/star/xrddata
oss.space public /export/data1/star/xrddata
oss.defaults r/w nocheck nodread nomig norcreate nopurge nostage xattr
oss.path / r/w nocheck nodread nomig norcreate nopurge nostage xattr
------ Storage system initialization completed.
Config effective /common/star/xrootd/etc/xrootd.pc2404.cf ofs configuration:
ofs.role server
ofs.maxdelay 60
ofs.persist manual hold 600 logdir /export/data/star/xrootd/admin/.ofs/posc.log
ofs.trace bfcd
------ File system server initialization completed.
111217 08:44:42 001 XrootdAioReq: Max aio/req=8; aio/srv=4096; Quantum=131072
111217 08:44:42 001 XrootdAioReq: Adding 18 aioreq objects.
111217 08:44:42 001 XrootdAio: Adding 18 aio objects; 4096 pending.
111217 08:44:42 001 XrdSched: scheduling xrootd protocol anchor in 3600 seconds
Config warning: 'xrootd.prepare logdir' not specified; prepare tracking disabled.
111217 08:44:42 9505 XrdXeq: Admin traffic thread started
------ xrootd protocol initialization completed.
------ xrootd [log in to unmask]:1094 initialization completed.
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
111217 08:44:42 001 Scalla is starting. . .
Copr. 2010 Stanford University, xrd version v3.1.0
++++++ cmsd [log in to unmask] initialization started.
Config using configuration file /common/star/xrootd/etc/xrootd.pc2404.cf
=====> all.adminpath /export/data/star/xrootd/admin
Config maximum number of connections restricted to 65500
111217 08:44:42 001 XrdConfig: sendfile disabled!
111217 08:44:42 001 XrdSched: scheduling underused thread monitor in 780 seconds
111217 08:44:42 9522 XrdXeq: Buffer Manager reshaper thread started
111217 08:44:42 001 XrdSched: Starting with 2 workers
111217 08:44:42 001 XrdLink: Allocating 8 link objects at a time
111217 08:44:42 9522 XrdXeq: Time scheduler thread started
111217 08:44:42 9522 XrdXeq: Worker thread started
111217 08:44:42 9522 XrdXeq: Worker thread started
111217 08:44:42 001 XrdPoll: Starting poller 0
111217 08:44:42 9522 XrdXeq: Poller thread started
111217 08:44:42 001 XrdPoll: Starting poller 1
111217 08:44:42 9522 XrdXeq: Poller thread started
111217 08:44:42 001 XrdPoll: Starting poller 2
111217 08:44:42 9522 XrdXeq: Poller thread started
111217 08:44:42 001 XrdProtocol: getting port from protocol cmsd
Copr. 2007 Stanford University/SLAC cmsd.
++++++ [log in to unmask] phase 1 initialization started.
=====> all.role server
=====> all.manager pdsfgrid2 3121
=====> all.adminpath /export/data/star/xrootd/admin
=====> all.pidpath /export/data/star/xrootd/admin
=====> all.export / nostage
=====> oss.localroot /export/data/star/reco
The following paths are available to the redirector:
w /
------ [log in to unmask] phase 1 server initialization completed.
111217 08:44:42 001 XrdConfig: LCL port 47873 wsz=87380 (87380)
111217 08:44:42 001 XrdProtocol: getting protocol object cmsd
++++++ [log in to unmask] phase 2 server initialization started.
111217 08:44:42 001 Configure2 Global System Identification: anon-s 3121pdsfgrid2.nersc.gov
++++++ Storage system initialization started.
=====> all.export / nostage
=====> oss.localroot /export/data/star/reco
=====> oss.space public /export/data/star/xrddata
=====> oss.space public /export/data/star/xrddata
=====> oss.space public /export/data1/star/xrddata
=====> oss.space public /export/data1/star/xrddata
++++++ Configuring standalone mode . . .
111217 08:44:42 001 oss_AioInit: started AIO read signal thread; tid=1085790528
111217 08:44:42 001 oss_AioInit: started AIO write signal thread; tid=1107646784
Config effective /common/star/xrootd/etc/xrootd.pc2404.cf oss configuration:
oss.alloc 0 0 0
oss.cachescan 600
oss.fdlimit 32750 65500
oss.maxsize 0
oss.localroot /export/data/star/reco
oss.trace fff
oss.xfr 1 deny 10800 keep 1200
oss.memfile off max 2077915136
oss.space public /export/data/star/xrddata
oss.space public /export/data/star/xrddata
oss.space public /export/data1/star/xrddata
oss.space public /export/data1/star/xrddata
oss.defaults r/w nocheck nodread nomig norcreate nopurge nostage xattr
oss.path / r/w nocheck nodread nomig norcreate nopurge nostage xattr
------ Storage system initialization completed.
111217 08:44:42 001 Start Srv=0 dfs=0 lcl=0 Pre=1 dmLife=0 0
111217 08:44:42 001 Start Lim=0 0 fix=0 Qmax=1
111217 08:44:42 001 oss_CacheScan: New free=352398422016 path=/export/data/star/xrddata/
111217 08:44:42 001 oss_CacheScan: New free=352398422016 path=/export/data/star/xrddata/
111217 08:44:42 001 calcSpace New fs info; maxfree=336073MB utilized=6%
111217 08:44:42 001 Meter: Found 2 filesystem(s); 662GB total (6% util); 625GB free (328GB max)
111217 08:44:42 9522 XrdXeq: FS meter thread started
------ [log in to unmask] phase 2 server initialization completed.
111217 08:44:42 9522 XrdSched: running cmsd startup inq=0
111217 08:44:42 9522 XrdXeq: Notification handler thread started
111217 08:44:42 9522 XrdXeq: Prep handler thread started
------ cmsd [log in to unmask]:47873 initialization completed.
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
|