Dear Yang-wei:
Thanks for the reply, actually the line 'all.manager valtical.cern.ch
1213 ' is already in the old file:
Here is the full content of the old configuration file:
---------------------------------------------------------------------------------------------------------------------------
#COMMON INFORMATION
#We assume that all xrootd instances using this file are installed in
the same directory
set xrootdlocation = /opt/vdt-xrootd/xrootd
set xrdr = valtical.cern.ch
all.export /localdisk/xrootd
all.export /localdisk/proofbox r/o
all.adminpath ${xrootdlocation}/var/admin
all.manager $(xrdr):1213
#cms.allow host *.cern.ch
cms.allow host valtical.cern.ch
cms.allow host valtical00.cern.ch
cms.allow host valtical04.cern.ch
cms.allow host valtical05.cern.ch
cms.allow host valtical06.cern.ch
cms.allow host valtical07.cern.ch
cms.allow host valtical08.cern.ch
cms.allow host valtical09.cern.ch
xrd.port 1094
xrootd.fslib ${xrootdlocation}/lib/libXrdOfs.so
if $(xrdr)
all.role manager
# CNSD_XRDR_BEGIN
# broadcast mv, rm, rmdir and trunc operations to all data
servers, and
# redirect the client to CNS (the second xrootd instance on
redirector)
# to do the operation on shadow file/dir.
ofs.forward 3way $(xrdr):2094 mv rm rmdir trunc
# CNSD_XRDR_END
else
all.role server
xrootd.chksum max 3 adler32 ${xrootdlocation}/bin/xrdadler32
cms.perf int 2m pgm ${xrootdlocation}/etc/XrdOlbMonPerf 120
set osscachepath = /localdisk/xrootd
oss.cache public $(osscachepath)/* xa
oss.cache public /localdisk2/xrootd xa
oss.cache public /localdisk7/xrootd xa
oss.cache public /localdisk4/xrootd xa
oss.cache public /localdisk5/xrootd xa
oss.cache public /localdisk6/xrootd xa
oss.usage log ${xrootdlocation}/var/admin
# CNSD_BEGIN
ofs.notify create closew mkdir | ${xrootdlocation}/bin/XrdCnsd
-d -l ${xrootdlocation}/var/logs/cnsd.log root://$(xrdr):2094
ofs.notifymsg create $TID create $FMODE $LFN?$CGI
ofs.notifymsg closew $TID closew $LFN $FSIZE
# CNSD_END
fi
---------------------------------------------------------------------------------------------------------------------------
I changed to a new configuration file then it works, but as you see
those lines between
# CNSD_XRDR_BEGIN" and "# CNSD_XRDR_END" are still there and I didn't see major difference between these 2 files but it works, so maybe you can have some idea on this new configuration file:
---------------------------------------------------------------------------------------------------------------------------# Xrootd Configuration
set xrootdlocation = /opt/vdt-xrootd/xrootd
set xrdr = valtical.cern.ch
all.adminpath ${xrootdlocation}/var/admin
all.export /localdisk/xrootd
all.export /localdisk/proofbox r/o
all.manager $(xrdr):1213
all.role server
xrootd.fslib ${xrootdlocation}/lib/libXrdOfs.so
xrd.port 1094
#cms.allow host *.cern.ch
cms.allow host valtical.cern.ch
cms.allow host valtical00.cern.ch
cms.allow host valtical04.cern.ch
cms.allow host valtical05.cern.ch
cms.allow host valtical06.cern.ch
cms.allow host valtical07.cern.ch
cms.allow host valtical08.cern.ch
cms.allow host valtical09.cern.ch
cms.pidpath ${xrootdlocation}/var/admin
#cms.perf int 2m pgm ${xrootdlocation}/etc/XrdOlbMonPerf 120
ofs.notify create closew mkdir | ${xrootdlocation}/bin/XrdCnsd -d -l
${xrootdlocation}/var/logs/cnsd.log root://$(xrdr):2094
ofs.notifymsg create $TID create $FMODE $LFN?$CGI
ofs.notifymsg closew $TID closew $LFN $FSIZE
set osscachepath = /localdisk/xrootd
oss.cache public $(osscachepath)/* xa
oss.cache public /localdisk2/xrootd xa
oss.cache public /localdisk3/xrootd xa
oss.cache public /localdisk4/xrootd xa
oss.cache public /localdisk5/xrootd xa
oss.cache public /localdisk6/xrootd xa
---------------------------------------------------------------------------------------------------------------------------
Cheers,Gang
On 01/21/2013 07:56 AM, Yang, Wei wrote:
> Dear Gang,
>
> you missed a line in your config file. please add the following out side of the "if-else-fi" statement (so both valtical and valtical00 can see it)
>
> all.manager valtical.cern.ch 1213
>
> in addition, things between "# CNSD_XRDR_BEGIN" and "# CNSD_XRDR_END" are probably obsolete unless you have specific needs such as xrootd inventory.
>
> regards,
> Wei Yang | [log in to unmask] | 650-926-3338(O)
>
>
>
>
> On Jan 18, 2013, at 3:35 AM, qing wrote:
>
>> Dear Expert:
>>
>> Today when I try to upload some files, the following error appeared:
>>
>> root://valtical.cern.ch//localdisk/xrootd/test1.root
>>
>> Last server error 3011 ('No servers are available to write the file,
>> however, on one file server there are still ~ 5TB free space.
>>
>> valtical.cern.ch is the xrdr, while valtical00 is one of the disk
>> servers which has a lot of free space, the other disk servers are all
>> full at this time.
>>
>> Here is the xrootd configuration file on valtical00:
>> ------------------------------------------------------------------------------------------------------------------------
>>
>> xrootd.fslib ${xrootdlocation}/lib/libXrdOfs.so
>>
>> if $(xrdr)
>> all.role manager
>>
>> # CNSD_XRDR_BEGIN
>> # broadcast mv, rm, rmdir and trunc operations to all data
>> servers, and
>> # redirect the client to CNS (the second xrootd instance on
>> redirector)
>> # to do the operation on shadow file/dir.
>> ofs.forward 3way $(xrdr):2094 mv rm rmdir trunc
>> # CNSD_XRDR_END
>> else
>>
>> all.role server
>> xrootd.chksum max 3 adler32 ${xrootdlocation}/bin/xrdadler32
>> cms.perf int 2m pgm ${xrootdlocation}/etc/XrdOlbMonPerf 120
>> set osscachepath = /localdisk/xrootd
>> oss.cache public $(osscachepath)/* xa
>> oss.cache public /localdisk2/xrootd xa
>> oss.cache public /localdisk3/xrootd xa
>> oss.cache public /localdisk4/xrootd xa
>> oss.cache public /localdisk5/xrootd xa
>> oss.cache public /localdisk6/xrootd xa
>> oss.usage log ${xrootdlocation}/var/admin
>>
>> # CNSD_BEGIN
>> ofs.notify create closew mkdir | ${xrootdlocation}/bin/XrdCnsd
>> -d -l ${xrootdlocation}/var/logs/cnsd.log root://$(xrdr):2094
>> ofs.notifymsg create $TID create $FMODE $LFN?$CGI
>> ofs.notifymsg closew $TID closew $LFN $FSIZE
>> # CNSD_END
>> --------------------------------------------------------------------------------------------------------------------------------------
>>
>> As you see, on valtical00 we still have 3 disks empty
>> [valtical00] /afs/cern.ch/user/q/qing > df -h | grep localdisk
>> /dev/sdb1 1.8T 1.7T 0 100% /localdisk
>> /dev/sdc1 1.8T 1.7T 0 100% /localdisk2
>> /dev/sdd1 1.8T 192G 1.6T 11% /localdisk3
>> /dev/sde1 1.8T 43G 1.7T 3% /localdisk4
>> /dev/sdg1 1.8T 1.7T 0 100% /localdisk5
>> /dev/sdh1 1.8T 196M 1.7T 1% /localdisk6
>>
>> Any idea what can be done to use these 3 disks?
>>
>> Cheers,Gang
>>
>> ########################################################################
>> Use REPLY-ALL to reply to list
>>
>> To unsubscribe from the XROOTD-L list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
