URL:
<http://savannah.cern.ch/bugs/?82288>
Summary: xrootd server rejects files if the allocation hint
is a small number
Project: XROOTD
Submitted by: ljanyst
Submitted on: 2011-05-16 09:05
Severity: 3 - Normal
Priority: 5 - Normal
Status: None
Privacy: Public
Assigned to: None
Originator Email:
Open/Closed: Open
Discussion Lock: Any
Fixed by commit(s):
_______________________________________________________
Details:
Doug Benjamin writes:
I am trying to debug a behavior that I am seeing in our cluster on a
standalone file server with three partitions.
when I try to copy a small file into the machine I see this error:
(debugging is on)
110515 19:19:58 001 Xrd: Open: Access to server granted.
110515 19:19:58 001 Xrd: Open: Opening the remote file
/atlas/local/benjamin/atl010-testfile?oss.asize=22
110515 19:19:58 001 Xrd: Open: File open in progress.
110515 19:19:58 22101 Xrd: SendGenCommand: Sending command Open
110515 19:19:58 22101 Xrd: ReadPartialAnswer: Reading a XrdClientMessage from
the server [atl005.phy.duke.edu:1094]...
110515 19:19:58 22101 Xrd: ReaderThread_loc: Reader Thread starting.
[xrootd] Total 0.00 MB |====110515 19:19:58 22101 Xrd: ReadPartialAnswer:
Server [atl005.phy.duke.edu:1094] answered [kXR_error] (4003)
=======110515 19:19:58 22101 Xrd: CheckErrorStatus: Server
[atl005.phy.duke.edu] declared: Unable to create
/atlas/local/benjamin/atl010-testfile; invalid suggested allocation
size(error code: 3005)
110515 19:19:58 001 Xrd: WriteBuffer: File not opened.
Error writing to output server.
Last server error 3005 ('Unable to create
/atlas/local/benjamin/atl010-testfile; invalid suggested allocation size')
110515 19:19:58 001 Xrd: Close: File not opened.
110515 19:19:58 001 Xrd: Disconnect: LogConnID: 0 destroyed
*******************************************************
On a test machine I have create three partitions:
[root@atl005 ~]# df -h /array*
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/xrootdvg-lv01
222G 188M 211G 1% /array1
/dev/mapper/xrootdvg-lv02
226G 188M 214G 1% /array2
/dev/mapper/xrootdvg-lv03
226G 188M 214G 1% /array3
Note all have plenty of space.
Here is the configuration file
set head = atlhn02.phy.duke.edu
set exportpath = /atlas
set domainname = *.phy.duke.edu
all.adminpath /var/spool/xrootd/admin
all.export $(exportpath)
oss.space public /array*
xrootd.chksum max 3 adler32 /usr/bin/xrdadler32
xrootd.seclib /usr/lib64/libXrdSec.so
# this specify that we use the 'unix' authentication module, additional one
can be specified.
sec.protocol /usr/lib64 unix
# this is the authorization file
acc.authdb /etc/xrootd/auth_file
ofs.authorize
ofs.notify closew create mkdir mv rm rmdir trunc | /usr/bin/XrdCnsd -d -D 2
-i 90 -b $(head):1095:$(exportpath)/inventory
Here is the authorization file (though I do not see it making any
difference)
# This means that all the users have read access to the datasets
u * /atlas lr
# This means that all the users have full access to their private dirs
u = /atlas/local/@=/ a
# This means that this privileged user can do everything
# You need at least one user like that, in order to create the
# private dir for each user willing to store his data in the facility
u xrootd /atlas a
Here is snippets from the xrootd.log
++++++ Storage system initialization started.
=====> all.export /atlas
=====> oss.space public /array*
Config effective /etc/xrootd/xrootd-standalone.cfg oss configuration:
oss.alloc 0 0 0
oss.cachescan 600
oss.compdetect * oss.fdlimit 32678 65356
oss.maxsize 0
oss.trace 0
oss.xfr 1 deny 10800 keep 1200
oss.memfile off max 8413181952
oss.space public /array1
oss.space public /array3
oss.space public /array2
oss.defaults r/w nocheck nodread nomig norcreate nopurge nostage
xattr
oss.path /atlas r/w nocheck nodread nomig norcreate nopurge nostage
xattr
------ Storage system initialization completed.
110515 19:00:21 19065 XrootdXeq: benjamin.22101:6@atl010 login as benjamin
110515 19:00:21 19065 ofs_open: benjamin.22101:6@atl010 Unable to create
/atlas/local/benjamin/atl010-testfile; invalid suggested allocation size
110515 19:00:21 19065 XrootdXeq: benjamin.22101:6@atl010 disc 0:00:00
I am at a lost to try to understand why I am getting the errors invalid
suggested allocation size
_______________________________________________________
Reply to this item at:
<http://savannah.cern.ch/bugs/?82288>
_______________________________________________
Message sent via/by LCG Savannah
http://savannah.cern.ch/
