Hi,
I having a heck of a time trying to debug this problem.
I have a stand alone file server with two partitions /data/1 and /data/2 that are glued together with xrootd
Here is the xrootd config file important bits -
all.adminpath /var/spool/xrootd/admin
all.export /atlas r/w
oss.space public /data/*
xrootd.chksum max 3 adler32 /usr/bin/xrdadler32
xrootd.seclib /usr/lib64/libXrdSec.so
sec.protocol /usr/lib64 unix
acc.authdb /etc/xrootd/auth_file
ofs.authorize
cms.space min 10g 15g
xrootd.trace all
Both of the data partitions have sufficient space and inodes free.
[root@atlasfs ~]# df -h /data/*
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vgdata1-lvdata1
19T 17T 2.2T 89% /data/1
/dev/mapper/vgdata2-lvdata2
19T 16T 3.0T 84% /data/2
[root@atlasfs ~]# df -ih /data/*
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/mapper/vgdata1-lvdata1
3.7G 211K 3.7G 1% /data/1
/dev/mapper/vgdata2-lvdata2
3.7G 165K 3.7G 1% /data/2
The exported area /atlas is on a disk with sufficient space and inodes :
[root@atlasfs ~]# df -ih /atlas
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/mapper/sysvg-LVsys
1.6M 639K 926K 41% /
[root@atlasfs ~]# df -h /atlas
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/sysvg-LVsys
24G 16G 7.7G 67% /
Yet the xrootd data server is reporting no space left on the device.
150325 16:04:16 10920 ?:7@atlas28 XrootdProtocol: 0000 req=3007 dlen=71
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdResponse: 0000 sending 23 data bytes; status=0
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdProtocol: 0000 req=3000 dlen=21
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdResponse: 0000 sending OK
150325 16:04:16 10920 XrootdXeq: dbenjami.9782:7@atlas28 pub IPv4 login as dbenjamin
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdProtocol: 0100 req=3017 dlen=39
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdProtocol: 0100 rc=0 stat /atlas/local/dbenjamin/xroot_copy_test/
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdResponse: 0100 sending 36 data bytes
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdProtocol: 0100 req=3010 dlen=94
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdProtocol: 0100 open unmat
/atlas/local/dbenjamin/xroot_copy_test//NTUP_SMWZ.01122074._000001.root.1?oss.asize=3303014400
150325 16:04:16 10920 ofs_open: dbenjami.9782:7@atlas28 Unable to create
/atlas/local/dbenjamin/xroot_copy_test/NTUP_SMWZ.01122074._000001.root.1; no space left on device
150325 16:04:16 10920 dbenjami.9782:7@atlas28 XrootdResponse: 0100 sending err 3009: Unable to create
/atlas/local/dbenjamin/xroot_copy_test/NTUP_SMWZ.01122074._000001.root.1; no space left on device
150325 16:04:16 10920 XrootdXeq: dbenjami.9782:7@atlas28 disc 0:00:00
150325 16:09:19 10950 ?:18@atlas17 XrootdProtocol: 0000 req=3007 dlen=84
150325 16:09:19 10950 xrootd.7213:18@atlas17 XrootdResponse: 0000 sending 23 data bytes; status=0
150325 16:09:19 10950 xrootd.7213:18@atlas17 XrootdProtocol: 0000 req=3000 dlen=18
150325 16:09:19 10950 xrootd.7213:18@atlas17 XrootdResponse: 0000 sending OK
Also using xrd -
[dbenjamin@atlas28 bnl_openstack]$ xrd atlasfs.hep.anl.gov statvfs /atlas/local
r/w nodes: 1 r/w free space: 3064292 r/w utilization: 0 staging nodes: 1 staging free space: 3064292 staging utilization: 0
[dbenjamin@atlas28 bnl_openstack]$ xrd atlasfs.hep.anl.gov queryspace /atlas/local
Disk space approximations (MB):
Total : 38139916
Free : 5324910
Used : 0
Largest chunk : 3064292
What am I missing?
Thanks,
Doug Benjamin
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
