 |
 |
Hi Yvan, The particular error here comes from XRootD not the cmsd. That is, the server was already selected but by the time the client got there the server didn't have enough space. If you are using xrdcp to copy in files then the client tells the server how much space it needs and it better be available. For other types of file creation, the server pre-reserves enough space so that the client doesn't die in the middle of writing data. This also impacts any other file creation requests. This is controlled by oss.alloc directive: http://xrootd.org/doc/dev41/ofs_config.htm#_Toc401930727 However, assuming you never specified it, the defaults are very loose so it looks like there really is no space left on the server and no directive will create more space. Andy On Thu, 15 Jun 2017, Yvan Calas wrote: > Dear XRootD experts, > > I would like to understand how to correctly set up the parameter cms.space in XRootD. We currently observe error messages like this one on our servers: > > 170615 18:42:06 285690 XrootdXeq: alisgm76.15597:26@[::xxx.xxx.xx.x] pub IPv4 login as alisgm76 > 170615 18:42:06 285690 ofs_open: alisgm76.15597:26@[::xxx.xxx.xx.x] Unable to create /03/01818/8cb7a7f4-51e9-11e7-a169-ef6caac907fd; no space left on device > 170615 18:42:06 285690 XrootdXeq: alisgm76.15597:26@[::xxx.xxx.xx.x] disc 0:00:00 > > In order to solve this issue, I reduced the recalc parameter to 1 minutes and try different thresholds for the "min" and "hwm" parameters as described in [1]. Actually, we have: > > cms.space linger 0 recalc 1 min 100g 150g > > and the xrootd partition is as follow: > > Filesystem Size Used Avail Use% Mounted on > /dev/mapper/datavg-data > 110T 110T 109G 100% /xrootd > > I tried to change the value of the hwm parameter (below and above 100g) but without success, the error messages remain. > > Could you please tell me if there is something wrong with my setting? > > Thanks, > > Yvan > > > [1] http://xrootd.org/doc/dev45/cms_config.htm#_Toc454223038 > > ######################################################################## > Use REPLY-ALL to reply to list > > To unsubscribe from the XROOTD-L list, click the following link: > https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1 > ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the XROOTD-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1