 |
 |
Hello, We have an issue with two of our XRootD Ceph gateways (running xrootd@proxy and xrootd@ceph services). The issue is that at (seemingly) random times, almost once a day, the data traffic through these gateways suddenly stops. There is no apparent reason for this happening or a warning message in the logs. Only the following line is printed in the /var/log/xrootd/proxy/xrootd.log 210120 23:20:55 1779 XrdBuffManager: Reshaper has 90282K; target 19646593K Restarting xrootd@proxy immediately restores traffic. During the last week or so, ALICE have been sending data to RAL from a decommissioned SE which involves a large scale of TPC transfers. Following communication with the ALICE admins, I increased the "rfr" flag (number of allowed concurrent TPC transfers) in the "ofs.tpc" directive from the default value of 9 to 200. This appeared to have delayed the stop in data traffic for a couple of days but it didn't prevent it from happening. One remarkable thing seen before the stop of traffic is the abnormal increase in the CLOSE_WAIT connections (i.e. the connections that have been 'closed' by the client and waiting for the xrootd server to close its end) to a number > 9.25K Any clues where to look at would be more than welcome. Many thanks, George This email and any attachments are intended solely for the use of the named recipients. If you are not the intended recipient you must not use, disclose, copy or distribute this email or any of its attachments and should notify the sender immediately and delete this email from your system. UK Research and Innovation (UKRI) has taken every reasonable precaution to minimise risk of this email or any attachments containing viruses or malware but the recipient should carry out its own virus and malware checks before opening the attachments. UKRI does not accept any liability for any losses or damages which the recipient may sustain due to presence of any viruses. Opinions, conclusions or other information in this message and attachments that are not related directly to UKRI business are solely those of the author and do not represent the views of UKRI. ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the XROOTD-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1