Hi Andy,

thanks! In case this is still useful, here's some more information.

Yes, all space groups were fixed, I only sent you one as an example. Here's the complete output of cstore11's last fix:

Audit of 35069 files in ATLASSCRATCHDISK space completed with no errors.
Claimed: 0
Actual: 1734698250629
Audit of 5214 files in ATLASLOCALGROUPDISK space completed with no errors.
Claimed: 0
Actual: 2307556894528
Audit of 498365 files in ATLASDATADISK space completed with no errors.
Claimed: 11993149362
Actual: 65010776295655
Audit of 116 files in public space completed with no errors.
Claimed: 223340914190
Actual: 223340914190

That was a few days ago, so things have changed since, but the current usage shows that LOCALGROUPDISK is way off again, at least on that server. The first number below is from cstore11, and then the other 6 servers. They should all show roughly the same, since the servers are pretty well balanced.

ATLASDATADISK:
68445699487289
56094782846807
68959311467158
56282078410523
63124517732464
69535660379334
69536269420556

ATLASLOCALGROUPDISK:
2307556897528
2291028980971
2355459965719
3280
3180
2296649283341
3260

ATLASSCRATCHDISK:
2400
3640
2600
1573175712257
1714778431188
2900
2520

public:
225955379726
172443302061
216656392931
227284052402
212123373809
216416678677
233566653469

So only ATLASDATADISK and public make sense -- the 20% or so differences between the servers are real, I can verify that with 'df' on those xfs partitions -- but the other two groups are completely off on some of the other servers.

Here's the relevant info from /etc/xrootd/xrootd-clustered.cfg:

    oss.usage log $(osscachepath)/.logs
    oss.space ATLASDATADISK assign /xrd/atlasdatadisk/
    oss.space ATLASLOCALGROUPDISK assign /xrd/atlaslocalgroupdisk/
    oss.space ATLASSCRATCHDISK assign /xrd/atlasscratchdisk/

That all makes sense, since it works fine when things are stable.

I can't figure out how to attach a file here, so I'll email you cstore11's .Usage file privately.

So into which release will the patch you just submitted will make it?
I guess it's too late for 4.12.3?

Thanks a lot,
Horst

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

[ { "@context": "http://schema.org", "@type": "EmailMessage", "potentialAction": { "@type": "ViewAction", "target": "https://github.com/xrootd/xrootd/issues/1213#issuecomment-644923429", "url": "https://github.com/xrootd/xrootd/issues/1213#issuecomment-644923429", "name": "View Issue" }, "description": "View this Issue on GitHub", "publisher": { "@type": "Organization", "name": "GitHub", "url": "https://github.com" } } ]

Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1