Print

Print


Hi Matt,
cms.dfs limit 0 lookup distrib mdhold 0 redirect verify retries 2
worked from my testing (I can see the stat on the manager's xrootd service).

The full set of cmsd config I've used is this:

cms.dfs limit 0 lookup distrib mdhold 0 redirect verify retries 2
cms.sched affinity none
cms.sched cpu 20 io 0 mem 0 pag 0 runq 80 space 0 fuzz 15
cms.sched maxload 80
cms.perf int 10s pgm /etc/xrootd/xrdload.sh
# Only used by the cmsd managers
cms.ping 30 log 1 usage 6
# Only used by cmsd manager
cms.fxhold 60s 1m
cms.blacklist check 1m /etc/xrootd/cms.blacklist
cms.space recalc 30 min 1g
# This option effectively determines the server quorum necessary for the cmsd to redirect clients.
cms.delay servers 1
# Enabled enhanced cmsd stats reporting for xrd.report
cms.repstats all
cms.trace all

Regards,
Jyothish

-----Original Message-----
From: [log in to unmask] <[log in to unmask]> On Behalf Of Doidge, Matt
Sent: Thursday, February 8, 2024 2:02 PM
To: [log in to unmask]
Subject: "cms.dfs lookup central" not working as intended

Hi all,

On our XRootD in front of CEPHFS storage[1] we've tried to set it so that the redirector does look ups/"existence checks" itself rather then redirect such lightweight queries.

The redirector has the cephfs volume mounted, and has this directive
set:
cms.dfs lookup central redirect verify retries 2

But every test I try using gfal-ls, xrdfs ls, or something like a curl -I, it appears that the operation gets redirected to one of the xroot servers rather then being performed by the redirector.

Is there something else I need to set so the redirector can answer these queries? My only thought so far is that the redirectors only role is "manager": all.role manager

Does it need another role to be able to do more then redirect? Or am I grabbing at virtual straws?

It of course could be that the client tools are going beyond (or appear to be) what a simple lookup should be and thus the request warrants redirection. But that could be more straw clutching.

Any help or advice would be appreciated.

Thanks in advance all,
Matt


[1] xgate.hec.lancs.ac.uk:1094/cephfs/grid/dteam

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1