Print

Print


Hello all,
I've was tinkering after adding crc32c support to one of our xrootd servers and saw an odd behaviour with gfal-sum over https when trying to return a crc32c checksum - it's returning an encoded version of the checksum. gfal-sum over root works as expected. xrdcrc32c performed on the file locally returns the expected result.

gfal-sum root://stor015.hec.lancs.ac.uk:1095/cephfs/grid/dteam/crc32chttpstest5.txt crc32c 
root://stor015.hec.lancs.ac.uk:1095/cephfs/grid/dteam/crc32chttpstest5.txt d98fa965

$gfal-sum https://stor015.hec.lancs.ac.uk:1095/cephfs/grid/dteam/crc32chttpstest5.txt crc32c
https://stor015.hec.lancs.ac.uk:1095/cephfs/grid/dteam/crc32chttpstest5.txt 2Y+pZQ==

$ echo "2Y+pZQ==" | base64 -d | xxd -ps
d98fa965

I tried to deduce if this is a problem within gfal tools, and looking into the verbose output (-vvv) I think the "2Y+pZQ==" is what is being returned by the server, from a snippet below:

DEBUG    Davix: Request sent; retry is 0.
INFO     Davix: < HTTP/1.1 200 OK
INFO     Davix: < Connection: Keep-Alive
INFO     Davix: < Server: XrootD/v5.5.2
INFO     Davix: < Content-Length: 996
INFO     Davix: < Digest: crc32c=2Y+pZQ==
INFO     Davix: < 
DEBUG    Davix: End of headers.

The file exists on disk with the extended attribute below:
user.XrdCks.crc32c=0sY3JjMzJjAAAAAAAAAAAAAAAAAABkCJzmAAAAAAAAAATZj6llAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA

(which again if you binary decode you can see the checksum in there).

Note with adler32 we do not see anything out of the ordinary, checksums are returned as expected with https:// or root:// Our filesystem xroot is writing to is cephfs, the operating system is Rocky8, and xroot version 5.5.3. The line used to configure our checksums is just:

xrootd.chksum max 32 adler32 crc32c

I am wondering if this is an xroot bug (then I'll open an issue), a likely bug in our setup (then I'd appreciate a pointer to it!) or a problem with gfal (where I'll throw them a ticket).

Thanks in advance all,
Matt
########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1