 |
 |
Hi @rajanandakumar -
"Operation expired" simply means a timeout occurred before the xrootd server returned a response for a given operation (in this case, a vector read). In other words, the server didn't respond fast enough -- which can happen randomly, of course, as you may not know how busy the remote server is.
Unfortunately, this is possibly a side-effect of how RAL deploys its storage. IIRC (and do check up with them, my memory may be dated) the backend storage requires a minimum of X MB to be read (perhaps X=32?) for XRootD to service a read. So, vector read requests with many small reads may require up to the full file to be read out in one operation.
That is, if your read of 1024 chunks noted above is perfectly scattered throughout the file, then the backend may need to read out up to 5GB within the operation timeout to service the 1.7MB request.
RAL has historically addressed this through a caching layer - but that can be finicky to tune as large files can effectively permanently thrash the cache.
It's not clear that this is something that the XRootD team can solve. It might make sense to strike up a conversation with RAL - I know they've been studying this closely and may have some updates that invalidates my recollections above.
Brian
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1