Print

Print


Hello,

On 4/13/22 03:32, CURRIE Robert wrote:
> Hi,
> 
> I had understood that the point of the XrdPfcCommand was to allow for a certain
> file to be removed from the cache with a call to the service for testing.
> https://github.com/xrootd/xrootd/blob/6b0209fd262f9f571e93daef17df1724dac8eed5/src/XrdPfc/XrdPfcCommand.cc#L268
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_xrootd_xrootd_blob_6b0209fd262f9f571e93daef17df1724dac8eed5_src_XrdPfc_XrdPfcCommand.cc-23L268&d=DwMFAw&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=Q0Ppdm3qaiATZfNFVTPse_xNXAM1peod0ghaZwVHGVdPZCCjsc-6Tz9DNE5r3BBX&s=3Rw0ESc-NhqZ6eBu1VbW8pPgR7XdSEl-pvSjxqKKwSI&e=>
> 
> I don't know if this is this still supported as I haven't tested it (yet). I've
> just removed the files from disk and haven't had the server react badly from me
> doing so, it just looks for the file, finds it missing and re-acquires it.

Yes, this all works ... I use create_file for purge development as it gives you
a way to quickly populate the cache (it creates file of the requested size with
random data, whatever is in the blocks, without actually writing anything other
than allocating the blocks). I used delete to remove redundant replicas of files
in a caching cluster. Best way to use those two is through python scripts, but
for a single delete xrdcp will work as well (if you configure the access
correctly, please do not leave these exported to any user).

> @Fabio Andrijauskas <mailto:[log in to unmask]> I've been looking into
> modifying/expanding the Pfc recently at Edinburgh.
> (nothing other than ugly local hacks on a test instance for now).
> I think we're mainly interested from a cache performance improvement angle, and
> possibly building a set of cache/purge decision libraries which we can
> configure, but I've also been looking at the monitoring data with some interest
> to compare it to our .cinfo file monitor.

I have a couple of purge improvements planned as well. In particular, to support
per directory quotas and to minimize/reduce the number of times the file system
gets scanned.

Best,
Matevz

> 
> Best Regards,
> 
> Rob
> 
> --------------------------------------------------------------------------------
> *From:* [log in to unmask] <[log in to unmask]> on behalf of
> Andrew Hanushevsky <[log in to unmask]>
> *Sent:* 13 April 2022 01:08
> *To:* Fabio Andrijauskas <[log in to unmask]>
> *Cc:* [log in to unmask] <[log in to unmask]>
> *Subject:* Re: Delete a file from rooted cache
>  
> This email was sent to you by someone outside the University.
> You should only click on links or attachments if you are certain that the email
> is genuine and the content is safe.
> 
> Hi Fabio,
> 
> There is no way to flush (effectively delete) a file from the cache. We
> have talked about providing such a feature but didn't have a use case for
> it. Anyway, I assume you are logging into the Xcache server and physically
> removing the files. As long as you do that when no one is using the file a
> subsequent xrdcp should not hang. So, I suspect the timing was a bit off
> or I don't understand the actual steps you were taking.
> 
> Andy
> 
> 
> On Tue, 12 Apr 2022, Fabio Andrijauskas wrote:
> 
>> Hi Folks,
>>
>>  I am improving the Xrootd cache monitoring on OSG, and I would like to
>> check if the cache can provide a cached file and if the cache can fetch a
>> file from the origin. To check the origin cache process, I want to delete a
>> specific file on the cache and request this file on the client, in that way
>> forcing the cache to fetch the origin file.
>>
>>  I am deleting 4 files, two links, and two files related to this
>> cached file. However, when I do that, the xrdcopy process hangs and
>> timeout. So, I need to restart the cache to back to the regular operation.
>>
>>  What is the right way to force the cache to fetch a file on the origin?
>>
>>
>>
>> *--Fábio Andrijauskas*
>>
>> ########################################################################
>> Use REPLY-ALL to reply to list
>>
>> To unsubscribe from the XROOTD-L list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DXROOTD-2DL-26A-3D1&d=DwMFAw&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=Q0Ppdm3qaiATZfNFVTPse_xNXAM1peod0ghaZwVHGVdPZCCjsc-6Tz9DNE5r3BBX&s=JePPsv0o5YTLWUqXoTZ8VpHvRrxuV7sXgKd_z9mrtIc&e=>
>>
> 
> ########################################################################
> Use REPLY-ALL to reply to list
> 
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DXROOTD-2DL-26A-3D1&d=DwMFAw&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=Q0Ppdm3qaiATZfNFVTPse_xNXAM1peod0ghaZwVHGVdPZCCjsc-6Tz9DNE5r3BBX&s=JePPsv0o5YTLWUqXoTZ8VpHvRrxuV7sXgKd_z9mrtIc&e=>
> The University of Edinburgh is a charitable body, registered in Scotland, with
> registration number SC005336. Is e buidheann carthannais a th’ ann an Oilthigh
> Dhùn Èideann, clàraichte an Alba, àireamh clàraidh SC005336.
> --------------------------------------------------------------------------------
> 
> Use REPLY-ALL to reply to list
> 
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DXROOTD-2DL-26A-3D1&d=DwMFAw&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=Q0Ppdm3qaiATZfNFVTPse_xNXAM1peod0ghaZwVHGVdPZCCjsc-6Tz9DNE5r3BBX&s=JePPsv0o5YTLWUqXoTZ8VpHvRrxuV7sXgKd_z9mrtIc&e=>
> 
> 

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1