Hi,
I need to move large numbers of files between dataservers. In one case this is
because I want to retire an existing host and, in another case, I need to free
up space on data servers so that overall usage among the dataservers is more
balanced.
I can do this with existing scripts that I have used in the past, but there are
places I would like to improve things.
The general operation is to:
1) create a list of files to be moved and a list of dataservers that will accept
the copies.
2) Determine the space name associated with each file, so that the destination
maintains the space name.
3) In multiple threads copy the file with space information, verify the local
and remote checksums, delete the local file. I normally kick off one process
per destination host.
I utilize a mapping function that looks at the path of a local file to determine
what space name it should belong to. I am wondering if I can ask the dataserver
holding the file, what the space name is. Is this possible, or if I can make an
xrdcp replicate the opaque information.
Another place I would like to improve things is to maintain the timestamps
associated with the original file, so that the modtime of the copied file
matches the modtime of the original file. Is there there a way of doing the
equivalent to:
touch -mt <STAMP> path
on a file stored in xrootd?
Should I be using FRM to manage all of this?
Regards,
Patrick
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
|