LISTSERV 16.5 - XROOTD-DEV Archives

I suspect that the other protocols are synchrnous and wait until the DPM
database is updated. XRootD is asynchrnous so issuing a stat right after
an upload likely does not give enough time for the DPM database to be
updated. I will check with Fabrizio on how to address this.

On Mon, 25 Feb 2019, javor wrote:

> Hello,
>
> when we do physical check after uploading a file using xrdfs stat, it gives use different results with respect to other protocols for first few seconds. The result of other protocols is turstable, so the xrootd claims False, although the file is physically present at the storage. This behaviour was observed at DPM architecture for now. But I suspect it happens also on other architectures.
>
> Kind regards, Rucio team.
>
>
> 2019-02-25 14:36:34,001 INFO Successfully uploaded file test.uploadapi.3278def9-07aa-4bcc-a047-493677425533
> root://fal-pygrid-30.lancs.ac.uk:1094//dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533
> 2019-02-25 14:36:34,100 INFO Exists: False
> srm://fal-pygrid-30.lancs.ac.uk:8446/srm/managerv2?SFN=/dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533
> 2019-02-25 14:36:34,453 INFO Exists: True
> root://fal-pygrid-30.lancs.ac.uk:1094//dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533
> 2019-02-25 14:36:35,490 INFO Exists: False
> srm://fal-pygrid-30.lancs.ac.uk:8446/srm/managerv2?SFN=/dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533
> 2019-02-25 14:36:35,846 INFO Exists: True
> ....
> root://fal-pygrid-30.lancs.ac.uk:1094//dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533
> 2019-02-25 14:36:43,834 INFO Exists: True
>
>
>
> --
> You are receiving this because you are subscribed to this thread.
> Reply to this email directly or view it on GitHub:
> https://github.com/xrootd/xrootd/issues/912

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/xrootd/xrootd","title":"xrootd/xrootd","subtitle":"GitHub repository","main_image_url":"https://github.githubassets.com/images/email/message_cards/header.png","avatar_image_url":"https://github.githubassets.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/xrootd/xrootd"}},"updates":{"snippets":[{"icon":"PERSON","message":"@abh3 in #912: I suspect that the other protocols are synchrnous and wait until the DPM \ndatabase is updated. XRootD is asynchrnous so issuing a stat right after \nan upload likely does not give enough time for the DPM database to be \nupdated. I will check with Fabrizio on how to address this.\n\nOn Mon, 25 Feb 2019, javor wrote:\n\n\u003e Hello,\n\u003e\n\u003e when we do physical check after uploading a file using xrdfs stat, it gives use different results with respect to other protocols for first few seconds. The result of other protocols is turstable, so the xrootd claims False, although the file is physically present at the storage. This behaviour was observed at DPM architecture for now. But I suspect it happens also on other architectures.\n\u003e\n\u003e Kind regards, Rucio team.\n\u003e\n\u003e\n\u003e 2019-02-25 14:36:34,001 INFO Successfully uploaded file test.uploadapi.3278def9-07aa-4bcc-a047-493677425533\n\u003e root://fal-pygrid-30.lancs.ac.uk:1094//dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533\n\u003e 2019-02-25 14:36:34,100 INFO Exists: False\n\u003e srm://fal-pygrid-30.lancs.ac.uk:8446/srm/managerv2?SFN=/dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533\n\u003e 2019-02-25 14:36:34,453 INFO Exists: True\n\u003e root://fal-pygrid-30.lancs.ac.uk:1094//dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533\n\u003e 2019-02-25 14:36:35,490 INFO Exists: False\n\u003e srm://fal-pygrid-30.lancs.ac.uk:8446/srm/managerv2?SFN=/dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533\n\u003e 2019-02-25 14:36:35,846 INFO Exists: True\n\u003e ....\n\u003e root://fal-pygrid-30.lancs.ac.uk:1094//dpm/lancs.ac.uk/home/atlas/atlasscratchdisk/rucio/user/twegner/b6/96/test.uploadapi.3278def9-07aa-4bcc-a047-493677425533\n\u003e 2019-02-25 14:36:43,834 INFO Exists: True\n\u003e\n\u003e\n\u003e\n\u003e -- \n\u003e You are receiving this because you are subscribed to this thread.\n\u003e Reply to this email directly or view it on GitHub:\n\u003e https://github.com/xrootd/xrootd/issues/912\n"}],"action":{"name":"View Issue","url":"https://github.com/xrootd/xrootd/issues/912#issuecomment-467169017"}}} [ { "@context": "http://schema.org", "@type": "EmailMessage", "potentialAction": { "@type": "ViewAction", "target": "https://github.com/xrootd/xrootd/issues/912#issuecomment-467169017", "url": "https://github.com/xrootd/xrootd/issues/912#issuecomment-467169017", "name": "View Issue" }, "description": "View this Issue on GitHub", "publisher": { "@type": "Organization", "name": "GitHub", "url": "https://github.com" } } ]

Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1