Hi all,
We're currently seeing similar TLS issues in osg-test with xrdcp. It's
why we haven't released 5.6.x in the OSG repos yet:
https://opensciencegrid.atlassian.net/browse/SOFTWARE-5623?focusedCommentId=380033.
I'm also CC'ing Lincoln who is seeing this issue out in the wild with a
5.6.1 client against a 5.5.5 server (see attached). For comparison, I've
also attached a successful copy for a 5.5.5 client vs 5.5.5 server for
the same file.
Bockjoo: would you be able to try downgrading to a 5.5 client and seeing
if that resolves your issue?
Thanks,
Brian
On 8/28/23 08:42, Bockjoo Kim wrote:
> Hi Guilherme,
>
> The client machine (xrootd 5.6.1) that I had the issue is a fully
> credible OSG CE.
>
> So, there should be no issue with the CA and X509_CERT_DIR.
>
> I have used this python script to reproduce the issue on the client
> machine:
>
> #############################################
>
> import os
> import sys
> import errno
> import subprocess
> import zlib
> import random
> from XRootD import client
> from XRootD.client.flags import OpenFlags
>
> ENDPOINT='cmsio2.rc.ufl.edu:1094'
> SAM_TEST_FILE='/store/mc/SAM/GenericTTbar/AODSIM/CMSSW_9_2_6_91X_mcRun1_realistic_v2-v1/00000/A64CCCF2-5C76-E711-B359-0CC47A78A3F8.root'
>
>
> print ("XRootD Client Versin",client.__version__)
> cmd = [ "xrdfs "+ENDPOINT+" query config version" ]
> try:
> result = subprocess.run(cmd, shell=True, capture_output=True,
> text=True)
> print("XRootD Server Version", result.stdout)
> except subprocess.TimeoutExpired:
> print("connecting to endpoint timed out")
>
>
> os.environ["X509_CERT_DIR"] =
> "/cvmfs/cms.cern.ch/grid/etc/grid-security/certificates"
> os.environ["X509_USER_PROXY"] = "/home/bockjoo/.cmsuser.proxy"
> os.environ["X509_USER_PROXY_NONCMS"] = "/home/bockjoo/.griduser.proxy"
> os.environ["XRD_NETWORKSTACK"] = "IPv4"
> with client.File() as f:
> status, response = f.open("root://" + ENDPOINT + "/" + \
> SAM_TEST_FILE, flags=OpenFlags.READ, timeout=90)
> if ( not status.ok ):
> print (("\nopen(root://%s/%s, flags=OpenFlags.READ,
> time" + \
> "out=90)\nXRootDStatus.code=%d \"%s\"\n") % \
> (ENDPOINT, SAM_TEST_FILE, status.code, \
> status.message.replace("\n", "")))
> pass
> status, data = f.read(offset=0, size=65536, timeout=90)
> if ( not status.ok ):
> print(("\n%s\nread(offset=0, size=65536,
> timeout=90)\n" + \
> "XRootDStatus.code=%d \"%s\"\n") %
> (SAM_TEST_FILE, \
> status.code, status.message.replace("\n", "")))
> pass
> print ("Open Status",status.ok)
>
> #############################################
>
> You can choose the endpoint and the file of your choosing with the
> 5.5.5 server
>
> to test it.
>
> Thanks,
>
> Bockjoo
>
> On 8/28/23 09:33, Guilherme Amadio wrote:
>> Dear Bockjoo,
>>
>> On Sat, Aug 26, 2023 at 04:14:28PM -0400, Bockjoo Kim wrote:
>>> Hi,
>>>
>>> I am seeing a python XRootD file open issue for the 5.6.1 client with a
>>> 5.5.5 server :
>>>
>>> =============================================================
>>>
>>> XRootD Client Versin 5.6.1
>>> XRootD Server Version v5.5.5
>>>
>>> open(root://cmsio2.rc.ufl.edu:1094//store/mc/SAM/GenericTTbar/AODSIM/CMSSW_9_2_6_91X_mcRun1_realistic_v2-v1/00000/A64CCCF2-5C76-E711-B359-0CC47A78A3F8.root,
>>>
>>> flags=OpenFlags.READ, timeout=90)
>>> XRootDStatus.code=110 "[FATAL] TLS error: resource temporarily
>>> unavailable: Unable to connect to cmsio2.rc.ufl.edu; error_ssl"
>>>
>>> ---------------------------------------------------------------------------
>>>
>>> ValueError Traceback (most recent
>>> call last)
>>> /tmp/ipykernel_4179061/812350213.py in <module>
>>> 40 status.message.replace("\n", "")))
>>> 41 #pass
>>> ---> 42 status, data = f.read(offset=0, size=65536,
>>> timeout=90)
>>> 43 if ( not status.ok ):
>>> 44 print(("\n%s\nread(offset=0, size=65536,
>>> timeout=90)\n" + \
>>>
>>> /opt/cms/services/anaconda3/lib/python3.9/site-packages/XRootD/client/file.py
>>>
>>> in read(self, offset, size, timeout, callback)
>>> 124 return XRootDStatus(self.__file.read(offset, size,
>>> timeout, callback))
>>> 125
>>> --> 126 status, response = self.__file.read(offset, size, timeout)
>>> 127 return XRootDStatus(status), response
>>> 128
>>>
>>> ValueError: I/O operation on closed file
>>>
>>> ===============================================================
>>>
>>> Here, XRootD Server is configured with TLS.
>>>
>>> If I remove TLS configuration of the 5.5.5 server, there is no issue.
>>>
>>> If I switch to 5.5.5 client, there is no issue.
>>>
>>> Is this expected?
>> It may or may not be. When I wrote the patch, I tested several scenarios
>> (see
>> https://github.com/xrootd/xrootd/pull/2031#issuecomment-1589380486).
>> The error message that you see is likely caused by a client that cannot
>> validate the server with TLS (because it does not have the proper CA
>> certificates installed locally). So I suggest you to try with xrdcp
>> --notlsok option, or export X509_CERT_DIR=/dev/null to force the client
>> into not being able to do TLS at all. If the directory
>> /etc/grid-security
>> exists on your machine, but the client cannot verify the server, and TLS
>> is enforced, then this behavior is expected. Otherwise, please export
>> XRD_LOGLEVEL=Dump, re-run the command and send us the output so I can
>> investigate this issue further. You may also want to install the proper
>> certificates to let the client validate the server to be able to use
>> TLS.
>>
>> Best regards,
>> -Guilherme
>
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
[10:57] uct2-int.mwt2.org:~ $ lsetup "xrootd 5.6.1-x86_64-centos7"
Requested: xrootd ...
Setting up xrootd 5.6.1-x86_64-centos7 ...
Information for user <<<<<<<<<<<<<<<<<<<<<<<<<
[10:58] uct2-int.mwt2.org:~ $ xrdcp -f root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc .
[0B/0B][100%][==================================================][0B/s]
Run: [FATAL] TLS error: resource temporarily unavailable: (source)
[10:58] uct2-int.mwt2.org:~ $ xrdcp -f -d 3 root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc .
[2023-08-29 10:58:51.056025 -0500][Dump ][App ] Chunk size: 8388608, parallel chunks 4, streams: 1
[2023-08-29 10:58:51.056243 -0500][Dump ][App ] Processing source entry: root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc, type xroot, target file: file:///home/lincolnb/.
[2023-08-29 10:58:51.056544 -0500][Dump ][Utility ] Adding job with properties: 'checkSumMode' = 'none', 'checkSumPreset' = '', 'checkSumType' = '', 'chunkSize' = '8388608', 'coerce' = '0', 'continue' = '0', 'cpTimeout' = '0', 'delegate' = '0', 'doServer' = '0', 'dynamicSource' = '0', 'force' = '1', 'initTimeout' = '600', 'makeDir' = '0', 'parallelChunks' = '4', 'posc' = '0', 'preserveXAttr' = '0', 'rmOnBadCksum' = '0', 'source' = 'root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc', 'target' = 'file:///home/lincolnb/.', 'targetIsDir' = '1', 'thirdParty' = 'none', 'tpcTimeout' = '1800', 'xcp' = '0', 'xcpBlockSize' = '134217728', 'xrate' = '0', 'xrateThreshold' = '0', 'zipAppend' = '0', 'zipArchive' = '0'
[2023-08-29 10:58:51.056645 -0500][Debug ][Utility ] CopyProcess: 2 jobs to prepare
[2023-08-29 10:58:51.056730 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.056730 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.056730 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.056730 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.056730 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.056730 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.056730 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.056913 -0500][Dump ][Utility ] URL: file:///home/lincolnb/.
[2023-08-29 10:58:51.056913 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:58:51.056913 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.056913 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.056913 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:58:51.056913 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.056913 -0500][Dump ][Utility ] Path: /home/lincolnb/.
[2023-08-29 10:58:51.057131 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.057131 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.057131 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.057131 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.057131 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.057131 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.057131 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.057288 -0500][Dump ][Utility ] URL: file://localhost/home/lincolnb/./hello-nersc
[2023-08-29 10:58:51.057288 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:58:51.057288 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.057288 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.057288 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:58:51.057288 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.057288 -0500][Dump ][Utility ] Path: /home/lincolnb/./hello-nersc
[2023-08-29 10:58:51.057419 -0500][Debug ][Utility ] Creating a classic copy job, from root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc to file://localhost/home/lincolnb/./hello-nersc
[2023-08-29 10:58:51.057499 -0500][Debug ][Utility ] Monitor library name not set. No monitoring
[2023-08-29 10:58:51.057762 -0500][Debug ][Utility ] Opening root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc for reading
[2023-08-29 10:58:51.057855 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.057855 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.057855 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.057855 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.057855 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.057855 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.057855 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.058022 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.058022 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.058022 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.058022 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.058022 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.058022 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.058022 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.058188 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.058188 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.058188 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.058188 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.058188 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.058188 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.058188 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.058459 -0500][Debug ][File ] [0x1885fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=a043545b-0717-4b0e-950f-f9024a619859] Sending an open command
[2023-08-29 10:58:51.058605 -0500][Debug ][Utility ] Env: trying to get a non-existent string entry: pollerpreference
[2023-08-29 10:58:51.058658 -0500][Debug ][Poller ] Available pollers: built-in
[2023-08-29 10:58:51.058699 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in
[2023-08-29 10:58:51.058739 -0500][Debug ][Poller ] Creating poller: built-in
[2023-08-29 10:58:51.058789 -0500][Debug ][Poller ] Creating and starting the built-in poller...
[2023-08-29 10:58:51.059761 -0500][Debug ][Poller ] Using 10 poller threads
[2023-08-29 10:58:51.059816 -0500][Debug ][TaskMgr ] Starting the task manager...
[2023-08-29 10:58:51.059909 -0500][Debug ][TaskMgr ] Task manager started
[2023-08-29 10:58:51.059959 -0500][Debug ][JobMgr ] Starting the job manager...
[2023-08-29 10:58:51.060123 -0500][Debug ][JobMgr ] Job manager started, 3 workers
[2023-08-29 10:58:51.060178 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2023-08-29 10:58:51 -0500]
[2023-08-29 10:58:51.060224 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Sending message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )
[2023-08-29 10:58:51.060335 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] MsgHandler created: 0x189a2b0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ).
[2023-08-29 10:58:51.060452 -0500][Dump ][Utility ] URL: dtn114.nersc.gov:1094
[2023-08-29 10:58:51.060452 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.060452 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.060452 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.060452 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.060452 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.060452 -0500][Dump ][Utility ] Path:
[2023-08-29 10:58:51.060638 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094/
[2023-08-29 10:58:51.060638 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.060638 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.060638 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.060638 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.060638 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.060638 -0500][Dump ][Utility ] Path:
[2023-08-29 10:58:51.060799 -0500][Debug ][PostMaster ] Creating new channel to: root://dtn114.nersc.gov:1094/
[2023-08-29 10:58:51.062668 -0500][Debug ][PostMaster ] [dtn114.nersc.gov:1094] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800
[2023-08-29 10:58:51.062768 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: root://dtn114.nersc.gov:1094/" to be run at: [2023-08-29 10:59:06 -0500]
[2023-08-29 10:58:51.062839 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Sending message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x18850b0) through substream 0 expecting answer at 0
[2023-08-29 10:58:51.068706 -0500][Debug ][PostMaster ] [dtn114.nersc.gov:1094] Found 1 address(es): [::ffff:128.55.205.114]:1094
[2023-08-29 10:58:51.068876 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Attempting connection to [::ffff:128.55.205.114]:1094
[2023-08-29 10:58:51.068976 -0500][Debug ][Poller ] Adding socket 0x189af90 to the poller
[2023-08-29 10:58:51.114107 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Async connection call returned
[2023-08-29 10:58:51.114234 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Sending out the initial hand shake + kXR_protocol
[2023-08-29 10:58:51.114341 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Wrote a message: (0xe8000950), 44 bytes
[2023-08-29 10:58:51.159458 -0500][Dump ][XRootDTransport ] [msg: 0xe8000ab0] Expecting 8 bytes of message body
[2023-08-29 10:58:51.159624 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header, size: 8
[2023-08-29 10:58:51.159699 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received a message of 16 bytes
[2023-08-29 10:58:51.159798 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Got the server hand shake response (type: server [], protocol version 511)
[2023-08-29 10:58:51.159902 -0500][Dump ][XRootDTransport ] [msg: 0xe8000ab0] Expecting 8 bytes of message body
[2023-08-29 10:58:51.159956 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header, size: 8
[2023-08-29 10:58:51.160034 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received a message of 16 bytes
[2023-08-29 10:58:51.160096 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] kXR_protocol successful (type: server [], protocol version 511)
[2023-08-29 10:58:51.161620 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Sending out kXR_login request, username: lincolnb, cgi: xrd.cc=us&xrd.tz=-6&xrd.appname=xrdcp&xrd.info=&xrd.hostname=uct2-int.mwt2.org&xrd.rn=v5.6.1, dual-stack: true, private IPv4: false, private IPv6: false
[2023-08-29 10:58:51.161697 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] TLS hand-shake exchange.
[2023-08-29 10:58:51.212618 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] TLS hand-shake exchange.
[2023-08-29 10:58:51.212743 -0500][Error ][TlsMsg ] [] TLS error rc=-1 ec=1 (error_ssl) errno=0.
[2023-08-29 10:58:51.212849 -0500][Debug ][TlsMsg ] [] 139912652908288:error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol:s23_clnt.c:794:
[2023-08-29 10:58:51.212897 -0500][Error ][TlsMsg ] Failed to do TLS connect: Unable to connect to dtn114.nersc.gov; error_ssl
[2023-08-29 10:58:51.212949 -0500][Error ][AsyncSock ] [dtn114.nersc.gov:1094.0] Socket error while handshaking: [FATAL] TLS error: resource temporarily unavailable
[2023-08-29 10:58:51.212990 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Closing the socket
[2023-08-29 10:58:51.213026 -0500][Debug ][Poller ] <[::ffff:192.170.240.10]:51110><--><[::ffff:128.55.205.114]:1094> Removing socket from the poller
[2023-08-29 10:58:51.213151 -0500][Error ][PostMaster ] [dtn114.nersc.gov:1094] elapsed = 0, pConnectionWindow = 120 seconds.
[2023-08-29 10:58:51.213217 -0500][Error ][PostMaster ] [dtn114.nersc.gov:1094] Unable to recover: [FATAL] TLS error: resource temporarily unavailable.
[2023-08-29 10:58:51.213279 -0500][Error ][XRootD ] [dtn114.nersc.gov:1094] Impossible to send message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover.
[2023-08-29 10:58:51.213324 -0500][Debug ][XRootD ] [dtn114.nersc.gov:1094] Handling error while processing kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ): [FATAL] TLS error: resource temporarily unavailable.
[2023-08-29 10:58:51.213370 -0500][Info ][XRootD ] [dtn114.nersc.gov:1094] Retrying request: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ).
[2023-08-29 10:58:51.213458 -0500][Dump ][Utility ] URL: fake://fake:111//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.213458 -0500][Dump ][Utility ] Protocol: fake
[2023-08-29 10:58:51.213458 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.213458 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.213458 -0500][Dump ][Utility ] Host Name: fake
[2023-08-29 10:58:51.213458 -0500][Dump ][Utility ] Port: 111
[2023-08-29 10:58:51.213458 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.213692 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.213692 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.213692 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.213692 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.213692 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.213692 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.213692 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.213844 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.213844 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.213844 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.213844 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.213844 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.213844 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.213844 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.213985 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Retry at server MsgHandler: 0x189a2b0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov&triedrc=srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ).
[2023-08-29 10:58:51.214040 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Sending message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov&triedrc=srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x18850b0) through substream 0 expecting answer at 0
[2023-08-29 10:58:51.214086 -0500][Debug ][XRootD ] [dtn114.nersc.gov:1094] Handling error while processing kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov&triedrc=srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ): [FATAL] TLS error: resource temporarily unavailable.
[2023-08-29 10:58:51.214135 -0500][Info ][XRootD ] [dtn114.nersc.gov:1094] Retrying request: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov&triedrc=srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ).
[2023-08-29 10:58:51.214216 -0500][Dump ][Utility ] URL: fake://fake:111//global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov&triedrc=srverr
[2023-08-29 10:58:51.214216 -0500][Dump ][Utility ] Protocol: fake
[2023-08-29 10:58:51.214216 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.214216 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.214216 -0500][Dump ][Utility ] Host Name: fake
[2023-08-29 10:58:51.214216 -0500][Dump ][Utility ] Port: 111
[2023-08-29 10:58:51.214216 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.214401 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.214401 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.214401 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.214401 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.214401 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.214401 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.214401 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.214569 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.214569 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.214569 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.214569 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.214569 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.214569 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.214569 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.214714 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Retry at server MsgHandler: 0x189a2b0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ).
[2023-08-29 10:58:51.214762 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Sending message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x18850b0) through substream 0 expecting answer at 0
[2023-08-29 10:58:51.214808 -0500][Debug ][XRootD ] [dtn114.nersc.gov:1094] Handling error while processing kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ): [FATAL] TLS error: resource temporarily unavailable.
[2023-08-29 10:58:51.214854 -0500][Info ][XRootD ] [dtn114.nersc.gov:1094] Retrying request: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ).
[2023-08-29 10:58:51.214926 -0500][Dump ][Utility ] URL: fake://fake:111//global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr
[2023-08-29 10:58:51.214926 -0500][Dump ][Utility ] Protocol: fake
[2023-08-29 10:58:51.214926 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.214926 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.214926 -0500][Dump ][Utility ] Host Name: fake
[2023-08-29 10:58:51.214926 -0500][Dump ][Utility ] Port: 111
[2023-08-29 10:58:51.214926 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.215104 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.215104 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.215104 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.215104 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.215104 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.215104 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.215104 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.215255 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.215255 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:58:51.215255 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:58:51.215255 -0500][Dump ][Utility ] Password:
[2023-08-29 10:58:51.215255 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:58:51.215255 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:58:51.215255 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.215396 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Retry at server MsgHandler: 0x189a2b0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ).
[2023-08-29 10:58:51.215439 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Sending message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x18850b0) through substream 0 expecting answer at 0
[2023-08-29 10:58:51.215479 -0500][Debug ][XRootD ] [dtn114.nersc.gov:1094] Handling error while processing kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ): [FATAL] TLS error: resource temporarily unavailable.
[2023-08-29 10:58:51.215527 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Passing to the thread-pool MsgHandler: 0x189a2b0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ).
[2023-08-29 10:58:51.215718 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Calling MsgHandler: 0x189a2b0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc?tried=dtn114.nersc.gov,dtn114.nersc.gov,dtn114.nersc.gov&triedrc=srverr,srverr,srverr, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ) with status: [FATAL] TLS error: resource temporarily unavailable.
[2023-08-29 10:58:51.215881 -0500][Debug ][File ] [0x1885fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=a043545b-0717-4b0e-950f-f9024a619859] Open has returned with status [FATAL] TLS error: resource temporarily unavailable
[2023-08-29 10:58:51.215951 -0500][Debug ][File ] [0x1885fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=a043545b-0717-4b0e-950f-f9024a619859] Error while opening at dtn114.nersc.gov:1094: [FATAL] TLS error: resource temporarily unavailable
[2023-08-29 10:58:51.216049 -0500][Debug ][XRootD ] Redirect trace-back:
[2023-08-29 10:58:51.216049 -0500][Debug ][XRootD ] Retrying: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.216049 -0500][Debug ][XRootD ] Retrying: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.216049 -0500][Debug ][XRootD ] Retrying: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:58:51.216172 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Destroying MsgHandler: 0x189a2b0.
[0B/0B][100%][==================================================][0B/s]
Run: [FATAL] TLS error: resource temporarily unavailable: (source)
[2023-08-29 10:58:51.217171 -0500][Debug ][JobMgr ] Stopping the job manager...
[2023-08-29 10:58:51.217213 -0500][Dump ][JobMgr ] Stopping worker #0...
[2023-08-29 10:58:51.217443 -0500][Dump ][JobMgr ] Worker #0 stopped
[2023-08-29 10:58:51.217475 -0500][Dump ][JobMgr ] Stopping worker #1...
[2023-08-29 10:58:51.217569 -0500][Dump ][JobMgr ] Worker #1 stopped
[2023-08-29 10:58:51.217596 -0500][Dump ][JobMgr ] Stopping worker #2...
[2023-08-29 10:58:51.217666 -0500][Dump ][JobMgr ] Worker #2 stopped
[2023-08-29 10:58:51.217692 -0500][Debug ][JobMgr ] Job manager stopped
[2023-08-29 10:58:51.217713 -0500][Debug ][TaskMgr ] Stopping the task manager...
[2023-08-29 10:58:51.218052 -0500][Debug ][TaskMgr ] Task manager stopped
[2023-08-29 10:58:51.218080 -0500][Debug ][Poller ] Stopping the poller...
[2023-08-29 10:58:51.219026 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Closing the socket
[2023-08-29 10:58:51.219062 -0500][Debug ][PostMaster ] [dtn114.nersc.gov:1094] Destroying stream
[2023-08-29 10:58:51.219087 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Closing the socket
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
[10:59] uct2-int.mwt2.org:~ $ lsetup "xrootd 5.5.5-x86_64-centos7"
Requested: xrootd ...
Setting up xrootd 5.5.5-x86_64-centos7 ...
Information for user <<<<<<<<<<<<<<<<<<<<<<<<<
[10:59] uct2-int.mwt2.org:~ $ xrdcp -f -d 3 root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc .
[2023-08-29 10:59:53.911690 -0500][Dump ][App ] Chunk size: 8388608, parallel chunks 4, streams: 1
[2023-08-29 10:59:53.911904 -0500][Dump ][App ] Processing source entry: root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc, type xroot, target file: file:///home/lincolnb/.
[2023-08-29 10:59:53.912180 -0500][Dump ][Utility ] Adding job with properties: 'checkSumMode' = 'none', 'checkSumPreset' = '', 'checkSumType' = '', 'chunkSize' = '8388608', 'coerce' = '0', 'continue' = '0', 'cpTimeout' = '0', 'delegate' = '0', 'doServer' = '0', 'dynamicSource' = '0', 'force' = '1', 'initTimeout' = '600', 'makeDir' = '0', 'parallelChunks' = '4', 'posc' = '0', 'preserveXAttr' = '0', 'rmOnBadCksum' = '0', 'source' = 'root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc', 'target' = 'file:///home/lincolnb/.', 'targetIsDir' = '1', 'thirdParty' = 'none', 'tpcTimeout' = '1800', 'xcp' = '0', 'xcpBlockSize' = '134217728', 'xrate' = '0', 'xrateThreshold' = '0', 'zipAppend' = '0', 'zipArchive' = '0'
[2023-08-29 10:59:53.912252 -0500][Debug ][Utility ] CopyProcess: 2 jobs to prepare
[2023-08-29 10:59:53.912305 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.912305 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:53.912305 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.912305 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.912305 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:53.912305 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.912305 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.912452 -0500][Dump ][Utility ] URL: file:///home/lincolnb/.
[2023-08-29 10:59:53.912452 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:59:53.912452 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.912452 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.912452 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:59:53.912452 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.912452 -0500][Dump ][Utility ] Path: /home/lincolnb/.
[2023-08-29 10:59:53.912616 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.912616 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:53.912616 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.912616 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.912616 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:53.912616 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.912616 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.912750 -0500][Dump ][Utility ] URL: file://localhost/home/lincolnb/./hello-nersc
[2023-08-29 10:59:53.912750 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:59:53.912750 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.912750 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.912750 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:59:53.912750 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.912750 -0500][Dump ][Utility ] Path: /home/lincolnb/./hello-nersc
[2023-08-29 10:59:53.912860 -0500][Debug ][Utility ] Creating a classic copy job, from root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc to file://localhost/home/lincolnb/./hello-nersc
[2023-08-29 10:59:53.912911 -0500][Debug ][Utility ] Monitor library name not set. No monitoring
[2023-08-29 10:59:53.913037 -0500][Debug ][Utility ] Opening root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc for reading
[2023-08-29 10:59:53.913098 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.913098 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:53.913098 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.913098 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.913098 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:53.913098 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.913098 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.913216 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.913216 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:53.913216 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.913216 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.913216 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:53.913216 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.913216 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.913331 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.913331 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:53.913331 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.913331 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.913331 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:53.913331 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.913331 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:53.913525 -0500][Debug ][File ] [0x11b5fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=3783e54a-302f-4ca0-99d2-5da04c19e94d] Sending an open command
[2023-08-29 10:59:53.913634 -0500][Debug ][Utility ] Env: trying to get a non-existent string entry: pollerpreference
[2023-08-29 10:59:53.913674 -0500][Debug ][Poller ] Available pollers: built-in
[2023-08-29 10:59:53.913705 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in
[2023-08-29 10:59:53.913732 -0500][Debug ][Poller ] Creating poller: built-in
[2023-08-29 10:59:53.913769 -0500][Debug ][Poller ] Creating and starting the built-in poller...
[2023-08-29 10:59:53.913999 -0500][Debug ][Poller ] Using 1 poller threads
[2023-08-29 10:59:53.914040 -0500][Debug ][TaskMgr ] Starting the task manager...
[2023-08-29 10:59:53.914112 -0500][Debug ][TaskMgr ] Task manager started
[2023-08-29 10:59:53.914143 -0500][Debug ][JobMgr ] Starting the job manager...
[2023-08-29 10:59:53.914275 -0500][Debug ][JobMgr ] Job manager started, 3 workers
[2023-08-29 10:59:53.914316 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2023-08-29 10:59:53 -0500]
[2023-08-29 10:59:53.914346 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Sending message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )
[2023-08-29 10:59:53.914416 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] MsgHandler created: 0x11badb0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ).
[2023-08-29 10:59:53.914500 -0500][Dump ][Utility ] URL: dtn114.nersc.gov:1094
[2023-08-29 10:59:53.914500 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:53.914500 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.914500 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.914500 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:53.914500 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.914500 -0500][Dump ][Utility ] Path:
[2023-08-29 10:59:53.914644 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094/
[2023-08-29 10:59:53.914644 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:53.914644 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:53.914644 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:53.914644 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:53.914644 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:53.914644 -0500][Dump ][Utility ] Path:
[2023-08-29 10:59:53.914758 -0500][Debug ][PostMaster ] Creating new channel to: root://dtn114.nersc.gov:1094/
[2023-08-29 10:59:53.916592 -0500][Debug ][PostMaster ] [dtn114.nersc.gov:1094] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800
[2023-08-29 10:59:53.916684 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: root://dtn114.nersc.gov:1094/" to be run at: [2023-08-29 11:00:08 -0500]
[2023-08-29 10:59:53.916736 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Sending message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x11b50b0) through substream 0 expecting answer at 0
[2023-08-29 10:59:53.931833 -0500][Debug ][PostMaster ] [dtn114.nersc.gov:1094] Found 1 address(es): [::ffff:128.55.205.114]:1094
[2023-08-29 10:59:53.931918 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Attempting connection to [::ffff:128.55.205.114]:1094
[2023-08-29 10:59:53.931997 -0500][Debug ][Poller ] Adding socket 0x11bb1d0 to the poller
[2023-08-29 10:59:53.977074 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Async connection call returned
[2023-08-29 10:59:53.977156 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Sending out the initial hand shake + kXR_protocol
[2023-08-29 10:59:53.977223 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Wrote a message: (0xa4000950), 44 bytes
[2023-08-29 10:59:54.022210 -0500][Dump ][XRootDTransport ] [msg: 0xa4000ab0] Expecting 8 bytes of message body
[2023-08-29 10:59:54.022245 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header, size: 8
[2023-08-29 10:59:54.022303 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received a message of 16 bytes
[2023-08-29 10:59:54.022334 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Got the server hand shake response (type: server [], protocol version 511)
[2023-08-29 10:59:54.022376 -0500][Dump ][XRootDTransport ] [msg: 0xa4000ab0] Expecting 8 bytes of message body
[2023-08-29 10:59:54.022397 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header, size: 8
[2023-08-29 10:59:54.022423 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received a message of 16 bytes
[2023-08-29 10:59:54.022451 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] kXR_protocol successful (type: server [], protocol version 511)
[2023-08-29 10:59:54.023891 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Sending out kXR_login request, username: lincolnb, cgi: xrd.cc=us&xrd.tz=-6&xrd.appname=xrdcp&xrd.info=&xrd.hostname=uct2-int.mwt2.org&xrd.rn=v5.5.5, dual-stack: true, private IPv4: false, private IPv6: false
[2023-08-29 10:59:54.023959 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] TLS hand-shake exchange.
[2023-08-29 10:59:54.075646 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] TLS hand-shake exchange.
[2023-08-29 10:59:54.125522 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] TLS hand-shake exchange.
[2023-08-29 10:59:54.125861 -0500][Info ][AsyncSock ] [dtn114.nersc.gov:1094.0] TLS hand-shake done.
[2023-08-29 10:59:54.125965 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Wrote a message: (0xa4000be0), 116 bytes
[2023-08-29 10:59:54.171021 -0500][Dump ][XRootDTransport ] [msg: 0xa403f1e0] Expecting 75 bytes of message body
[2023-08-29 10:59:54.171097 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header, size: 8
[2023-08-29 10:59:54.171214 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received a message of 83 bytes
[2023-08-29 10:59:54.171262 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Logged in, session: 060000002b731c00250000000b000000
[2023-08-29 10:59:54.171296 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Authentication is required: &P=ztn,0:4096:&P=gsi,v:10600,c:ssl,ca:1e49ade3.0|3cbc995f.0
[2023-08-29 10:59:54.171329 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Sending authentication data
[2023-08-29 10:59:54.173871 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Trying to authenticate using ztn
[2023-08-29 10:59:54.173983 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Cannot get credentials for protocol ztn: Secztn: No token found; runtime fetch disallowed.
[2023-08-29 10:59:54.176871 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Trying to authenticate using gsi
[2023-08-29 10:59:54.916522 -0500][Dump ][TaskMgr ] Running task: "FileTimer task"
[2023-08-29 10:59:54.916644 -0500][Dump ][TaskMgr ] Will rerun task "FileTimer task" at [2023-08-29 11:00:09 -0500]
[2023-08-29 10:59:55.844399 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Wrote a message: (0xa404bd10), 136 bytes
[2023-08-29 10:59:55.935585 -0500][Dump ][XRootDTransport ] [msg: 0xa40451b0] Expecting 5141 bytes of message body
[2023-08-29 10:59:55.935641 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header, size: 8
[2023-08-29 10:59:55.935700 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received a message of 5149 bytes
[2023-08-29 10:59:55.935725 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Sending more authentication data for gsi
[2023-08-29 10:59:56.040040 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Wrote a message: (0xa402c590), 11948 bytes
[2023-08-29 10:59:56.112410 -0500][Dump ][XRootDTransport ] [msg: 0xa4000be0] Expecting 0 bytes of message body
[2023-08-29 10:59:56.112486 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header, size: 8
[2023-08-29 10:59:56.112566 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received a message of 8 bytes
[2023-08-29 10:59:56.112700 -0500][Debug ][XRootDTransport ] [dtn114.nersc.gov:1094.0] Authenticated with gsi.
[2023-08-29 10:59:56.112770 -0500][Debug ][PostMaster ] [dtn114.nersc.gov:1094] Stream 0 connected (IPv4).
[2023-08-29 10:59:56.112864 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Wrote a message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x11b50b0), 59 bytes
[2023-08-29 10:59:56.112949 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Successfully sent message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x11b50b0).
[2023-08-29 10:59:56.113011 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Message kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) has been successfully sent.
[2023-08-29 10:59:56.113048 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Moving MsgHandler: 0x11badb0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ) from out-queu to in-queue.
[2023-08-29 10:59:56.113088 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094.0] All messages consumed, disable uplink
[2023-08-29 10:59:56.158096 -0500][Dump ][XRootDTransport ] [msg: 0xa40437d0] Expecting 89 bytes of message body
[2023-08-29 10:59:56.158139 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header for 0xa40437d0 size: 8
[2023-08-29 10:59:56.158190 -0500][Debug ][ExDbgMsg ] [msg: 0xa40437d0] Assigned MsgHandler: 0x11badb0.
[2023-08-29 10:59:56.158263 -0500][Debug ][ExDbgMsg ] [handler: 0x11badb0] Removed MsgHandler: 0x11badb0 from the in-queue.
[2023-08-29 10:59:56.158369 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message 0xa40437d0 of 97 bytes
[2023-08-29 10:59:56.158411 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Handling received message: 0xa40437d0.
[2023-08-29 10:59:56.158666 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Got a kXR_ok response to request kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )
[2023-08-29 10:59:56.158765 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Calling MsgHandler: 0x11badb0 (message: kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ) with status: [SUCCESS] .
[2023-08-29 10:59:56.158802 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Parsing the response to kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) as OpenInfo
[2023-08-29 10:59:56.158828 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Parsing StatInfo in response to kXR_open (file: /global/cfs/cdirs/m2616/hello-nersc, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )
[2023-08-29 10:59:56.158932 -0500][Debug ][File ] [0x11b5fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=3783e54a-302f-4ca0-99d2-5da04c19e94d] Open has returned with status [SUCCESS]
[2023-08-29 10:59:56.158968 -0500][Debug ][File ] [0x11b5fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=3783e54a-302f-4ca0-99d2-5da04c19e94d] successfully opened at dtn114.nersc.gov:1094, handle: 0x0, session id: 1
[2023-08-29 10:59:56.159047 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Destroying MsgHandler: 0x11badb0.
[2023-08-29 10:59:56.159190 -0500][Dump ][Utility ] URL: root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=3783e54a-302f-4ca0-99d2-5da04c19e94d
[2023-08-29 10:59:56.159190 -0500][Dump ][Utility ] Protocol: root
[2023-08-29 10:59:56.159190 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:56.159190 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:56.159190 -0500][Dump ][Utility ] Host Name: dtn114.nersc.gov
[2023-08-29 10:59:56.159190 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:56.159190 -0500][Dump ][Utility ] Path: /global/cfs/cdirs/m2616/hello-nersc
[2023-08-29 10:59:56.159449 -0500][Debug ][Utility ] Opening file://localhost/home/lincolnb/./hello-nersc?oss.asize=0 for writing
[2023-08-29 10:59:56.159525 -0500][Dump ][Utility ] URL: file://localhost/home/lincolnb/./hello-nersc?oss.asize=0
[2023-08-29 10:59:56.159525 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:59:56.159525 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:56.159525 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:56.159525 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:59:56.159525 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:56.159525 -0500][Dump ][Utility ] Path: /home/lincolnb/./hello-nersc
[2023-08-29 10:59:56.159686 -0500][Dump ][Utility ] URL: file://localhost/home/lincolnb/./hello-nersc?oss.asize=0
[2023-08-29 10:59:56.159686 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:59:56.159686 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:56.159686 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:56.159686 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:59:56.159686 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:56.159686 -0500][Dump ][Utility ] Path: /home/lincolnb/./hello-nersc
[2023-08-29 10:59:56.159821 -0500][Dump ][Utility ] URL: file://localhost/home/lincolnb/./hello-nersc?oss.asize=0
[2023-08-29 10:59:56.159821 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:59:56.159821 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:56.159821 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:56.159821 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:59:56.159821 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:56.159821 -0500][Dump ][Utility ] Path: /home/lincolnb/./hello-nersc
[2023-08-29 10:59:56.160022 -0500][Debug ][File ] [0x11baee0@file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199] Sending an open command
[2023-08-29 10:59:56.160130 -0500][Dump ][Utility ] URL: file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199
[2023-08-29 10:59:56.160130 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:59:56.160130 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:56.160130 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:56.160130 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:59:56.160130 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:56.160130 -0500][Dump ][Utility ] Path: /home/lincolnb/./hello-nersc
[2023-08-29 10:59:56.161129 -0500][Dump ][Utility ] URL: file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199
[2023-08-29 10:59:56.161129 -0500][Dump ][Utility ] Protocol: file
[2023-08-29 10:59:56.161129 -0500][Dump ][Utility ] User Name:
[2023-08-29 10:59:56.161129 -0500][Dump ][Utility ] Password:
[2023-08-29 10:59:56.161129 -0500][Dump ][Utility ] Host Name: localhost
[2023-08-29 10:59:56.161129 -0500][Dump ][Utility ] Port: 1094
[2023-08-29 10:59:56.161129 -0500][Dump ][Utility ] Path: /home/lincolnb/./hello-nersc
[2023-08-29 10:59:56.161487 -0500][Debug ][File ] [0x11baee0@file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199] Open has returned with status [SUCCESS]
[2023-08-29 10:59:56.161573 -0500][Debug ][File ] [0x11baee0@file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199] successfully opened at localhost, handle: 0xe, session id: 1
[2023-08-29 10:59:56.161685 -0500][Debug ][File ] [0x11baee0@file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199] Sending a close command for handle 0xe to localhost
[2023-08-29 10:59:56.162072 -0500][Debug ][File ] [0x11baee0@file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199] Close returned from localhost with: [SUCCESS]
[2023-08-29 10:59:56.162119 -0500][Dump ][File ] [0x11baee0@file://localhost/home/lincolnb/./hello-nersc?oss.asize=0&xrdcl.requuid=e8027c06-a922-40b0-b4cd-4fea2c7c1199] Items in the fly 0, queued for recovery 0
[2023-08-29 10:59:56.162212 -0500][Debug ][File ] [0x11b5fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=3783e54a-302f-4ca0-99d2-5da04c19e94d] Sending a close command for handle 0x0 to dtn114.nersc.gov:1094
[2023-08-29 10:59:56.162283 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Sending message kXR_close (handle: 0x00000000)
[2023-08-29 10:59:56.162328 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] MsgHandler created: 0x11badb0 (message: kXR_close (handle: 0x00000000) ).
[2023-08-29 10:59:56.162372 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Sending message kXR_close (handle: 0x00000000) (0x11b4b70) through substream 0 expecting answer at 0
[2023-08-29 10:59:56.162498 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Wrote a message: kXR_close (handle: 0x00000000) (0x11b4b70), 24 bytes
[2023-08-29 10:59:56.162566 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Successfully sent message: kXR_close (handle: 0x00000000) (0x11b4b70).
[2023-08-29 10:59:56.162590 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Message kXR_close (handle: 0x00000000) has been successfully sent.
[2023-08-29 10:59:56.162612 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Moving MsgHandler: 0x11badb0 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue.
[2023-08-29 10:59:56.162631 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094.0] All messages consumed, disable uplink
[2023-08-29 10:59:56.207612 -0500][Dump ][XRootDTransport ] [msg: 0xa4022ba0] Expecting 0 bytes of message body
[2023-08-29 10:59:56.207656 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message header for 0xa4022ba0 size: 8
[2023-08-29 10:59:56.207678 -0500][Debug ][ExDbgMsg ] [msg: 0xa4022ba0] Assigned MsgHandler: 0x11badb0.
[2023-08-29 10:59:56.207716 -0500][Debug ][ExDbgMsg ] [handler: 0x11badb0] Removed MsgHandler: 0x11badb0 from the in-queue.
[2023-08-29 10:59:56.207734 -0500][Dump ][AsyncSock ] [dtn114.nersc.gov:1094.0] Received message 0xa4022ba0 of 8 bytes
[2023-08-29 10:59:56.207751 -0500][Dump ][PostMaster ] [dtn114.nersc.gov:1094] Handling received message: 0xa4022ba0.
[2023-08-29 10:59:56.207863 -0500][Dump ][XRootD ] [dtn114.nersc.gov:1094] Got a kXR_ok response to request kXR_close (handle: 0x00000000)
[2023-08-29 10:59:56.207945 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Calling MsgHandler: 0x11badb0 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] .
[2023-08-29 10:59:56.207976 -0500][Debug ][File ] [0x11b5fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=3783e54a-302f-4ca0-99d2-5da04c19e94d] Close returned from dtn114.nersc.gov:1094 with: [SUCCESS]
[2023-08-29 10:59:56.208000 -0500][Dump ][File ] [0x11b5fd0@root://dtn114.nersc.gov:1094//global/cfs/cdirs/m2616/hello-nersc?xrdcl.requuid=3783e54a-302f-4ca0-99d2-5da04c19e94d] Items in the fly 0, queued for recovery 0
[2023-08-29 10:59:56.208033 -0500][Debug ][ExDbgMsg ] [dtn114.nersc.gov:1094] Destroying MsgHandler: 0x11badb0.
[0B/0B][100%][==================================================][0B/s]
[2023-08-29 10:59:56.209372 -0500][Debug ][JobMgr ] Stopping the job manager...
[2023-08-29 10:59:56.209445 -0500][Dump ][JobMgr ] Stopping worker #0...
[2023-08-29 10:59:56.209781 -0500][Dump ][JobMgr ] Worker #0 stopped
[2023-08-29 10:59:56.209831 -0500][Dump ][JobMgr ] Stopping worker #1...
[2023-08-29 10:59:56.209921 -0500][Dump ][JobMgr ] Worker #1 stopped
[2023-08-29 10:59:56.209966 -0500][Dump ][JobMgr ] Stopping worker #2...
[2023-08-29 10:59:56.210047 -0500][Dump ][JobMgr ] Worker #2 stopped
[2023-08-29 10:59:56.210089 -0500][Debug ][JobMgr ] Job manager stopped
[2023-08-29 10:59:56.210121 -0500][Debug ][TaskMgr ] Stopping the task manager...
[2023-08-29 10:59:56.210285 -0500][Debug ][TaskMgr ] Task manager stopped
[2023-08-29 10:59:56.210331 -0500][Debug ][Poller ] Stopping the poller...
[2023-08-29 10:59:56.210553 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Closing the socket
[2023-08-29 10:59:56.210606 -0500][Debug ][Poller ] <[::ffff:192.170.240.10]:51160><--><[::ffff:128.55.205.114]:1094> Removing socket from the poller
[2023-08-29 10:59:56.210881 -0500][Debug ][PostMaster ] [dtn114.nersc.gov:1094] Destroying stream
[2023-08-29 10:59:56.210931 -0500][Debug ][AsyncSock ] [dtn114.nersc.gov:1094.0] Closing the socket
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
|