Print

Print


Also, what is the result of:

]==> netstat -nt | grep 169.228.230.92

when the connections are 'in progress'?

Cheers,
    Lukasz

On 03.12.2013 11:45, Lukasz Janyst wrote:
> Or better, write a program that tries to connect to the host:port twice
> (on the socket level is enough).
>
>     Lukasz
>
> On 03.12.2013 11:41, Lukasz Janyst wrote:
>> By twice I mean having two connections active at the same time.
>>
>>     Lukasz
>>
>> On 03.12.2013 11:39, Lukasz Janyst wrote:
>>> Hi Andy,
>>>
>>>     no, b is not the problem. There was an issue like the one you
>>> mention, but it was introduced after migration to IPv6 in master only
>>> and fixed immediately after it was discovered. It was never introduced
>>> to the stable-3.3.x branch.
>>>
>>>     Matevz, what you see is really strange. It looks like the system
>>> won't let you connect to the host twice... A router issue perhaps? Can
>>> you telnet twice to this host:port from your test box?
>>>
>>> Cheers,
>>>     Lukasz
>>>
>>> On 03.12.2013 07:34, Andrew Hanushevsky wrote:
>>>> Hi Matevz,
>>>>
>>>> On Mon, 2 Dec 2013, Matevz Tadel wrote:
>>>>
>>>>>> Why don't you just setup an overlay xrootd and try it with that one.
>>>>>> You can
>>>>>> then trace it, or at least run with '-d'.
>>>>>
>>>>> Sorry, I'm drawing a blank card from my head on this one :) What
>>>>> overlay xrootd? For the server side?
>>>> Ah, now I understand the issue. Redirector works fine so you don't even
>>>> need to use it. So, you should have drawn a blank card :-)
>>>>
>>>> Now, that said, in the logs you provided I never see a single
>>>> successful
>>>> connection. You may want to set client debugging at the dump level.
>>>>
>>>> Anyway, as you know, the client first does a locate for that file and
>>>> the connect to each of the end-points to produce a composite dirlist.
>>>> While hat does not appear in the trace output it does seem to have
>>>> occurred. But the connect to the locate response doesn't work. So,
>>>>
>>>> a) Can you actually ssh to the machine using the IP address
>>>> 169.228.130.92? You probably can.
>>>>
>>>> b) What version are you running of the client? Older versions (probably
>>>> 3.3.3 or below) didn't always properly handle an IP address that was
>>>> returned in deprecated format. Try 3.3.4 or x5.
>>>>
>>>> c) Actually, Lukasz can tell you when that issue was fixed.
>>>>
>>>> I suspect that (b) is the culprit issue here.
>>>>
>>>> Andy
>>>>
>>>>   > >> Anyway, I think the problem is on your
>>>>>> end....
>>>>>
>>>>> Yes, I know :) but I can't figure it out ...
>>>>>
>>>>>> On Mon, 2 Dec 2013, Matevz Tadel wrote:
>>>>>>
>>>>>>>>> 1a. Connecting with 3.3.3 client, error is "host not found":
>>>>>>>>> http://uaf-2.t2.ucsd.edu/~matevz/xrd/ls-fun/3.3.3-slc5--3.3.3-slc5.clog
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> http://uaf-2.t2.ucsd.edu/~matevz/xrd/ls-fun/3.3.3-slc5--3.3.3-slc5.clogstrace
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>> This is the same issue as the one below....
>>>>>>
>>>>>>>>> 1b. Connecting with master client, error is "connection timeout"
>>>>>>>>> http://uaf-2.t2.ucsd.edu/~matevz/xrd/ls-fun/3.3.3-slc5--master-f19.clog
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> http://uaf-2.t2.ucsd.edu/~matevz/xrd/ls-fun/3.3.3-slc5--master-f19.clogstrace
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>> Well of course, because it was actually trying to connect to
>>>>>> nfs-5.t2.ucsd.edu and there seems to eb a firewall preventing it from
>>>>>> getting
>>>>>> there. Why where you trying to go there? Presumably because it got
>>>>>> redirect when
>>>>>> you did "ls /nfs-5/".
>>>>>
>>>>> Yes, but this is the same machine I connected to originally ... and it
>>>>> worked ok for the first connection / login ... and then client is told
>>>>> to connect one more time to the same machine/port to issue the ls
>>>>> request. See below the client log when this actually succeeds on a
>>>>> slc6 machine at UCSD.
>>>>>
>>>>>> So, I don't see a problem other then you are goingto a machine which
>>>>>> is behind a
>>>>>> firewall and you happento be onthe other side.
>>>>>
>>>>> Yes, I know it looks like that ... but it isn't. The same happens if I
>>>>> stop iptables completely.
>>>>>
>>>>> Matevz
>>>>>
>>>>>
>>>>> matevz@desire ~> XRD_CONNECTIONWINDOW=50 XRD_LOGLEVEL=Debug xrdfs
>>>>> cabinet-10-10-10.t2.ucsd.edu:9940 ls /opt
>>>>> [2013-12-02 21:52:01.457868 -0800][Debug  ][App               ]
>>>>> Executing: ls /opt
>>>>> [2013-12-02 21:52:01.457994 -0800][Debug  ][App               ]
>>>>> Attempting to list: /opt
>>>>> [2013-12-02 21:52:01.458120 -0800][Debug  ][Poller            ]
>>>>> Available pollers: built-in
>>>>> [2013-12-02 21:52:01.458141 -0800][Debug  ][Poller            ]
>>>>> Attempting to create a poller according to preference:
>>>>> built-in,libevent
>>>>> [2013-12-02 21:52:01.458153 -0800][Debug  ][Poller            ]
>>>>> Creating poller: built-in
>>>>> [2013-12-02 21:52:01.458165 -0800][Debug  ][Poller            ]
>>>>> Creating and starting the built-in poller...
>>>>> [2013-12-02 21:52:01.458369 -0800][Debug  ][TaskMgr           ]
>>>>> Starting the task manager...
>>>>> [2013-12-02 21:52:01.458425 -0800][Debug  ][TaskMgr           ] Task
>>>>> manager started
>>>>> [2013-12-02 21:52:01.458446 -0800][Debug  ][JobMgr            ]
>>>>> Starting the job manager...
>>>>> [2013-12-02 21:52:01.458511 -0800][Debug  ][JobMgr            ] Job
>>>>> manager started, 3 workers
>>>>> [2013-12-02 21:52:01.458531 -0800][Debug  ][TaskMgr           ]
>>>>> Registering task: "FileTimer task" to be run at: [2013-12-02 21:52:01
>>>>> -0800]
>>>>> [2013-12-02 21:52:01.458576 -0800][Debug  ][PostMaster        ]
>>>>> Creating new channel to: cabinet-10-10-10.t2.ucsd.edu:9940 1 stream(s)
>>>>> [2013-12-02 21:52:01.458618 -0800][Debug  ][PostMaster        ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0] Stream parameters: Network
>>>>> Stack: IPAll, Connection Window: 50, ConnectionRetry: 5, Stream Error
>>>>> Widnow: 1800
>>>>> [2013-12-02 21:52:01.460855 -0800][Debug  ][TaskMgr           ]
>>>>> Registering task: "TickGeneratorTask for:
>>>>> cabinet-10-10-10.t2.ucsd.edu:9940" to be run at: [2013-12-02 21:52:16
>>>>> -0800]
>>>>> [2013-12-02 21:52:01.462712 -0800][Debug  ][PostMaster        ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940] Found 1 address(es):
>>>>> [::ffff:169.228.130.155]:9940
>>>>> [2013-12-02 21:52:01.462752 -0800][Debug  ][AsyncSock         ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] Attempting connection to
>>>>> [::ffff:169.228.130.155]:9940
>>>>> [2013-12-02 21:52:01.462803 -0800][Debug  ][Poller            ] Adding
>>>>> socket 0x636c50 to the poller
>>>>> [2013-12-02 21:52:01.463421 -0800][Debug  ][AsyncSock         ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] Async connection call
>>>>> returned
>>>>> [2013-12-02 21:52:01.463470 -0800][Debug  ][XRootDTransport   ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] Sending out the initial hand
>>>>> shake + kXR_protocol
>>>>> [2013-12-02 21:52:01.465042 -0800][Debug  ][XRootDTransport   ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] Got the server hand shake
>>>>> response (type: server [], protocol version 297)
>>>>> [2013-12-02 21:52:01.465083 -0800][Debug  ][XRootDTransport   ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] kXR_protocol successful
>>>>> (type: server [], protocol version 297)
>>>>> [2013-12-02 21:52:01.465203 -0800][Debug  ][XRootDTransport   ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] Sending out kXR_login
>>>>> request, username: matevz
>>>>> [2013-12-02 21:52:01.465768 -0800][Debug  ][XRootDTransport   ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] Logged in
>>>>> [2013-12-02 21:52:01.465805 -0800][Debug  ][PostMaster        ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0] Stream 0 connected.
>>>>> [2013-12-02 21:52:01.465823 -0800][Debug  ][Utility           ]
>>>>> Monitor library name not set. No monitoring
>>>>> [2013-12-02 21:52:01.466736 -0800][Debug  ][PostMaster        ]
>>>>> Creating new channel to: 169.228.130.155:9940 1 stream(s)
>>>>> [2013-12-02 21:52:01.466769 -0800][Debug  ][PostMaster        ]
>>>>> [169.228.130.155:9940 #0] Stream parameters: Network Stack: IPAll,
>>>>> Connection Window: 50, ConnectionRetry: 5, Stream Error Widnow: 1800
>>>>> [2013-12-02 21:52:01.468959 -0800][Debug  ][TaskMgr           ]
>>>>> Registering task: "TickGeneratorTask for: 169.228.130.155:9940" to be
>>>>> run at: [2013-12-02 21:52:16 -0800]
>>>>> [2013-12-02 21:52:01.469001 -0800][Debug  ][PostMaster        ]
>>>>> [169.228.130.155:9940] Found 1 address(es):
>>>>> [::ffff:169.228.130.155]:9940
>>>>> [2013-12-02 21:52:01.469022 -0800][Debug  ][AsyncSock         ]
>>>>> [169.228.130.155:9940 #0.0] Attempting connection to
>>>>> [::ffff:169.228.130.155]:9940
>>>>> [2013-12-02 21:52:01.469056 -0800][Debug  ][Poller            ] Adding
>>>>> socket 0x63c570 to the poller
>>>>> [2013-12-02 21:52:01.469458 -0800][Debug  ][AsyncSock         ]
>>>>> [169.228.130.155:9940 #0.0] Async connection call returned
>>>>> [2013-12-02 21:52:01.469490 -0800][Debug  ][XRootDTransport   ]
>>>>> [169.228.130.155:9940 #0.0] Sending out the initial hand shake +
>>>>> kXR_protocol
>>>>> [2013-12-02 21:52:01.470843 -0800][Debug  ][XRootDTransport   ]
>>>>> [169.228.130.155:9940 #0.0] Got the server hand shake response (type:
>>>>> server [], protocol version 297)
>>>>> [2013-12-02 21:52:01.470884 -0800][Debug  ][XRootDTransport   ]
>>>>> [169.228.130.155:9940 #0.0] kXR_protocol successful (type: server [],
>>>>> protocol version 297)
>>>>> [2013-12-02 21:52:01.470945 -0800][Debug  ][XRootDTransport   ]
>>>>> [169.228.130.155:9940 #0.0] Sending out kXR_login request, username:
>>>>> matevz
>>>>> [2013-12-02 21:52:01.471323 -0800][Debug  ][XRootDTransport   ]
>>>>> [169.228.130.155:9940 #0.0] Logged in
>>>>> [2013-12-02 21:52:01.471352 -0800][Debug  ][PostMaster        ]
>>>>> [169.228.130.155:9940 #0] Stream 0 connected.
>>>>> /opt/xrootd-master
>>>>> /opt/xrootd
>>>>> /opt/xrootd-3.3.3
>>>>> [2013-12-02 21:52:01.472283 -0800][Debug  ][JobMgr            ]
>>>>> Stopping the job manager...
>>>>> [2013-12-02 21:52:01.472749 -0800][Debug  ][JobMgr            ] Job
>>>>> manager stopped
>>>>> [2013-12-02 21:52:01.472776 -0800][Debug  ][TaskMgr           ]
>>>>> Stopping the task manager...
>>>>> [2013-12-02 21:52:01.472868 -0800][Debug  ][TaskMgr           ] Task
>>>>> manager stopped
>>>>> [2013-12-02 21:52:01.472892 -0800][Debug  ][Poller            ]
>>>>> Stopping the poller...
>>>>> [2013-12-02 21:52:01.473043 -0800][Debug  ][TaskMgr           ]
>>>>> Requesting unregistration of: "TickGeneratorTask for:
>>>>> 169.228.130.155:9940"
>>>>> [2013-12-02 21:52:01.473070 -0800][Debug  ][PostMaster        ]
>>>>> [169.228.130.155:9940 #0] Destroying stream
>>>>> [2013-12-02 21:52:01.473086 -0800][Debug  ][AsyncSock         ]
>>>>> [169.228.130.155:9940 #0.0] Closing the socket
>>>>> [2013-12-02 21:52:01.473098 -0800][Debug  ][Poller            ]
>>>>> <[::ffff:132.239.186.42]:44701><--><[::ffff:169.228.130.155]:9940>
>>>>> Removing socket from the poller
>>>>> [2013-12-02 21:52:01.473134 -0800][Debug  ][TaskMgr           ]
>>>>> Requesting unregistration of: "TickGeneratorTask for:
>>>>> cabinet-10-10-10.t2.ucsd.edu:9940"
>>>>> [2013-12-02 21:52:01.473148 -0800][Debug  ][PostMaster        ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0] Destroying stream
>>>>> [2013-12-02 21:52:01.473158 -0800][Debug  ][AsyncSock         ]
>>>>> [cabinet-10-10-10.t2.ucsd.edu:9940 #0.0] Closing the socket
>>>>> [2013-12-02 21:52:01.473167 -0800][Debug  ][Poller            ]
>>>>> <[::ffff:132.239.186.42]:44700><--><[::ffff:169.228.130.155]:9940>
>>>>> Removing socket from the poller
>>>>>
>>>>> ########################################################################
>>>>>
>>>>>
>>>>> Use REPLY-ALL to reply to list
>>>>>
>>>>> To unsubscribe from the XROOTD-DEV list, click the following link:
>>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
>>>>>
>>>>
>>>> ########################################################################
>>>>
>>>> Use REPLY-ALL to reply to list
>>>>
>>>> To unsubscribe from the XROOTD-DEV list, click the following link:
>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
>>>
>>
>

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1