Print

Print


Hi Remi,

Just got bck nd still in somewht of  daze. Anyway, you're quite correct
and I will be revisiting the olb semantics for writing. As we've found
out, the write semantics are not easy to get right (we'll not when we have
multiple servers). As for teh quick and dirty, I did tell Wilko to simply
add the "s" option to the "w" option in the olb.path directive. That
doesn't mean you will be staging in your case since whenever you open a
file you will be opening it for writing anyway and the xrootd will not
stage the file in, regardless because of other options in the config file.
This is a complete hack but should bypass the majority of problems.

Andy


On Mon, 29 Nov 2004, Remi Mommsen wrote:

> Hi,
>
> I have another problem with XrdClientAdmin::XrdExistFiles using the
> load balancer oprserv08. The following perl code snipped doesn't find a
> file as it does not get redirected:
>
> XrdClientAdmin::XrdInitialize("root://oprserv08:1094//prod", 2);
>
> if (XrdClientAdmin::XrdExistFiles("/prod/foo/test.01.root")) {
>    # is never true
> }
>
> However, adding a XrdClientAdmin::XrdChmod before the 'if' statement
> like
>
> XrdClientAdmin::XrdChmod("/prod/foo/test.01.root", 0x6, 0x4, 0x0);
>
> results in being redirected and the following
> XrdClientAdmin::XrdExistFiles then evaluates correctly.
>
> This is of course quite an ugly hack.
>
> Cheers,
> 		Remi
>
>
> =====================================================================
>
> here the output without the XrdClientAdmin::XrdChmod line:
>
> 041129 09:02:39 001 Xrd:  (C) 2004 SLAC XrdClientAdmin 0.2 beta
> 041129 09:02:39 001 Xrd: GetDomainToMatch GetHostName(noric01) returned
> name=noric01.slac.stanford.edu
> 041129 09:02:39 001 Xrd: GetDomainToMatch GetDomain(noric01) -->
> slac.stanford.edu
> 041129 09:02:39 001 Xrd: XrdClientUrlSet List of servers to connect to
> is [oprserv08:1094]
> 041129 09:02:39 001 Xrd: XrdClientUrlSet Remote file to open is 'prod'
> 041129 09:02:39 001 Xrd: ConvertSingleDNSAlias Resolving oprserv08:1094
> 041129 09:02:39 001 Xrd: ConvertSingleDNSAlias Found host
> oprserv08.slac.stanford.edu with addr 134.79.85.48
> 041129 09:02:39 001 Xrd: ShowUrls The converted URLs count is 1
> 041129 09:02:39 001 Xrd: ShowUrls URL n.1:
> oprserv08.slac.stanford.edu:1094//.
> 041129 09:02:39 001 Xrd: GetDomainToMatch
> GetHostName(oprserv08.slac.stanford.edu) returned
> name=oprserv08.slac.stanford.edu
> 041129 09:02:39 001 Xrd: GetDomainToMatch
> GetDomain(oprserv08.slac.stanford.edu) --> slac.stanford.edu
> 041129 09:02:39 001 Xrd: CheckHostDomain Resolved
> [oprserv08.slac.stanford.edu]'s domain name into [slac.stanford.edu]
> 041129 09:02:39 001 Xrd: CheckHostDomain Access granted to the domain
> of [oprserv08.slac.stanford.edu].
> 041129 09:02:39 001 Xrd: GetDomainToMatch
> GetHostName(oprserv08.slac.stanford.edu) returned
> name=oprserv08.slac.stanford.edu
> 041129 09:02:39 001 Xrd: GetDomainToMatch
> GetDomain(oprserv08.slac.stanford.edu) --> slac.stanford.edu
> 041129 09:02:39 001 Xrd: CheckHostDomain Resolved
> [oprserv08.slac.stanford.edu]'s domain name into [slac.stanford.edu]
> 041129 09:02:39 001 Xrd: CheckHostDomain Access granted to the domain
> of [oprserv08.slac.stanford.edu].
> 041129 09:02:39 001 Xrd: CreateTXNf Trying to connect to
> oprserv08.slac.stanford.edu:1094. Connect try 1
> 041129 09:02:39 001 Xrd: ConnectionMgr Explicitly requested not to
> start the garbage collector thread. Are you sure?
> 041129 09:02:39 001 Xrd: Connect Creating a logical connection...
> 041129 09:02:39 001 Xrd: Connect Physical connection not found.
> Creating a new one...
> 041129 09:02:39 001 Xrd: Connect Connecting to
> [oprserv08.slac.stanford.edu:1094]
> 041129 09:02:39 001 Xrd: ClientSock::TryConnect Trying to connect
> tooprserv08.slac.stanford.edu(134.79.85.48):1094
> 041129 09:02:39 001 Xrd: Connect Connected to
> [oprserv08.slac.stanford.edu:1094]
> 041129 09:02:39 001 Xrd: Connect New physical connection to server
> oprserv08.slac.stanford.edu:1094 succesfully created.
> 041129 09:02:39 001 Xrd: Connect LogConn: size:1 count: 1PhyConn:
> size:1 count: 1
> 041129 09:02:39 001 Xrd: Connect Connect(oprserv08.slac.stanford.edu,
> 1094) returned 0
> 041129 09:02:39 001 Xrd: CreateTXNf The logical connection id is 0.
> This will be the streamid for this client
> 041129 09:02:39 001 Xrd: CreateTXNf Working url is
> oprserv08.slac.stanford.edu:1094//
> 041129 09:02:39 001 Xrd: DoHandShake HandShake step 1: Sending 20 bytes
> to the server [oprserv08.slac.stanford.edu:1094]
> 041129 09:02:39 001 Xrd: DoHandShake HandShake step 2: Reading 4 bytes
> from server [oprserv08.slac.stanford.edu:1094].
> 041129 09:02:39 001 Xrd: DoHandShake HandShake step 3: Reading 12 bytes
> from server [oprserv08.slac.stanford.edu:1094].
> 041129 09:02:39 001 Xrd: DoHandShake Setting Load Balancer Server Url =
> oprserv08.slac.stanford.edu:1094//
> 041129 09:02:39 001 Xrd: StartReader Starting reader thread...
> 041129 09:02:39 000 Xrd: SocketReaderThread Reader Thread starting.
> 041129 09:02:39 001 Xrd: GetAccessToSrv Ok: the server on
> [oprserv08.slac.stanford.edu:1094] is an xrootd redirector.
> 041129 09:02:39 001 Xrd: DoLogin Logging into the server
> [oprserv08.slac.stanford.edu:1094]. pid=27921 uid=mommsen
> 041129 09:02:39 001 Xrd: SendGenCommand Sending command
> XTNetconn::doLogin
> 041129 09:02:39 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [oprserv08.slac.stanford.edu:1094]...
> 041129 09:02:39 001 Xrd: Create Access to server granted.
> 041129 09:02:39 001 Xrd: Connect Connected.
> 041129 09:02:39 001 Xrd: SendGenCommand Sending command SysStatX
> 041129 09:02:39 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [oprserv08.slac.stanford.edu:1094]...
> Cannot find /prod/foo/test.01.root from root://oprserv08:1094/
>
>
>
> here the output with the XrdClientAdmin::XrdChmod line:
> 041129 09:02:54 001 Xrd:  (C) 2004 SLAC XrdClientAdmin 0.2 beta
> 041129 09:02:54 001 Xrd: GetDomainToMatch GetHostName(noric01) returned
> name=noric01.slac.stanford.edu
> 041129 09:02:54 001 Xrd: GetDomainToMatch GetDomain(noric01) -->
> slac.stanford.edu
> 041129 09:02:54 001 Xrd: XrdClientUrlSet List of servers to connect to
> is [oprserv08:1094]
> 041129 09:02:54 001 Xrd: XrdClientUrlSet Remote file to open is 'prod'
> 041129 09:02:54 001 Xrd: ConvertSingleDNSAlias Resolving oprserv08:1094
> 041129 09:02:54 001 Xrd: ConvertSingleDNSAlias Found host
> oprserv08.slac.stanford.edu with addr 134.79.85.48
> 041129 09:02:54 001 Xrd: ShowUrls The converted URLs count is 1
> 041129 09:02:54 001 Xrd: ShowUrls URL n.1:
> oprserv08.slac.stanford.edu:1094//.
> 041129 09:02:54 001 Xrd: GetDomainToMatch
> GetHostName(oprserv08.slac.stanford.edu) returned
> name=oprserv08.slac.stanford.edu
> 041129 09:02:54 001 Xrd: GetDomainToMatch
> GetDomain(oprserv08.slac.stanford.edu) --> slac.stanford.edu
> 041129 09:02:54 001 Xrd: CheckHostDomain Resolved
> [oprserv08.slac.stanford.edu]'s domain name into [slac.stanford.edu]
> 041129 09:02:54 001 Xrd: CheckHostDomain Access granted to the domain
> of [oprserv08.slac.stanford.edu].
> 041129 09:02:54 001 Xrd: GetDomainToMatch
> GetHostName(oprserv08.slac.stanford.edu) returned
> name=oprserv08.slac.stanford.edu
> 041129 09:02:54 001 Xrd: GetDomainToMatch
> GetDomain(oprserv08.slac.stanford.edu) --> slac.stanford.edu
> 041129 09:02:54 001 Xrd: CheckHostDomain Resolved
> [oprserv08.slac.stanford.edu]'s domain name into [slac.stanford.edu]
> 041129 09:02:54 001 Xrd: CheckHostDomain Access granted to the domain
> of [oprserv08.slac.stanford.edu].
> 041129 09:02:54 001 Xrd: CreateTXNf Trying to connect to
> oprserv08.slac.stanford.edu:1094. Connect try 1
> 041129 09:02:54 001 Xrd: ConnectionMgr Explicitly requested not to
> start the garbage collector thread. Are you sure?
> 041129 09:02:54 001 Xrd: Connect Creating a logical connection...
> 041129 09:02:54 001 Xrd: Connect Physical connection not found.
> Creating a new one...
> 041129 09:02:54 001 Xrd: Connect Connecting to
> [oprserv08.slac.stanford.edu:1094]
> 041129 09:02:54 001 Xrd: ClientSock::TryConnect Trying to connect
> tooprserv08.slac.stanford.edu(134.79.85.48):1094
> 041129 09:02:54 001 Xrd: Connect Connected to
> [oprserv08.slac.stanford.edu:1094]
> 041129 09:02:54 001 Xrd: Connect New physical connection to server
> oprserv08.slac.stanford.edu:1094 succesfully created.
> 041129 09:02:54 001 Xrd: Connect LogConn: size:1 count: 1PhyConn:
> size:1 count: 1
> 041129 09:02:54 001 Xrd: Connect Connect(oprserv08.slac.stanford.edu,
> 1094) returned 0
> 041129 09:02:54 001 Xrd: CreateTXNf The logical connection id is 0.
> This will be the streamid for this client
> 041129 09:02:54 001 Xrd: CreateTXNf Working url is
> oprserv08.slac.stanford.edu:1094//
> 041129 09:02:54 001 Xrd: DoHandShake HandShake step 1: Sending 20 bytes
> to the server [oprserv08.slac.stanford.edu:1094]
> 041129 09:02:54 001 Xrd: DoHandShake HandShake step 2: Reading 4 bytes
> from server [oprserv08.slac.stanford.edu:1094].
> 041129 09:02:54 001 Xrd: DoHandShake HandShake step 3: Reading 12 bytes
> from server [oprserv08.slac.stanford.edu:1094].
> 041129 09:02:54 001 Xrd: DoHandShake Setting Load Balancer Server Url =
> oprserv08.slac.stanford.edu:1094//
> 041129 09:02:54 001 Xrd: StartReader Starting reader thread...
> 041129 09:02:54 000 Xrd: SocketReaderThread Reader Thread starting.
> 041129 09:02:54 001 Xrd: GetAccessToSrv Ok: the server on
> [oprserv08.slac.stanford.edu:1094] is an xrootd redirector.
> 041129 09:02:54 001 Xrd: DoLogin Logging into the server
> [oprserv08.slac.stanford.edu:1094]. pid=27958 uid=mommsen
> 041129 09:02:54 001 Xrd: SendGenCommand Sending command
> XTNetconn::doLogin
> 041129 09:02:54 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [oprserv08.slac.stanford.edu:1094]...
> 041129 09:02:54 001 Xrd: Create Access to server granted.
> 041129 09:02:54 001 Xrd: Connect Connected.
> 041129 09:02:54 001 Xrd: SendGenCommand Sending command Chmod
> 041129 09:02:54 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [oprserv08.slac.stanford.edu:1094]...
> 041129 09:02:54 001 Xrd: ReadPartialAnswer Server
> [oprserv08.slac.stanford.edu:1094] did not answer OK. Resp status is
> [kXR_redirect]
> 041129 09:02:54 001 Xrd: HandleServerError Redir count=1
> 041129 09:02:54 001 Xrd: HandleServerError Received redirection to
> [bbrprod01.slac.stanford.edu:1094]. Token=[].
> 041129 09:02:59 001 Xrd: GetDomainToMatch
> GetHostName(bbrprod01.slac.stanford.edu) returned
> name=bbrprod01.slac.stanford.edu
> 041129 09:02:59 001 Xrd: GetDomainToMatch
> GetDomain(bbrprod01.slac.stanford.edu) --> slac.stanford.edu
> 041129 09:02:59 001 Xrd: CheckHostDomain Resolved
> [bbrprod01.slac.stanford.edu]'s domain name into [slac.stanford.edu]
> 041129 09:02:59 001 Xrd: CheckHostDomain Access granted to the domain
> of [bbrprod01.slac.stanford.edu].
> 041129 09:02:59 001 Xrd: Connect Creating a logical connection...
> 041129 09:02:59 001 Xrd: Connect Physical connection not found.
> Creating a new one...
> 041129 09:02:59 001 Xrd: Connect Connecting to
> [bbrprod01.slac.stanford.edu:1094]
> 041129 09:02:59 001 Xrd: ClientSock::TryConnect Trying to connect
> tobbrprod01.slac.stanford.edu(134.79.87.111):1094
> 041129 09:02:59 001 Xrd: Connect Connected to
> [bbrprod01.slac.stanford.edu:1094]
> 041129 09:02:59 001 Xrd: Connect New physical connection to server
> bbrprod01.slac.stanford.edu:1094 succesfully created.
> 041129 09:02:59 001 Xrd: Connect LogConn: size:2 count: 1PhyConn:
> size:2 count: 2
> 041129 09:02:59 001 Xrd: Connect Connect(bbrprod01.slac.stanford.edu,
> 1094) returned 1
> 041129 09:02:59 001 Xrd: DoHandShake HandShake step 1: Sending 20 bytes
> to the server [bbrprod01.slac.stanford.edu:1094]
> 041129 09:02:59 001 Xrd: DoHandShake HandShake step 2: Reading 4 bytes
> from server [bbrprod01.slac.stanford.edu:1094].
> 041129 09:02:59 001 Xrd: DoHandShake HandShake step 3: Reading 12 bytes
> from server [bbrprod01.slac.stanford.edu:1094].
> 041129 09:02:59 001 Xrd: StartReader Starting reader thread...
> 041129 09:02:59 000 Xrd: SocketReaderThread Reader Thread starting.
> 041129 09:02:59 001 Xrd: GetAccessToSrv Ok, the server on
> [bbrprod01.slac.stanford.edu:1094] is an xrootd data server.
> 041129 09:02:59 001 Xrd: DoLogin Logging into the server
> [bbrprod01.slac.stanford.edu:1094]. pid=27958 uid=mommsen
> 041129 09:02:59 001 Xrd: SendGenCommand Sending command
> XTNetconn::doLogin
> 041129 09:02:59 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [bbrprod01.slac.stanford.edu:1094]...
> 041129 09:02:59 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [bbrprod01.slac.stanford.edu:1094]...
> 041129 09:02:59 001 Xrd: SendGenCommand Sending command SysStatX
> 041129 09:02:59 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [bbrprod01.slac.stanford.edu:1094]...
> 041129 09:02:59 001 Xrd: SendGenCommand Sending command GetChecksum
> 041129 09:02:59 001 Xrd: ReadPartialAnswer Reading a XrdClientMessage
> from the server [bbrprod01.slac.stanford.edu:1094]...
>
>
>
> ---------------------------------------------------------------------
> Failure is not an option.
> It comes bundled with your Microsoft product.       (Ferenc Mantfeld)
>
> *********************************************************************
> Remigius K. Mommsen                 e-mail: [log in to unmask]
> University of California, Irvine       URL:    http://cern.ch/mommsen
> c/o SLAC                             voice:        ++1 (650) 926-3595
> 2575 Sand Hill Road #35                fax:        ++1 (650) 926-3882
> Menlo Park, CA 94025, US              home:        ++1 (650) 233-9041
> *********************************************************************
>
>