Hi all,
I tried to update to the latest xrootd version from epel-testing and the
latest version of xrdhttpvoms. However, there is no change in the result:
xrdcp xroot://gridpp09.ecdf.ed.ac.uk:1094//lsst/testfile .
----------------------------------------------------------
works
davix-get -P grid https://gridpp09.ecdf.ed.ac.uk:1094/lsst/testfile
---------------------------------------------------------------------
170316 16:15:13 7211 ?:[log in to unmask] sysXrdHttp: Setting host: 92.40.249.75.threembb.co.uk
170316 16:15:13 7211 ?:[log in to unmask] sysXrdHttp: Entering SSL_accept...
170316 16:15:13 7210 XrdSched: running main accept inq=0
170316 16:15:13 7211 ?:[log in to unmask] sysXrdHttp: SSL_accept returned :1
170316 16:15:13 7211 ?:[log in to unmask] sysXrdHttp: SSL_get_verify_result returned :0
170316 16:15:13 7211 ?:[log in to unmask] sysXrdHttp: Extracting auth info.
170316 16:15:13 7211 ?:[log in to unmask] sysXrdHttp: SSL_get_peer_certificate returned :0x7f414400cb70
170316 16:15:13 7211 ?:[log in to unmask] sysXrdHttp: Setting link name: /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert/CN=proxy/CN=proxy
170316 16:15:13 7211 [log in to unmask] SSL_get_peer_certificate returned :0x7f414400cb70
170316 16:15:13 7211 [log in to unmask] SSL_get_verify_result returned :0
170316 16:15:13 7211 [log in to unmask] SSL_get_peer_cert_chain :0x7f414400e930
170316 16:15:13 7211 [log in to unmask] fqan :/lsst/Role=NULL/Capability=NULL
170316 16:15:13 7211 [log in to unmask] Setting VO: lsst roles :/lsst/Role=NULL/Capability=NULL
170316 16:15:13 7211 sysXrdHttp: getDataOneShot BuffAvailable: 1048576 maxread: 1048576
170316 16:15:13 7211 sysXrdHttp: getDataOneShot sslavail: 1048576
170316 16:15:13 7211 sysXrdHttp: read 195 of 1048576 bytes
170316 16:15:13 7211 sysXrdHttp: rc:31 got hdr line: HEAD //lsst/testfile
HTTP/1.1
170316 16:15:13 7211 sysXrdHttp: rc:40 got hdr line: User-Agent: libdavix/0.6.0 neon/0.0.29
170316 16:15:13 7211 sysXrdHttp: rc:14 got hdr line: Keep-Alive:
170316 16:15:13 7211 sysXrdHttp: rc:24 got hdr line: Connection: Keep-Alive
170316 16:15:13 7211 sysXrdHttp: rc:14 got hdr line: TE: trailers
170316 16:15:13 7211 sysXrdHttp: rc:35 got hdr line: Host: gridpp09.ecdf.ed.ac.uk:1094
170316 16:15:13 7211 sysXrdHttp: rc:35 got hdr line: Accept: application/metalink4+xml
170316 16:15:13 7211 sysXrdHttp: rc:2 got hdr line:
170316 16:15:13 7211 sysXrdHttp: rc:2 detected header end.
170316 16:15:13 7211 XrootdBridge: /C=UK/O=.16:[log in to unmask] login as /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert/CN=proxy/CN=proxy
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] sysXrdHttp: Process. lp:0x7f4150001d68 reqstate: 0
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] XrootdProtocol: 0000 Bridge req=3017 dlen=15 blen=15
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] sysXrdHttp: Process is exiting rc:1
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] ofs_stat: fn=/lsst/testfile
170316 16:15:13 7211 ofs_stat: /C=UK/O=.16:[log in to unmask] Unable to locate /lsst/testfile; permission denied
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] XrootdProtocol: 0000 rc=-1 stat /lsst/testfile
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] XrootdResponse: 0000 sending err 3010: Unable to locate /lsst/testfile; permission denied
170316 16:15:13 7211 sysXrdHttp: XrdHttpReq::Error
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] sysXrdHttp: PostProcessHTTPReq req: 3 reqstate: 0
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] sysXrdHttp: Sending resp: 404 len:10
170316 16:15:13 7211 sysXrdHttp: Sending 46 bytes
170316 16:15:13 7211 sysXrdHttp: Sending 10 bytes
170316 16:15:13 7211 sysXrdHttp: XrdHttpReq request ended.
170316 16:15:13 7211 sysXrdHttp: Cleanup
170316 16:15:13 7211 sysXrdHttp: SSL_shutdown failed
170316 16:15:13 7211 sysXrdHttp: Reset
170316 16:15:13 7211 sysXrdHttp: XrdHttpReq request ended.
170316 16:15:13 7211 XrootdXeq: /C=UK/O=.16:[log in to unmask] disc 0:00:00 (send failure)
170316 16:15:13 7211 /C=UK/O=.16:[log in to unmask] XrdPoll: FD 7 detached from poller 0; num=0
Anyone any ideas what could be the reason that it doesn't work through
davix-get?
In the config I have for http:
if exec xrootd
xrd.protocol http /usr/lib64/libXrdHttp.so
fi
http.cadir /etc/grid-security/certificates
http.cert /etc/grid-security/xrd/xrdcert.pem
http.key /etc/grid-security/xrd/xrdkey.pem
http.secxtractor /usr/lib64/libXrdHttpVOMS.so
http.listingdeny no
http.desthttps no
(gridpp09 is just a single server, not going through a redirector for now
to have a simple situation until it works)
Cheers,
Marcus
On Fri, 10 Mar 2017, Marcus Ebert wrote:
> Hi,
>
> Ah right, http needs it's own debug. I now enabled
> http.trace all
>
> And at least it shows now that the VO is detected:
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: received
> dlen: 16
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: received
> dump: 22 03 01 01 20 01 00 01 16 03 03 88 -62 -29 -126 00
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: This does
> not look like http at pos 0
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: This may
> look like https
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: Protocol
> matched. https: 1
> 170310 17:33:53 14501 XrdProtocol: matched protocol http
> 170310 17:33:53 14501 ?:[log in to unmask] XrdPoll: FD 7
> attached to poller 0; num=1
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: Process.
> lp:0x7fba5c001c68 reqstate: 0
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: Setting
> host: 94.197.120.127.threembb.co.uk
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: Entering
> SSL_accept...
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp:
> SSL_accept returned :1
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp:
> Extracting auth info.
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp:
> SSL_get_peer_certificate returned :0x7fba60034dd0
> 170310 17:33:53 14501 ?:[log in to unmask] sysXrdHttp: Setting
> link name: /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert/CN=3266599870
> 170310 17:33:53 14501 [log in to unmask]
> SSL_get_peer_certificate returned :0x7fba60034dd0
> 170310 17:33:53 14501 [log in to unmask]
> SSL_get_verify_result returned :0
> 170310 17:33:53 14501 [log in to unmask]
> SSL_get_peer_cert_chain :0x7fba6003a0e0
> 170310 17:33:53 14501 [log in to unmask]
> fqan :/lsst/Role=NULL/Capability=NULL
> 170310 17:33:53 14501 [log in to unmask]
> Setting VO: lsst roles :/lsst/Role=NULL/Capability=NULL
> 170310 17:33:53 14501 [log in to unmask]
> sysXrdHttp: SSL_get_verify_result returned :0
>
> but then later it says:
> 170310 17:33:53 14501 XrootdBridge:
> /C=UK/O=.17:[log in to unmask] login as
> /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert/CN=3266599870
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask] sysXrdHttp:
> Process. lp:0x7fba5c001c68 reqstate: 0
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask]
> XrootdProtocol: 0000 Bridge req=3017 dlen=15 blen=15
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask] sysXrdHttp:
> Process is exiting rc:0
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask] ofs_stat:
> fn=/lsst/testfile
> 170310 17:33:53 14501 ofs_stat: /C=UK/O=.17:[log in to unmask]
> Unable to locate /lsst/testfile; permission denied
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask]
> XrootdProtocol: 0000 rc=-1 stat /lsst/testfile
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask]
> XrootdResponse: 0000 sending err 3010: Unable to locate /lsst/testfile;
> permission denied
> 170310 17:33:53 14501 sysXrdHttp: XrdHttpReq::Error
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask] sysXrdHttp:
> PostProcessHTTPReq req: 2 reqstate: 0
> 170310 17:33:53 14501 /C=UK/O=.17:[log in to unmask] sysXrdHttp:
> Sending resp: 404 len:15
> 170310 17:33:53 14501 sysXrdHttp: Sending 46 bytes
> 170310 17:33:53 14501 sysXrdHttp: Sending 15 bytes
> 170310 17:33:53 14501 sysXrdHttp: XrdHttpReq request ended.
> 170310 17:33:53 14501 sysXrdHttp: Cleanup
> 170310 17:33:53 14501 sysXrdHttp: SSL_shutdown failed
> 170310 17:33:53 14501 sysXrdHttp: Reset
> 170310 17:33:53 14501 sysXrdHttp: XrdHttpReq request ended.
> 170310 17:33:53 14501 XrootdXeq: /C=UK/O=.17:[log in to unmask]
> disc 0:00:00 (send failure)
>
>
> So it find's the VO but still shows a permission denied. Or can it not find
> the file?
> filename that
> works : root://dev2.gridpp.ecdf.ed.ac.uk:1094//lsst/testfile doesn't
> work : https://dev2.gridpp.ecdf.ed.ac.uk:1094/lsst/tesfile
>
> (you probably can also access /atlas/testfile through xrdcp)
>
> Cheers,
> Marcus
>
> On Fri, 10 Mar 2017, Fabrizio Furano wrote:
>
>> Hi,
>>
>> >
>> > > - Was your server (the machine, not xrootd) configured to recognize
>> > > gridpp or lsst proxies ?
>> > > [ it's the stuff in /etc/grid-security/vomsdir plus the
>> > > ca-policy-egi-core package ]
>> > >
>> > Yes, it was configured for atlas, gridpp, lsst, lhcb, dteam. This also
>> > works when using xrdcp/xrdfs.
>> > When going through xrdcp, I see in my logs:
>> > 170310 15:04:14 21760 secgsiVOMS_Fun: proxy:
>> > /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert/CN=3266599870
>> > 170310 15:04:14 21760 secgsiVOMS_Fun: adding cert:
>> > /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert
>> > 170310 15:04:15 21760 secgsiVOMS_Fun: retrieval successful
>> > 170310 15:04:15 21760 secgsiVOMS_Fun: found VO: lsst
>> > 170310 15:04:15 21760 secgsiVOMS_Fun: ---> group: '/lsst', role:
>> > 'NULL', cap: 'NULL'
>> > 170310 15:04:15 21760 secgsiVOMS_Fun: ---> fqan:
>> > '/lsst/Role=NULL/Capability=NULL'
>> >
>> > Something similar is not in the log files when going through https.
>>
>>
>> This is what you should look for in the logs when running xrootd in debug
>> mode. What do you get ?
>>
>> 170310 16:15:52 22616 ?:[log in to unmask] sysXrdHttp: Extracting auth
>> info.
>> 170310 16:15:52 22616 ?:[log in to unmask] sysXrdHttp:
>> SSL_get_peer_certificate returned :0x7f7cf403c150
>> 170310 16:15:52 22616 ?:[log in to unmask] sysXrdHttp: Setting link
>> name: /DC=ch/DC=cern/OU=Organic
>> Units/OU=Users/CN=furano/CN=644746/CN=Fabrizio Furano/CN=172241399
>> 170310 16:15:52 22616 [log in to unmask]
>> SSL_get_peer_certificate returned :0x7f7cf403c150
>> 170310 16:15:52 22616 [log in to unmask]
>> SSL_get_verify_result returned :0
>> 170310 16:15:52 22616 [log in to unmask]
>> SSL_get_peer_cert_chain :0x7f7cf403bc30
>> 170310 16:15:52 22616 [log in to unmask] fqan
>> :/atlas/Role=NULL/Capability=NULL
>> 170310 16:15:52 22616 [log in to unmask] fqan
>> :/atlas/lcg1/Role=NULL/Capability=NULL
>> 170310 16:15:52 22616 [log in to unmask] Setting
>> VO: atlas roles :/atlas/Role=NULL/Capability=NULL
>>
>>
>>
>>
>>
>>
>> >
>> > BTW:I think when you tried the error was because I had on the server
>> > still denied listing. It's allowed now and I also put
>> > atlas/testfile which should work to get?
>>
>>
>> Ehm no, still 404.
>>
>> Cheers
>> f
>>
>>
>>
>>
>>
>> >
>> > Cheers,
>> > Marcus
>> >
>> > > Cheers
>> > > Fabrizio
>> > >
>> > >
>> > >
>> > > On 03/10/2017 02:36 PM, Marcus Ebert wrote:
>> > > > Ok, getting the davix-tools was easier than I thought. They are
>> > > > available through a GridPP CernVM.
>> > > > However, doing so I get the output:
>> > > > <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
>> > > > "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
>> > > > <html xmlns="http://www.w3.org/1999/xhtml">
>> > > > <head>
>> > > > <meta http-equiv="content-type" content="text/html;charset=utf-8"/>
>> > > > <link rel="stylesheet" type="text/css"
>> > > > href="/static/css/xrdhttp.css"/>
>> > > > <link rel="icon" type="image/png" href="/static/icons/xrdhttp.ico"/>
>> > > > <title>/</title>
>> > > > </head>
>> > > > <body>
>> > > > <h1>Listing of: /</h1>
>> > > > <div id="header"><table id="ft">
>> > > > <thead><tr>
>> > > > <th class="mode">Mode</th><th class="flags">Flags</th><th
>> > > > class="size">Size</th><th class="datetime">Modified</th><th
>> > > > class="name">Name</th></tr></thead>
>> > > > <tr><td class="mode">d--rwx</td><td class="mode">51</td><td
>> > > > class="size">4096</td><td class="datetime">Wed, 26 Nov 2014 15:28:25
>> > > > GMT</td><td class="name"><a href="atlas">atlas</a></td></tr><tr><td
>> > > > class="mode">d--rwx</td><td class="mode">51</td><td
>> > > > class="size">4096</td><td class="datetime">Thu, 27 Nov 2014 16:34:50
>> > > > GMT</td><td class="name"><a
>> > > > href="dynafeds_demo">dynafeds_demo</a></td></tr><tr><td
>> > > > class="mode">d--rwx</td><td class="mode">51</td><td
>> > > > class="size">167936</td><td class="datetime">Tue, 28 Feb 2017
>> > > > 16:44:54 GMT</td><td class="name"><a
>> > > > href="georgios_test">georgios_test</a></td></tr></table></div><br><br><hr
>> > > > size=1><p><span id="requestby">Request by
>> > > > /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert/CN=157025827 (
>> > > > DN: /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus
>> > > > ebert/CN=157025827 ) ( 94.197.120.22.threembb.co.uk )</span></p>
>> > > > <p>Powered by XrdHTTP v20170305-55a66d2 (CERN IT-SDC)</p>
>> > > >
>> > > >
>> > > > Which doesn't say anything about the VO. I tried with an LSST and
>> > > > GridPP proxy.
>> > > > voms info gives for example for gridpp VO:
>> > > > subject : /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus
>> > > > ebert/CN=157025827
>> > > > issuer : /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert
>> > > > identity : /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert
>> > > > type : RFC compliant proxy
>> > > > strength : 1024 bits
>> > > > path : /tmp/x509up_u501
>> > > > timeleft : 11:59:33
>> > > > key usage : Digital Signature, Key Encipherment, Data Encipherment
>> > > > === VO gridpp extension information ===
>> > > > VO : gridpp
>> > > > subject : /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus ebert
>> > > > issuer :
>> > > > /C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk
>> > > > attribute : /gridpp/Role=NULL/Capability=NULL
>> > > > timeleft : 11:59:33
>> > > > uri : voms.gridpp.ac.uk:15000
>> > > >
>> > > >
>> > > > Cheers,
>> > > > Marcus
>> > > >
>> > > > On Fri, 10 Mar 2017, Marcus Ebert wrote:
>> > > >
>> > > > > Thanks Fabrizio!
>> > > > >
>> > > > > I'll try to get the davix-tools made available first.
>> > > > >
>> > > > > Cheers,
>> > > > > Marcus
>> > > > >
>> > > > > On Fri, 10 Mar 2017, Fabrizio Furano wrote:
>> > > > >
>> > > > > > Hi,
>> > > > > >
>> > > > > > sorry, I missed the other questions, here they are...
>> > > > > >
>> > > > > > On 03/10/2017 11:08 AM, Marcus Ebert wrote:
>> > > > > > > Unfortunaely, I don't have davix-get available on the local
>> > > > > > > desktop. Is > there any lsetup mode for Atlas to make that
>> > > > > > available
>> > > > > > > (or any other cvmfs path)?
>> > > > > >
>> > > > > > You can get davix from all the major Linux distributions with
>> > > > > > their own
>> > > > > > tools, apt, yum, ...
>> > > > > >
>> > > > > > cvmfs certainly has it because it's used, but I cannot help you
>> > > > > > there, I
>> > > > > > have no idea (others may chime in)
>> > > > > >
>> > > > > > > > Do you get any similar output if you do this with >
>> > > > > > > > https://dev2.gridpp.ecdf.ed.ac.uk:1094 ?
>> > > > > > >
>> > > > > > It gives to me 404 on the root directory, which is a sign of
>> > > > > > server
>> > > > > > misconfiguration (despite xrootd or http)
>> > > > > >
>> > > > > >
>> > > > > > > If I do so in a browser for your test server, it displays:
>> > > > > > > Request by /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus
>> > > > > > > ebert ( DN: > /C=UK/O=eScience/OU=Edinburgh/L=NeSC/CN=marcus
>> > > > > > ebert ) (
>> > > > > > > 94.197.120.22.threembb.co.uk )
>> > > > > > > > Powered by XrdHTTP v20170305-55a66d2 (CERN IT-SDC)
>> > > > > > > > but no VO identification (probably because there is no
>> > > > > > > > voms-proxy > available to the browser and it doesn't do a
>> > > > > > > > lockup in
>> > > > > > > grid-mapfile?)
>> > > > > >
>> > > > > > Browsers do not support Grid proxies.
>> > > > > > The historical workaround for that is the use of a mapfile, as
>> > > > > > you cite.
>> > > > > > Xrdhttp uses the same mapfile
>> > > > > > of the rest of the xrootd framework, which is a bit original if
>> > > > > > one is
>> > > > > > used to the ones used e.g. by DPM.
>> > > > > >
>> > > > > > Anyway I would not go further that way until you have
>> > > > > > troubleshoot your
>> > > > > > client setup. You must be able
>> > > > > > to get from my server the same kind of output that I get.
>> > > > > >
>> > > > > > You can use curl, but it's more complex and less reliable.
>> > > > > > Please do an
>> > > > > > attempt at getting davix.
>> > > > > >
>> > > > > > Please let me know
>> > > > > > Fabrizio
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > >
>> > >
>> > >
>> >
>>
>>
>
>
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
|