LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  January 2016

QSERV-L January 2016

Subject:

Re: webserv and butler issue

From:

"Pease, Nathan" <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Thu, 21 Jan 2016 22:48:49 +0000

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (136 lines)

a mapper instance can be passed into Butler at init time, but that's not being done here:
    "/home/centos/stack/repos/dax_imgserv/python/lsst/dax/imgserv/locateImage.py",
        line 214, in _getImageButler
        butler = lsst.daf.persistence.Butler(self._dataRoot)

(mapper would be a 2nd arg).

it's possible there was a parent repo specified in the repo dir you copied over. you could look for a symlink inside the dir called _parent. If you find it, it would point to another repo on the originating filesystem. Look there for a file called _mapper. If you find that, copy it to the repo you have on your system, or copy the whole parent repo (and recreate the _parent symlink to be accurate if necessary). You may have to follow several _parent links. (Even if you find the _mapper right away, you may need to keep following _parent to make sure you have all the data needed to run the script)

ping me if you need help or clarification.

n

________________________________________
From: [log in to unmask] <[log in to unmask]> on behalf of Jacek Becla <[log in to unmask]>
Sent: Thursday, January 21, 2016 2:26 PM
To: qserv-l
Subject: [QSERV-L] webserv and butler issue

I need some here, probably Nate, Serge or John will be able to help.

So I am trying to setup webserv for ipac... I copied this directory over:

/raid/lauren/rerun/LSST/STRIPE82L/v2/deepCoadd-results

from lsst-dev, and I ran Serge's ingest script, ending up
with some tables in the database becla_bremerton on our
lsst10 server.

I pointed webserv to lsst10 (like we did at Bremerton),
and tried to run some queries we used to run at Bremerton, eg


curl
'http://localhost:8661/image/v0/raw?ra=359.195&dec=-0.1055&filter=r' > 1.

(see full list at:

https://confluence.lsstcorp.org/display/DM/Webserv+for+SUI+Tests#WebservforSUITests-ExampleImageQueries
)


the imgserv is failing with


2819111 [0x7f7b4179c740] INFO root null - raw ra=359.195 dec=-0.1055 filt=r
2819125 [0x7f7b4179c740] INFO root null - SET time_zone = '+0:00'
2819126 [0x7f7b4179c740] INFO root null - SELECT
ra,decl,run,camcol,field,filterName,(power((ra - 359.195),2) +
power((decl - -0.1055),2)) as distance FROM Science_Ccd_Exposure WHERE
scisql_s2PtInBox(ra, decl, 359.194305556, -0.106194444444,
359.195694444, -0.104805555556) = 1 order by distance LIMIT 1
01/21/2016 10:18:05 __main__ ERROR: Exception on /image/v0/raw [GET]
Traceback (most recent call last):
   File
"/home/centos/stack/Linux64/flask/0.10.1+11/lib/python/Flask-0.10.1-py2.7.egg/flask/app.py",
line 1817, in wsgi_app
     response = self.full_dispatch_request()
   File
"/home/centos/stack/Linux64/flask/0.10.1+11/lib/python/Flask-0.10.1-py2.7.egg/flask/app.py",
line 1477, in full_dispatch_request
     rv = self.handle_user_exception(e)
   File
"/home/centos/stack/Linux64/flask/0.10.1+11/lib/python/Flask-0.10.1-py2.7.egg/flask/app.py",
line 1381, in handle_user_exception
     reraise(exc_type, exc_value, tb)
   File
"/home/centos/stack/Linux64/flask/0.10.1+11/lib/python/Flask-0.10.1-py2.7.egg/flask/app.py",
line 1475, in full_dispatch_request
     rv = self.dispatch_request()
   File
"/home/centos/stack/Linux64/flask/0.10.1+11/lib/python/Flask-0.10.1-py2.7.egg/flask/app.py",
line 1461, in dispatch_request
     return self.view_functions[rule.endpoint](**req.view_args)
   File
"/home/centos/stack/repos/dax_imgserv/python/lsst/dax/imgserv/imageREST_v0.py",
line 94, in getRaw
     return _getIFull(request, W13RawDb)
   File
"/home/centos/stack/repos/dax_imgserv/python/lsst/dax/imgserv/imageREST_v0.py",
line 149, in _getIFull
     imgFull = w13db.getImageFull(ra, dec)
   File
"/home/centos/stack/repos/dax_imgserv/python/lsst/dax/imgserv/locateImage.py",
line 74, in getImageFull
     img, metadata = self.getImageFullWithMetadata(ra, dec)
   File
"/home/centos/stack/repos/dax_imgserv/python/lsst/dax/imgserv/locateImage.py",
line 85, in getImageFullWithMetadata
     img, butler = self._getImageButler(res)
   File
"/home/centos/stack/repos/dax_imgserv/python/lsst/dax/imgserv/locateImage.py",
line 214, in _getImageButler
     butler = lsst.daf.persistence.Butler(self._dataRoot)
   File
"/home/centos/stack/Linux64/daf_persistence/2015_10.0-5-g4063539+6/python/lsst/daf/persistence/butler.py",
line 137, in __init__
     cls = Butler.getMapperClass(root)
   File
"/home/centos/stack/Linux64/daf_persistence/2015_10.0-5-g4063539+6/python/lsst/daf/persistence/butler.py",
line 103, in getMapperClass
     (mapperFile,))
RuntimeError: No mapper provided and no _mapper available
01/21/2016 10:18:05 werkzeug INFO: 127.0.0.1 - - [21/Jan/2016 22:18:05]
"GET /image/v0/raw?ra=359.195&dec=-0.1055&filter=r HTTP/1.1" 500 -

---

So why am I missing _mapper?

BTW, I suspect we need to redo the sample image queries (I'll need
help with that :).

---

Oh, and I just noticed that imgserv has this hardcoded:

database="DC_W13_Stripe82",
table="Science_Ccd_Exposure",

that is pretty ugly. We need to sort it all out, but right now I'd
like to just get to where we were during Bremerton meeting.

J.

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use