LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  August 2013

QSERV-L August 2013

Subject:

Re: Ok, source table

From:

"Daniel L. Wang" <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Fri, 30 Aug 2013 14:27:06 -0700

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (174 lines)

(adding qserv-l for posterity)
Douglas,

FYI, I improved the error message so that you can see the failing query 
(and clue to the broken index) rather than a runtime python type problem.

It was a couple lines in app.py that I committed and pushed to master.

I'll have a quick look at the object-source join.

-Daniel

On 08/27/2013 09:36 AM, Smith, Douglas A. wrote:
> On 08/26/2013 02:28 PM, Wang, Daniel Liwei wrote:
>> Okay, thanks for testing this out.
>>
>>
>> On 08/26/2013 01:26 PM, Smith, Douglas A. wrote:
>>> Anway, found a object id with source data:
>>>
>>>
>>> But when I try to select this data:
>>>
>>> mysql> select * from Object where objectId = 154062577146538502;
>>> ERROR 4110 (Proxy): Qserv error: Unexpected error: (<type
>>> 'exceptions.TypeError'>, TypeError('argument 2 to map() must support
>>> iteration',), <traceback object at 0x17629e0>)
>>>
>>> Not sure, is that an error in the code there?
>> Yes, looks like an error in the python on the frontend. Send me the last
>> bit of the log, which should have the python stack trace, and the first
>> bit of the log, which should spit out config and what it thinks are the
>> metadata records.
> Ok, here is the start and end of the log on this one:
>
> Configuration:
> [frontend]
> xrootd = ccqserv001.in2p3.fr:1094
> scratch_path =
> /dev/shm/qserv-root-3e033a53578f3f74e588026d516356bc8383ba40a1dd2bd6a37eeb28
> port = 7080
> xrootd_user = qsmaster
>
> [tuning]
> memoryengine = yes
>
> [partitioner]
> substripes = 9
> stripes = 120
> emptychunklistfile = /qserv/qserv-newparser/etc/emptyChunks.txt
>
> [mgmtdb]
> db = qservMeta
>
> [mysql]
> mysqlclient =
>
> [debug]
> chunklimit = -1
>
> [table]
> subchunked = Object
> partitioncols =
> Object:ra_PS,decl_PS,objectId;Source:raObject,declObject,objectId
> chunked = Source,FaintSource
> alloweddbs =
> LSST,qservTest_case01_qserv,qservTest_case02_qserv,qservTest_case03_qserv
>
> [metaServer]
> passwd = qmsPass
> host = localhost
> port = 7082
> user = qms
>
> [resultdb]
> dropmem =
> passwd =
> db = qservResult
> unix_socket = /qserv/qserv-newparser/var/lib/mysql/mysql.sock
> host =
> user = qsmaster
> port = 0
>
> contents: xmlrpc_check xmlrpc_echo xmlrpc_help xmlrpc_initMetadataCache
> xmlrpc_joinQuery xmlrpc_query xmlrpc_queryNow xmlrpc_reset
> xmlrpc_resultTableString xmlrpc_results xmlrpc_stop xmlrpc_submitQuery
> xmlrpc_submitQueryPlain xmlrpc_submitQueryWithLock
>
>
> Metadata Cache in C++:
> db: LSST: is partitioned (nStripes=120, nSubStripes=9, defOvF=0,
> defOvNN=0.025).
>     Tables:
>      Object: is partitioned (overlap=0.025, phiCol=ra_PS,
> thetaCol=decl_PS, objIdCol=objectId, phiColNo=2, thetaColNo=4,
> objIdColNo=0, logPart=2, physChunking=33).
>
>      Source: is partitioned (overlap=0, phiCol=ra, thetaCol=decl,
> objIdCol=objectId, phiColNo=6, thetaColNo=9, objIdColNo=3, logPart=1,
> physChunking=17).
>
>
>
> Starting Qserv interface on port: 7080
>
>
>
> AliasMap fwd()    rev()
> Found ref:Table(.Object)
> Adding orsibs: COMP_PREDICATE FACTOR COLUMN_REF objectId = FACTOR
> 154062577146538502
> Parsed value expression for select list.
> *
> SELECT * FROM Object WHERE objectId=154062577146538502
> Testing
> aggr origlist: *,
> pass: *
> fixup:
> parallel: SELECT * FROM LSST.Object_%CC% AS QST_1_ WHERE
> objectId=154062577146538502
> merge: SELECT
> Using 120 stripes and 9 substripes.
> constraint= <lsst.qserv.master.masterLib.Constraint; proxy of <Swig
> Object of type 'lsst::qserv::master::Constraint *' at 0x1bba180> >
> Looking for indexhints in  [('sIndex', ['LSST', 'Object', 'objectId',
> '154062577146538502'])]
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> Too many SQL failures, not retrying.
> cids are  None
> Unexpected error: (<type 'exceptions.TypeError'>, TypeError('argument 2
> to map() must support iteration',), <traceback object at 0x1762200>)
> Traceback
> (most recent call last):
>     File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 409, in __init__
>       self._prepareForExec()
>     File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 458, in _prepareForExec
>       self._applyConstraints()
>     File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 516, in _applyConstraints
>       self._evaluateHints(dominantDb, self.hintList, self.pmap)
>     File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 469, in _evaluateHints
>       indexRegions = self._computeIndexRegions(hintList)
>     File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 605, in _computeIndexRegions
> :    chunkIds = index.lookup(lookups)
>     File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 369, in lookup
>       cids = map(lambda t: t[0], cids)
> TypeError: argument 2 to map() must support iteration

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use