(adding qserv-l for posterity)
Douglas,
FYI, I improved the error message so that you can see the failing query
(and clue to the broken index) rather than a runtime python type problem.
It was a couple lines in app.py that I committed and pushed to master.
I'll have a quick look at the object-source join.
-Daniel
On 08/27/2013 09:36 AM, Smith, Douglas A. wrote:
> On 08/26/2013 02:28 PM, Wang, Daniel Liwei wrote:
>> Okay, thanks for testing this out.
>>
>>
>> On 08/26/2013 01:26 PM, Smith, Douglas A. wrote:
>>> Anway, found a object id with source data:
>>>
>>>
>>> But when I try to select this data:
>>>
>>> mysql> select * from Object where objectId = 154062577146538502;
>>> ERROR 4110 (Proxy): Qserv error: Unexpected error: (<type
>>> 'exceptions.TypeError'>, TypeError('argument 2 to map() must support
>>> iteration',), <traceback object at 0x17629e0>)
>>>
>>> Not sure, is that an error in the code there?
>> Yes, looks like an error in the python on the frontend. Send me the last
>> bit of the log, which should have the python stack trace, and the first
>> bit of the log, which should spit out config and what it thinks are the
>> metadata records.
> Ok, here is the start and end of the log on this one:
>
> Configuration:
> [frontend]
> xrootd = ccqserv001.in2p3.fr:1094
> scratch_path =
> /dev/shm/qserv-root-3e033a53578f3f74e588026d516356bc8383ba40a1dd2bd6a37eeb28
> port = 7080
> xrootd_user = qsmaster
>
> [tuning]
> memoryengine = yes
>
> [partitioner]
> substripes = 9
> stripes = 120
> emptychunklistfile = /qserv/qserv-newparser/etc/emptyChunks.txt
>
> [mgmtdb]
> db = qservMeta
>
> [mysql]
> mysqlclient =
>
> [debug]
> chunklimit = -1
>
> [table]
> subchunked = Object
> partitioncols =
> Object:ra_PS,decl_PS,objectId;Source:raObject,declObject,objectId
> chunked = Source,FaintSource
> alloweddbs =
> LSST,qservTest_case01_qserv,qservTest_case02_qserv,qservTest_case03_qserv
>
> [metaServer]
> passwd = qmsPass
> host = localhost
> port = 7082
> user = qms
>
> [resultdb]
> dropmem =
> passwd =
> db = qservResult
> unix_socket = /qserv/qserv-newparser/var/lib/mysql/mysql.sock
> host =
> user = qsmaster
> port = 0
>
> contents: xmlrpc_check xmlrpc_echo xmlrpc_help xmlrpc_initMetadataCache
> xmlrpc_joinQuery xmlrpc_query xmlrpc_queryNow xmlrpc_reset
> xmlrpc_resultTableString xmlrpc_results xmlrpc_stop xmlrpc_submitQuery
> xmlrpc_submitQueryPlain xmlrpc_submitQueryWithLock
>
>
> Metadata Cache in C++:
> db: LSST: is partitioned (nStripes=120, nSubStripes=9, defOvF=0,
> defOvNN=0.025).
> Tables:
> Object: is partitioned (overlap=0.025, phiCol=ra_PS,
> thetaCol=decl_PS, objIdCol=objectId, phiColNo=2, thetaColNo=4,
> objIdColNo=0, logPart=2, physChunking=33).
>
> Source: is partitioned (overlap=0, phiCol=ra, thetaCol=decl,
> objIdCol=objectId, phiColNo=6, thetaColNo=9, objIdColNo=3, logPart=1,
> physChunking=17).
>
>
>
> Starting Qserv interface on port: 7080
>
>
>
> AliasMap fwd() rev()
> Found ref:Table(.Object)
> Adding orsibs: COMP_PREDICATE FACTOR COLUMN_REF objectId = FACTOR
> 154062577146538502
> Parsed value expression for select list.
> *
> SELECT * FROM Object WHERE objectId=154062577146538502
> Testing
> aggr origlist: *,
> pass: *
> fixup:
> parallel: SELECT * FROM LSST.Object_%CC% AS QST_1_ WHERE
> objectId=154062577146538502
> merge: SELECT
> Using 120 stripes and 9 substripes.
> constraint= <lsst.qserv.master.masterLib.Constraint; proxy of <Swig
> Object of type 'lsst::qserv::master::Constraint *' at 0x1bba180> >
> Looking for indexhints in [('sIndex', ['LSST', 'Object', 'objectId',
> '154062577146538502'])]
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> operational error, retrying (1054, "Unknown column 'chunkId' in 'field
> list'")
> Too many SQL failures, not retrying.
> cids are None
> Unexpected error: (<type 'exceptions.TypeError'>, TypeError('argument 2
> to map() must support iteration',), <traceback object at 0x1762200>)
> Traceback
> (most recent call last):
> File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 409, in __init__
> self._prepareForExec()
> File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 458, in _prepareForExec
> self._applyConstraints()
> File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 516, in _applyConstraints
> self._evaluateHints(dominantDb, self.hintList, self.pmap)
> File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 469, in _evaluateHints
> indexRegions = self._computeIndexRegions(hintList)
> File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 605, in _computeIndexRegions
> : chunkIds = index.lookup(lookups)
> File
> "/home/qserv/src/qserv/newMaster2/dist/lsst/qserv/master/app.py", line
> 369, in lookup
> cids = map(lambda t: t[0], cids)
> TypeError: argument 2 to map() must support iteration
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
