[log in to unmask]" type="cite">OK, let's work on resolving this. I think the real issue is that getResponseData wants you to piece the buffers together and we can fix that. Let's get together so I completely understand what you are doing.
Andy
On Wed, 11 Feb 2015, Daniel L Wang wrote:
Yes, this is one of the 2mb buffer problems.
(typed on a small touch screen)
On Feb 11, 2015 7:29 PM, Tatiana Goldina <[log in to unmask]> wrote:
This is the tail from czar.log - I hope it would help to see what is wrong.
0211 19:23:21.662 [0x7fcb535fe700] DEBUG root (build/qproc/TaskMsgFactory2.cc:154) - SELECT * FROM LSST.Science_Ccd_Exposure AS QST_1_ WHERE scisql_s2PtInCircle(ra,decl,0.5,1.0,0.5)=1 LIMIT 3000
0211 19:23:21.662 [0x7fcb535fe700] DEBUG root (build/qdisp/Executive.cc:397) - Executive (0x2bf3d80) tracking id=1
0211 19:23:21.662 [0x7fcb535fe700] INFO root (build/qdisp/Executive.cc:173) - Exec add pth=/chk/LSST/1234567890
0211 19:23:21.662 [0x7fcb535fe700] DEBUG root (build/qdisp/MessageStore.cc:49) - Msg: 1234567890 1200 Exec add pth=/chk/LSST/1234567890
Opening xroot://127.0.0.1:1094//chk/LSST/1234567890
0211 19:23:21.662 [0x7fcb535fe700] DEBUG root (build/qdisp/Executive.cc:338) - Provision was ok
0211 19:23:21.663 [0x7fcb3ebfd700] INFO root (build/qdisp/QueryResource.cc:56) - Provision done
0211 19:23:21.663 [0x7fcb3ebfd700] INFO root (build/qdisp/QueryRequest.cc:89) - New QueryRequest with payload(182)
0211 19:23:21.663 [0x7fcb3ebfd700] DEBUG root (build/qdisp/QueryRequest.cc:99) - Requesting, payload size: [182]
Task=0x7fcb28dab640 processing id=0
0211 19:23:21.663 [0x7fcb535fe700] INFO root (app.py:565) - Query dispatch (7) took 0.003240 seconds
0211 19:23:21.663 [0x7fcb535fe700] INFO root (build/qdisp/Executive.cc:484) - Still 1 in flight.
Task 0x7fcb28dab640 sess=ok Status = 1 isWrite
Task Handler calling RelBuff.
0211 19:23:21.704 [0x7fcb3f5fe700] DEBUG root (build/qdisp/QueryRequest.cc:105) - Early release of request buffer
Task Handler calling trunc.
Task 0x7fcb28dab640 sess=ok Status = 1 isSync
Task Handler responding with stream.
0211 19:23:21.913 [0x7fcb3ebfd700] INFO root (build/qdisp/QueryRequest.cc:148) - GetResponseData with buffer of 0
Task 0x7fcb28dab640 SetBuff Async Status=isReady
0211 19:23:21.913 [0x7fcb3ebfd700] INFO root (build/qdisp/QueryRequest.cc:150) - Initiated request ok
Task 0x7fcb28dab640 sess=ok Status = 1 isReady
Task Handler calling ProcessResponseData.
0211 19:23:21.914 [0x7fcb3f5fe700] INFO root (build/qdisp/QueryRequest.cc:180) - ProcessResponse[data] with buflen=1 (more)
Task 0x7fcb28dab640 SetBuff Async Status=isReady
Task 0x7fcb28dab640 sess=ok Status = 1 isReady
Task Handler calling ProcessResponseData.
0211 19:23:21.916 [0x7fcb3ffff700] INFO root (build/qdisp/QueryRequest.cc:180) - ProcessResponse[data] with buflen=25 (more)
Task 0x7fcb28dab640 SetBuff Async Status=isReady
Task 0x7fcb28dab640 sess=ok Status = 1 isReady
Task Handler calling ProcessResponseData.
0211 19:23:21.925 [0x7fcb3ebfd700] INFO root (build/qdisp/QueryRequest.cc:180) - ProcessResponse[data] with buflen=2097152 (last)
0211 19:23:21.925 [0x7fcb3ebfd700] ERROR root (build/ccontrol/MergingRequester.cc:70) - MergingRequester size mismatch: expected 2378306 got 2097152
0211 19:23:26.663 [0x7fcb535fe700] INFO root (build/qdisp/Executive.cc:432) - Executive (0x2bf3d80) REAPED id=1
0211 19:23:31.664 [0x7fcb535fe700] INFO root (build/qdisp/Executive.cc:189) - entry state:0x7fcb400360c0 Resource(/chk/LSST/1234567890): 20150211-19:23:21, Error merging result, 1420, Result message MD5 mismatch)
0211 19:23:31.664 [0x7fcb535fe700] INFO root (build/qdisp/Executive.cc:194) - Query exec finish. 1 dispatched.
0211 19:23:31.664 [0x7fcb535fe700] DEBUG root (build/qdisp/MessageStore.cc:49) - Msg: 1234567890 1215 Error merging result 1420 (Result message MD5 mismatch) 1423711401
0211 19:23:31.664 [0x7fcb535fe700] INFO root (build/qdisp/Executive.cc:197) - Query exec error:. 1 != 0
0211 19:23:31.664 [0x7fcb535fe700] INFO root (build/rproc/InfileMerger.cc:325) - Merged qservResult.result_4492663602 into qservResult.result_4492663602
0211 19:23:31.664 [0x7fcb535fe700] ERROR root (build/ccontrol/UserQuery.cc:221) - Joined everything (failure!)
0211 19:23:31.665 [0x7fcb535fe700] INFO root (app.py:569) - Query exec (7) took 10.001105 seconds
0211 19:23:31.665 [0x7fcb535fe700] ERROR root (build/qdisp/Executive.cc:307) - Ref=1 Resource(/chk/LSST/1234567890): 20150211-19:23:21, Error merging result, 1420, Result message MD5 mismatch
0211 19:23:31.666 [0x7fcb535fe700] DEBUG root (app.py:389) - reporting -1 -1 Ref=1 Resource(/chk/LSST/1234567890): 20150211-19:23:21, Error merging result, 1420, Result message MD5 mismatch
0211 19:23:31.666 [0x7fcb535fe700] ERROR root (build/qdisp/MessageStore.cc:47) - Msg: -1 -1 Ref=1 Resource(/chk/LSST/1234567890): 20150211-19:23:21, Error merging result, 1420, Result message MD5 mismatch
0211 19:23:31.667 [0x7fcb535fe700] INFO root (app.py:574) - Final state of all queries error
0211 19:23:31.668 [0x7fcb521fc700] INFO root (build/ccontrol/UserQuery.cc:251) - Discarded UserQuery(7)
On Feb 11, 2015, at 2:36 PM, Fabrice Jammes <[log in to unmask]> wrote:
Hi Tatiana,
I think you're right. The 2MB xrootd can produce this error message.
qserv-czar.log produce more accurate information, but I don't know if you can access it?
Cheers,
Fabrice
On 02/11/2015 02:23 PM, Tatiana Goldina wrote:
I don't think I saw this error before, but it may be related to 2MB xroot limit (DM-1847). If the limit is lower, I do get the data.
sql> select * from Science_Ccd_Exposure where scisql_s2PtInCircle(ra, decl, 0.5, 1.0, 0.5)=1 LIMIT 3000
[2015-02-11 13:43:17] [42S02][1051] Unknown table 'result_4414650179'
[2015-02-11 13:43:17] [Proxy][4120] Error during execution:
-1 Ref=1 Resource(/chk/qservTest_caseSUI_qserv/1234567890): 20150211-13:43:06, Error merging result, 1420, Result message MD5 mismatch (-1)
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
--
BEGIN-ANTISPAM-VOTING-LINKS
------------------------------------------------------
Teach CanIt if this mail (ID 04NPaAUBC) is spam:
Spam: https://canit.ipac.caltech.edu/canit/b.php?i=04NPaAUBC&m=b93d2877e507&c=s
Not spam: https://canit.ipac.caltech.edu/canit/b.php?i=04NPaAUBC&m=b93d2877e507&c=n
Forget vote: https://canit.ipac.caltech.edu/canit/b.php?i=04NPaAUBC&m=b93d2877e507&c=f
------------------------------------------------------
END-ANTISPAM-VOTING-LINKS
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1