 |
 |
Hey guys, If on looking into this you see an uncaught/unprocessed error handling path after a failed query on the xrootd node is the cause, I have an almost-ready-to-go change from before the break that addresses that and some attendant reporting issues back up the chain. Let me know if that turns out to be the case, and I can at least put up what I have in its current state for people to borrow from. (I had wanted to add regression/unit tests and clean up a little before putting it up for general review.) --FritzM. > On Jan 7, 2015, at 9:58 PM, Serge Monkewitz <[log in to unmask]> wrote: > > Jacek, > > Try logging in to lsst-db1.ipac.caltech.edu. If you can get in, the stack is in /home/lsstadm/stack, qserv is in /home/lsstadm/qserv, and the run directory is /db1/run/qserv-master. > > However, note that Tatiana also requested that I upgrade qserv to tip of master. I tried, but master doesn’t build for me. I’m in the process of installing a fresh stack to see if it helps. Once I’m up and running again, I’ll see if we can reproduce with the latest code. > > Cheers, > Serge > >> On Jan 7, 2015, at 9:49 PM, Jacek Becla <[log in to unmask]> wrote: >> >> Hmm.... I have an account at ipac now, so >> a) if you can tell me how to reproduce it (e.g., where >> do I find qserv you are talking to etc), and >> b) if someone tells me where to log in (I didn't try >> to log in to ipac machines yet), >> >> I will look into that. >> >> Jacek >> >> >> >>> On 01/07/2015 04:41 PM, Tatiana Goldina wrote: >>> Hello, >>> >>> I noticed that xrootd is failing quite consistently when I am trying to constrain an area to a polygon: >>> select * from DeepSource where scisql_s2PtInPoly(ra, decl, 0.4, 1.0, 0.4, 1.2, 0.6, 1.2, 0.6, 1.0) = 1; >>> >>> Last time I was trying various spatial constraints. xrootd died at the polygon test. >>> >>> Are there any pointers to what is wrong? >>> >>> Thank you! >>> >>> Tatiana >>> >>> 1. select * from DeepSource where scisql_s2PtInCircle(ra, decl, 0.5, 1.1, 0.2) = 1; >>> ERROR 4120 (Proxy): Error during execution: >>> -1 Ref=1 Resource(/chk/LSST/6970): 20150107-15:59:54, Complete (success), 0, >>> Ref=2 Resource(/chk/LSST/7138): 20150107-15:59:54, Complete (success), 0, >>> Ref=3 Resource(/chk/LSST/7140): 20150107-15:59:54, Complete (success), 0, >>> Ref=4 Resource(/chk/LSST/7308) (-1) >>> >>> 2. select * from DeepSource where scisql_s2PtInBox(ra, decl, 0.4, 1.0, 0.6, 1.2) = 1; >>> 2027 rows in set (0.53 sec) >>> >>> 3. select * from DeepSource where scisql_s2PtInPoly(ra, decl, 0.4, 1.0, 0.4, 1.2, 0.6, 1.2, 0.6, 1.0) = 1; >>> never returned >>> >>> The report from qserv-status.sh >>> >>> INFO: Qserv execution directory : /db1/run/qserv-master >>> MySQL running (4049) [ OK ] >>> xrootd is dead but PID file exists [FAILED] >>> see /db1/run/qserv-master/var/run/worker/xrootd.pid >>> ZooKeeper daemon is running (4110) [ OK ] >>> mysql-proxy is running (4137) [ OK ] >>> qserv-czar is running (4149) [ OK ] >>> >>> This is the tail of var/log/qserv-czar.log >>> >>> 0107 16:07:02.153 [0x7f6552bfd700] DEBUG root (build/qdisp/QueryRequest.cc:97) - Requesting [193]LSST?9"LSST.DeepSource*? >>> oSELECT * FROM LSST.DeepSource_7310 AS QST_1_ WHERE scisql_s2PtInPoly(ra,decl,0.4,1.0,0.4,1.2,0.6,1.2,0.6,1.0)=1+r_18be7db4d2025f994bda94973d3b4770d5_7310_0"Task=0x7 >>> f653c234480 processing id=0 >>> Task 0x7f653cae9c00 sess=ok Status = 1 isWrite >>> Task Handler calling RelBuff. >>> 0107 16:07:02.153 [0x7f6552bfd700] DEBUG root (build/qdisp/QueryRequest.cc:103) - Early release of request buffer >>> Task Handler calling trunc. >>> Task 0x7f653c234480 sess=ok Status = 1 isWrite >>> Task Handler calling RelBuff. >>> 0107 16:07:02.154 [0x7f65535fe700] DEBUG root (build/qdisp/QueryRequest.cc:103) - Early release of request buffer >>> Task Handler calling trunc. >>> Task 0x7f653c234480 sess=ok Status = 0 isSync >>> 0107 16:15:02.522 [0x7f65657fb700] ERROR root (build/ccontrol/MergingRequester.cc:129) - Error receiving result. >>> 0107 16:15:02.522 [0x7f65657fb700] DEBUG root (build/qdisp/QueryRequest.cc:208) - Error finish >>> Session Complete: cancel=0 task=ok >>> Task 0x7f653c234480 Kill status = isDone mhpend=0 >>> RelTask dodel=0 id=0 >>> 0107 16:15:02.522 [0x7f65657fb700] INFO root (build/qdisp/QueryRequest.cc:213) - Request::Finished() with error (clean). >>> Opening xroot://127.0.0.1:1094//chk/LSST/7310 >>> 0107 16:15:02.522 [0x7f65657fb700] ERROR root (build/qdisp/Executive.cc:328) - Resource provision error /chk/LSST/7310 >>> 0107 16:15:02.522 [0x7f65657fb700] INFO root (build/qdisp/Executive.cc:416) - Executive (0x2f16380) UNTRACKING id=5 >>> 0107 16:15:02.522 [0x7f65657fb700] DEBUG root (build/qdisp/Executive.cc:334) - Provision was ok >>> 0107 16:15:07.124 [0x7f65675fe700] INFO root (build/qdisp/Executive.cc:480) - Still 4 in flight. >>> ######################################################################## >>> Use REPLY-ALL to reply to list >>> >>> To unsubscribe from the QSERV-L list, click the following link: >>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 >> >> ######################################################################## >> Use REPLY-ALL to reply to list >> >> To unsubscribe from the QSERV-L list, click the following link: >> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 > > ######################################################################## > Use REPLY-ALL to reply to list > > To unsubscribe from the QSERV-L list, click the following link: > https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1