Hi Andy,
Your fix seems to have some positive effect, thanks. Nevertheless i
still run in some problems (ccqserv132 data seems corrupted, maybe
because of original data transfer from ccqserv007).
Hope it'll work...
On 11/20/2015 10:50 PM, Fabrice Jammes wrote:
> Thanks so much Andy, I let you know soon.
> Shall we create a ticket for this? Data migration is cost-effective
> and we may track it?
>
> FYI I'm running qserv from master branch commit n°
> 25295192bddaec16ed080a531b9fbe45bf62e377
>
> Have a nice day :-)
>
> On 11/20/2015 10:14 PM, Salnikov, Andrei A. wrote:
>> Hi Fabrice,
>>
>> I'm attaching a modified script that you need to re-run to
>> update CSS. I needs to be run on a czar node and you
>> need to setup Qserv as you normally do. It should remove
>> and re-create CSS in a format which is recognizable by most
>> recent CSS version.
>>
>> It assumes that mysql server with CSS runs on port 13306,
>> if younfiguration is different then you may need to update
>> this string in a script:
>>
>> connInfo = 'mysql:[log in to unmask]:13306/qservCssData'
>>
>>
>> Let me know how it works.
>>
>> Cheers,
>> Andy
>>
>> Fabrice Jammes wrote on 2015-11-20:
>>> I used master branch tip from tuesday.
>>>
>>> Cheers,
>>>
>>> Fabrice
>>>
>>> On 11/20/2015 07:10 PM, Salnikov, Andrei A. wrote:
>>>> Hi Fabrice,
>>>>
>>>> which Qserv version do we currently have there, does it include
>>>> DM-4138 or is it released 2015_10.0?
>>>>
>>>> Cheers,
>>>> Andy
>>>>
>>>> Fabrice Jammes wrote on 2015-11-20:
>>>>> Hi Andy,
>>>>>
>>>>> Docker install is still beta but I have something running on in2p3
>>>>> cluster.
>>>>>
>>>>> (to log to docker instance running qserv
>>>>>
>>>>> ssh ccqserv125.in2p3.fr
>>>>> sudo -u qserv bash
>>>>> docker exec -it --rm qserv bash
>>>>> ls /qserv
>>>>>
>>>>> )
>>>>>
>>>>> Nevertheless they're might be an inconsistency in CSS data:
>>>>>
>>>>> Next query:
>>>>>
>>>>> time mysql --host ccqserv125 --port 4040 --user qsmaster LSST -e
>>>>> "select count(*) from Object;"; ERROR 4110 (Proxy) at line 1: Query
>>>>> processing error: 'Unknown failure occured setting up QuerySession
>>>>> (query is invalid).'
>>>>>
>>>>> real 0m0.035s
>>>>> user 0m0.006s
>>>>> sys 0m0.013s
>>>>>
>>>>>
>>>>> produce error log below in Qserv czar, would you have an idea please?
>>>>>
>>>>> 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR css.CssAccess
>>>>> (core/modules/css/CssAccess.cc:978) - unpackJson error: <unspecified
>>>>> file>(1): invalid code sequence data="{"compression": "0", "match":
>>>>> "0", "schema": "(
>>>>> `deepSourceId` bigint(20) NOT NULL,
>>>>> `ra` double NOT NULL,
>>>>> `decl` double NOT NULL,
>>>>> `raVar` double DEFAULT NULL,
>>>>> `declVar` double DEFAULT NULL,
>>>>> `radeclCov` double DEFAULT NULL,
>>>>> `chunkId` int(11) NOT NULL,
>>>>> `subChunkId` int(11) NOT NULL,
>>>>> `u_psfFlux` double DEFAULT NULL,
>>>>> `u_psfFluxSigma` double DEFAULT NULL,
>>>>> `u_apFlux` double DEFAULT NULL,
>>>>> `u_apFluxSigma` double DEFAULT NULL,
>>>>> `u_modelFlux` double DEFAULT NULL,
>>>>> `u_modelFluxSigma` double DEFAULT NULL,
>>>>> `u_instFlux` double DEFAULT NULL,
>>>>> `u_instFluxSigma` double DEFAULT NULL,
>>>>> `u_apCorrection` double DEFAULT NULL,
>>>>> `u_apCorrectionSigma` double DEFAULT NULL,
>>>>> `u_shapeIx` double DEFAULT NULL,
>>>>> `u_shapeIy` double DEFAULT NULL,
>>>>> `u_shapeIxVar` double DEFAULT NULL,
>>>>> `u_shapeIyVar` double DEFAULT NULL,
>>>>> `u_shapeIxIyCov` double DEFAULT NULL,
>>>>> `u_shapeIxx` double DEFAULT NULL,
>>>>> `u_shapeIyy` double DEFAULT NULL,
>>>>> `u_shapeIxy` double DEFAULT NULL,
>>>>> `u_shapeIxxVar` double DEFAULT NULL,
>>>>> `u_shapeIyyVar` double DEFAULT NULL,
>>>>> `u_shapeIxyVar` double DEFAULT NULL,
>>>>> `u_shapeIxxIyyCov` double DEFAULT NULL,
>>>>> `u_shapeIxxIxyCov` double DEFAULT NULL,
>>>>> `u_shapeIyyIxyCov` double DEFAULT NULL,
>>>>> `u_extendedness` double DEFAULT NULL,
>>>>> `u_flagNegative` bit(1) DEFAULT NULL,
>>>>> `u_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>> `u_flagPixEdge` bit(1) DEFAULT NULL,
>>>>> `u_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>> `u_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>> `u_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>> `u_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>> `u_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>> `u_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>> `u_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>> `u_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>> `u_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>> `u_flagBadShape` bit(1) DEFAULT NULL,
>>>>> `g_psfFlux` double DEFAULT NULL,
>>>>> `g_psfFluxSigma` double DEFAULT NULL,
>>>>> `g_apFlux` double DEFAULT NULL,
>>>>> `g_apFluxSigma` double DEFAULT NULL,
>>>>> `g_modelFlux` double DEFAULT NULL,
>>>>> `g_modelFluxSigma` double DEFAULT NULL,
>>>>> `g_instFlux` double DEFAULT NULL,
>>>>> `g_instFluxSigma` double DEFAULT NULL,
>>>>> `g_apCorrection` double DEFAULT NULL,
>>>>> `g_apCorrectionSigma` double DEFAULT NULL,
>>>>> `g_shapeIx` double DEFAULT NULL,
>>>>> `g_shapeIy` double DEFAULT NULL,
>>>>> `g_shapeIxVar` double DEFAULT NULL,
>>>>> `g_shapeIyVar` double DEFAULT NULL,
>>>>> `g_shapeIxIyCov` double DEFAULT NULL,
>>>>> `g_shapeIxx` double DEFAULT NULL,
>>>>> `g_shapeIyy` double DEFAULT NULL,
>>>>> `g_shapeIxy` double DEFAULT NULL,
>>>>> `g_shapeIxxVar` double DEFAULT NULL,
>>>>> `g_shapeIyyVar` double DEFAULT NULL,
>>>>> `g_shapeIxyVar` double DEFAULT NULL,
>>>>> `g_shapeIxxIyyCov` double DEFAULT NULL,
>>>>> `g_shapeIxxIxyCov` double DEFAULT NULL,
>>>>> `g_shapeIyyIxyCov` double DEFAULT NULL,
>>>>> `g_extendedness` double DEFAULT NULL,
>>>>> `g_flagNegative` bit(1) DEFAULT NULL,
>>>>> `g_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>> `g_flagPixEdge` bit(1) DEFAULT NULL,
>>>>> `g_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>> `g_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>> `g_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>> `g_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>> `g_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>> `g_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>> `g_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>> `g_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>> `g_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>> `g_flagBadShape` bit(1) DEFAULT NULL,
>>>>> `r_psfFlux` double DEFAULT NULL,
>>>>> `r_psfFluxSigma` double DEFAULT NULL,
>>>>> `r_apFlux` double DEFAULT NULL,
>>>>> `r_apFluxSigma` double DEFAULT NULL,
>>>>> `r_modelFlux` double DEFAULT NULL,
>>>>> `r_modelFluxSigma` double DEFAULT NULL,
>>>>> `r_instFlux` double DEFAULT NULL,
>>>>> `r_instFluxSigma` double DEFAULT NULL,
>>>>> `r_apCorrection` double DEFAULT NULL,
>>>>> `r_apCorrectionSigma` double DEFAULT NULL,
>>>>> `r_shapeIx` double DEFAULT NULL,
>>>>> `r_shapeIy` double DEFAULT NULL,
>>>>> `r_shapeIxVar` double DEFAULT NULL,
>>>>> `r_shapeIyVar` double DEFAULT NULL,
>>>>> `r_shapeIxIyCov` double DEFAULT NULL,
>>>>> `r_shapeIxx` double DEFAULT NULL,
>>>>> `r_shapeIyy` double DEFAULT NULL,
>>>>> `r_shapeIxy` double DEFAULT NULL,
>>>>> `r_shapeIxxVar` double DEFAULT NULL,
>>>>> `r_shapeIyyVar` double DEFAULT NULL,
>>>>> `r_shapeIxyVar` double DEFAULT NULL,
>>>>> `r_shapeIxxIyyCov` double DEFAULT NULL,
>>>>> `r_shapeIxxIxyCov` double DEFAULT NULL,
>>>>> `r_shapeIyyIxyCov` double DEFAULT NULL,
>>>>> `r_extendedness` double DEFAULT NULL,
>>>>> `r_flagNegative` bit(1) DEFAULT NULL,
>>>>> `r_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>> `r_flagPixEdge` bit(1) DEFAULT NULL,
>>>>> `r_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>> `r_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>> `r_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>> `r_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>> `r_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>> `r_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>> `r_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>> `r_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>> `r_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>> `r_flagBadShape` bit(1) DEFAULT NULL,
>>>>> `i_psfFlux` double DEFAULT NULL,
>>>>> `i_psfFluxSigma` double DEFAULT NULL,
>>>>> `i_apFlux` double DEFAULT NULL,
>>>>> `i_apFluxSigma` double DEFAULT NULL,
>>>>> `i_modelFlux` double DEFAULT NULL,
>>>>> `i_modelFluxSigma` double DEFAULT NULL,
>>>>> `i_instFlux` double DEFAULT NULL,
>>>>> `i_instFluxSigma` double DEFAULT NULL,
>>>>> `i_apCorrection` double DEFAULT NULL,
>>>>> `i_apCorrectionSigma` double DEFAULT NULL,
>>>>> `i_shapeIx` double DEFAULT NULL,
>>>>> `i_shapeIy` double DEFAULT NULL,
>>>>> `i_shapeIxVar` double DEFAULT NULL,
>>>>> `i_shapeIyVar` double DEFAULT NULL,
>>>>> `i_shapeIxIyCov` double DEFAULT NULL,
>>>>> `i_shapeIxx` double DEFAULT NULL,
>>>>> `i_shapeIyy` double DEFAULT NULL,
>>>>> `i_shapeIxy` double DEFAULT NULL,
>>>>> `i_shapeIxxVar` double DEFAULT NULL,
>>>>> `i_shapeIyyVar` double DEFAULT NULL,
>>>>> `i_shapeIxyVar` double DEFAULT NULL,
>>>>> `i_shapeIxxIyyCov` double DEFAULT NULL,
>>>>> `i_shapeIxxIxyCov` double DEFAULT NULL,
>>>>> `i_shapeIyyIxyCov` double DEFAULT NULL,
>>>>> `i_extendedness` double DEFAULT NULL,
>>>>> `i_flagNegative` bit(1) DEFAULT NULL,
>>>>> `i_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>> `i_flagPixEdge` bit(1) DEFAULT NULL,
>>>>> `i_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>> `i_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>> `i_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>> `i_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>> `i_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>> `i_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>> `i_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>> `i_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>> `i_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>> `i_flagBadShape` bit(1) DEFAULT NULL,
>>>>> `z_psfFlux` double DEFAULT NULL,
>>>>> `z_psfFluxSigma` double DEFAULT NULL,
>>>>> `z_apFlux` double DEFAULT NULL,
>>>>> `z_apFluxSigma` double DEFAULT NULL,
>>>>> `z_modelFlux` double DEFAULT NULL,
>>>>> `z_modelFluxSigma` double DEFAULT NULL,
>>>>> `z_instFlux` double DEFAULT NULL,
>>>>> `z_instFluxSigma` double DEFAULT NULL,
>>>>> `z_apCorrection` double DEFAULT NULL,
>>>>> `z_apCorrectionSigma` double DEFAULT NULL,
>>>>> `z_shapeIx` double DEFAULT NULL,
>>>>> `z_shapeIy` double DEFAULT NULL,
>>>>> `z_shapeIxVar` double DEFAULT NULL,
>>>>> `z_shapeIyVar` double DEFAULT NULL,
>>>>> `z_shapeIxIyCov` double DEFAULT NULL,
>>>>> `z_shapeIxx` double DEFAULT NULL,
>>>>> `z_shapeIyy` double DEFAULT NULL,
>>>>> `z_shapeIxy` double DEFAULT NULL,
>>>>> `z_shapeIxxVar` double DEFAULT NULL,
>>>>> `z_shapeIyyVar` double DEFAULT NULL,
>>>>> `z_shapeIxyVar` double DEFAULT NULL,
>>>>> `z_shapeIxxIyyCov` double DEFAULT NULL,
>>>>> `z_shapeIxxIxyCov` double DEFAULT NULL,
>>>>> `z_shapeIyyIxyCov` double DEFAULT NULL,
>>>>> `z_extendedness` double DEFAULT NULL,
>>>>> `z_flagNegative` bit(1) DEFAULT NULL,
>>>>> `z_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>> `z_flagPixEdge` bit(1) DEFAULT NULL,
>>>>> `z_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>> `z_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>> `z_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>> `z_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>> `z_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>> `z_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>> `z_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>> `z_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>> `z_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>> `z_flagBadShape` bit(1) DEFAULT NULL,
>>>>> `y_psfFlux` double DEFAULT NULL,
>>>>> `y_psfFluxSigma` double DEFAULT NULL,
>>>>> `y_apFlux` double DEFAULT NULL,
>>>>> `y_apFluxSigma` double DEFAULT NULL,
>>>>> `y_modelFlux` double DEFAULT NULL,
>>>>> `y_modelFluxSigma` double DEFAULT NULL,
>>>>> `y_instFlux` double DEFAULT NULL,
>>>>> `y_instFluxSigma` double DEFAULT NULL,
>>>>> `y_apCorrection` double DEFAULT NULL,
>>>>> `y_apCorrectionSigma` double DEFAULT NULL,
>>>>> `y_shapeIx` double DEFAULT NULL,
>>>>> `y_shapeIy` double DEFAULT NULL,
>>>>> `y_shapeIxVar` double DEFAULT NULL,
>>>>> `y_shapeIyVar` double DEFAULT NULL,
>>>>> `y_shapeIxIyCov` double DEFAULT NULL,
>>>>> `y_shapeIxx` double DEFAULT NULL,
>>>>> `y_shapeIyy` double DEFAULT NULL,
>>>>> `y_shapeIxy` double DEFAULT NULL,
>>>>> `y_shapeIxxVar` double DEFAULT NULL,
>>>>> `y_shapeIyyVar` double DEFAULT NULL,
>>>>> `y_shapeIxyVar` double DEFAULT NULL,
>>>>> `y_shapeIxxIyyCov` double DEFAULT NULL,
>>>>> `y_shapeIxxIxyCov` double DEFAULT NULL,
>>>>> `y_shapeIyyIxyCov` double DEFAULT NULL,
>>>>> `y_extendedness` double DEFAULT NULL,
>>>>> `y_flagNegative` bit(1) DEFAULT NULL,
>>>>> `y_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>> `y_flagPixEdge` bit(1) DEFAULT NULL,
>>>>> `y_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>> `y_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>> `y_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>> `y_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>> `y_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>> `y_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>> `y_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>> `y_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>> `y_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>> `y_flagBadShape` bit(1) DEFAULT NULL,
>>>>> PRIMARY KEY (`deepSourceId`),
>>>>> KEY `subChunkId` (`subChunkId`)
>>>>> )"}" 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR
>>>>> ccontrol.UserQueryFactory
>>>>> (core/modules/ccontrol/UserQueryFactory.cc:97) - Unknown failure
>>>>> occured setting up QuerySession (query is invalid).
>>>>> 2015-11-20T14:12:27.774Z [0x7f80d06d1700] INFO root
>>>>> (core/modules/ccontrol/UserQuery.cc:275) - Discarded UserQuery(2)
>>>>> 2015-11-20T14:12:27.777Z [0x7f80d06d1700] ERROR root
>>>>> (appInterface.py:138) - Returning error to proxy: ("'Unknown failure
>>>>> occured setting up QuerySession (query is invalid).'", False, False,
>>>>> False)
>>>>
>>>> ########################################################################
>>>>
>>>> Use REPLY-ALL to reply to list
>>>>
>>>> To unsubscribe from the QSERV-L list, click the following link:
>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>>
>
> ########################################################################
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the QSERV-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
|