Thanks so much Andy, I let you know soon.
Shall we create a ticket for this? Data migration is cost-effective and
we may track it?
FYI I'm running qserv from master branch commit n°
25295192bddaec16ed080a531b9fbe45bf62e377
Have a nice day :-)
On 11/20/2015 10:14 PM, Salnikov, Andrei A. wrote:
> Hi Fabrice,
>
> I'm attaching a modified script that you need to re-run to
> update CSS. I needs to be run on a czar node and you
> need to setup Qserv as you normally do. It should remove
> and re-create CSS in a format which is recognizable by most
> recent CSS version.
>
> It assumes that mysql server with CSS runs on port 13306,
> if younfiguration is different then you may need to update
> this string in a script:
>
> connInfo = 'mysql:[log in to unmask]:13306/qservCssData'
>
>
> Let me know how it works.
>
> Cheers,
> Andy
>
> Fabrice Jammes wrote on 2015-11-20:
>> I used master branch tip from tuesday.
>>
>> Cheers,
>>
>> Fabrice
>>
>> On 11/20/2015 07:10 PM, Salnikov, Andrei A. wrote:
>>> Hi Fabrice,
>>>
>>> which Qserv version do we currently have there, does it include
>>> DM-4138 or is it released 2015_10.0?
>>>
>>> Cheers,
>>> Andy
>>>
>>> Fabrice Jammes wrote on 2015-11-20:
>>>> Hi Andy,
>>>>
>>>> Docker install is still beta but I have something running on in2p3
>>>> cluster.
>>>>
>>>> (to log to docker instance running qserv
>>>>
>>>> ssh ccqserv125.in2p3.fr
>>>> sudo -u qserv bash
>>>> docker exec -it --rm qserv bash
>>>> ls /qserv
>>>>
>>>> )
>>>>
>>>> Nevertheless they're might be an inconsistency in CSS data:
>>>>
>>>> Next query:
>>>>
>>>> time mysql --host ccqserv125 --port 4040 --user qsmaster LSST -e
>>>> "select count(*) from Object;"; ERROR 4110 (Proxy) at line 1: Query
>>>> processing error: 'Unknown failure occured setting up QuerySession
>>>> (query is invalid).'
>>>>
>>>> real 0m0.035s
>>>> user 0m0.006s
>>>> sys 0m0.013s
>>>>
>>>>
>>>> produce error log below in Qserv czar, would you have an idea please?
>>>>
>>>> 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR css.CssAccess
>>>> (core/modules/css/CssAccess.cc:978) - unpackJson error: <unspecified
>>>> file>(1): invalid code sequence data="{"compression": "0", "match":
>>>> "0", "schema": "(
>>>> `deepSourceId` bigint(20) NOT NULL,
>>>> `ra` double NOT NULL,
>>>> `decl` double NOT NULL,
>>>> `raVar` double DEFAULT NULL,
>>>> `declVar` double DEFAULT NULL,
>>>> `radeclCov` double DEFAULT NULL,
>>>> `chunkId` int(11) NOT NULL,
>>>> `subChunkId` int(11) NOT NULL,
>>>> `u_psfFlux` double DEFAULT NULL,
>>>> `u_psfFluxSigma` double DEFAULT NULL,
>>>> `u_apFlux` double DEFAULT NULL,
>>>> `u_apFluxSigma` double DEFAULT NULL,
>>>> `u_modelFlux` double DEFAULT NULL,
>>>> `u_modelFluxSigma` double DEFAULT NULL,
>>>> `u_instFlux` double DEFAULT NULL,
>>>> `u_instFluxSigma` double DEFAULT NULL,
>>>> `u_apCorrection` double DEFAULT NULL,
>>>> `u_apCorrectionSigma` double DEFAULT NULL,
>>>> `u_shapeIx` double DEFAULT NULL,
>>>> `u_shapeIy` double DEFAULT NULL,
>>>> `u_shapeIxVar` double DEFAULT NULL,
>>>> `u_shapeIyVar` double DEFAULT NULL,
>>>> `u_shapeIxIyCov` double DEFAULT NULL,
>>>> `u_shapeIxx` double DEFAULT NULL,
>>>> `u_shapeIyy` double DEFAULT NULL,
>>>> `u_shapeIxy` double DEFAULT NULL,
>>>> `u_shapeIxxVar` double DEFAULT NULL,
>>>> `u_shapeIyyVar` double DEFAULT NULL,
>>>> `u_shapeIxyVar` double DEFAULT NULL,
>>>> `u_shapeIxxIyyCov` double DEFAULT NULL,
>>>> `u_shapeIxxIxyCov` double DEFAULT NULL,
>>>> `u_shapeIyyIxyCov` double DEFAULT NULL,
>>>> `u_extendedness` double DEFAULT NULL,
>>>> `u_flagNegative` bit(1) DEFAULT NULL,
>>>> `u_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>> `u_flagPixEdge` bit(1) DEFAULT NULL,
>>>> `u_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>> `u_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>> `u_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>> `u_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>> `u_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>> `u_flagBadApFlux` bit(1) DEFAULT NULL,
>>>> `u_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>> `u_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>> `u_flagBadCentroid` bit(1) DEFAULT NULL,
>>>> `u_flagBadShape` bit(1) DEFAULT NULL,
>>>> `g_psfFlux` double DEFAULT NULL,
>>>> `g_psfFluxSigma` double DEFAULT NULL,
>>>> `g_apFlux` double DEFAULT NULL,
>>>> `g_apFluxSigma` double DEFAULT NULL,
>>>> `g_modelFlux` double DEFAULT NULL,
>>>> `g_modelFluxSigma` double DEFAULT NULL,
>>>> `g_instFlux` double DEFAULT NULL,
>>>> `g_instFluxSigma` double DEFAULT NULL,
>>>> `g_apCorrection` double DEFAULT NULL,
>>>> `g_apCorrectionSigma` double DEFAULT NULL,
>>>> `g_shapeIx` double DEFAULT NULL,
>>>> `g_shapeIy` double DEFAULT NULL,
>>>> `g_shapeIxVar` double DEFAULT NULL,
>>>> `g_shapeIyVar` double DEFAULT NULL,
>>>> `g_shapeIxIyCov` double DEFAULT NULL,
>>>> `g_shapeIxx` double DEFAULT NULL,
>>>> `g_shapeIyy` double DEFAULT NULL,
>>>> `g_shapeIxy` double DEFAULT NULL,
>>>> `g_shapeIxxVar` double DEFAULT NULL,
>>>> `g_shapeIyyVar` double DEFAULT NULL,
>>>> `g_shapeIxyVar` double DEFAULT NULL,
>>>> `g_shapeIxxIyyCov` double DEFAULT NULL,
>>>> `g_shapeIxxIxyCov` double DEFAULT NULL,
>>>> `g_shapeIyyIxyCov` double DEFAULT NULL,
>>>> `g_extendedness` double DEFAULT NULL,
>>>> `g_flagNegative` bit(1) DEFAULT NULL,
>>>> `g_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>> `g_flagPixEdge` bit(1) DEFAULT NULL,
>>>> `g_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>> `g_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>> `g_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>> `g_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>> `g_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>> `g_flagBadApFlux` bit(1) DEFAULT NULL,
>>>> `g_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>> `g_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>> `g_flagBadCentroid` bit(1) DEFAULT NULL,
>>>> `g_flagBadShape` bit(1) DEFAULT NULL,
>>>> `r_psfFlux` double DEFAULT NULL,
>>>> `r_psfFluxSigma` double DEFAULT NULL,
>>>> `r_apFlux` double DEFAULT NULL,
>>>> `r_apFluxSigma` double DEFAULT NULL,
>>>> `r_modelFlux` double DEFAULT NULL,
>>>> `r_modelFluxSigma` double DEFAULT NULL,
>>>> `r_instFlux` double DEFAULT NULL,
>>>> `r_instFluxSigma` double DEFAULT NULL,
>>>> `r_apCorrection` double DEFAULT NULL,
>>>> `r_apCorrectionSigma` double DEFAULT NULL,
>>>> `r_shapeIx` double DEFAULT NULL,
>>>> `r_shapeIy` double DEFAULT NULL,
>>>> `r_shapeIxVar` double DEFAULT NULL,
>>>> `r_shapeIyVar` double DEFAULT NULL,
>>>> `r_shapeIxIyCov` double DEFAULT NULL,
>>>> `r_shapeIxx` double DEFAULT NULL,
>>>> `r_shapeIyy` double DEFAULT NULL,
>>>> `r_shapeIxy` double DEFAULT NULL,
>>>> `r_shapeIxxVar` double DEFAULT NULL,
>>>> `r_shapeIyyVar` double DEFAULT NULL,
>>>> `r_shapeIxyVar` double DEFAULT NULL,
>>>> `r_shapeIxxIyyCov` double DEFAULT NULL,
>>>> `r_shapeIxxIxyCov` double DEFAULT NULL,
>>>> `r_shapeIyyIxyCov` double DEFAULT NULL,
>>>> `r_extendedness` double DEFAULT NULL,
>>>> `r_flagNegative` bit(1) DEFAULT NULL,
>>>> `r_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>> `r_flagPixEdge` bit(1) DEFAULT NULL,
>>>> `r_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>> `r_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>> `r_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>> `r_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>> `r_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>> `r_flagBadApFlux` bit(1) DEFAULT NULL,
>>>> `r_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>> `r_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>> `r_flagBadCentroid` bit(1) DEFAULT NULL,
>>>> `r_flagBadShape` bit(1) DEFAULT NULL,
>>>> `i_psfFlux` double DEFAULT NULL,
>>>> `i_psfFluxSigma` double DEFAULT NULL,
>>>> `i_apFlux` double DEFAULT NULL,
>>>> `i_apFluxSigma` double DEFAULT NULL,
>>>> `i_modelFlux` double DEFAULT NULL,
>>>> `i_modelFluxSigma` double DEFAULT NULL,
>>>> `i_instFlux` double DEFAULT NULL,
>>>> `i_instFluxSigma` double DEFAULT NULL,
>>>> `i_apCorrection` double DEFAULT NULL,
>>>> `i_apCorrectionSigma` double DEFAULT NULL,
>>>> `i_shapeIx` double DEFAULT NULL,
>>>> `i_shapeIy` double DEFAULT NULL,
>>>> `i_shapeIxVar` double DEFAULT NULL,
>>>> `i_shapeIyVar` double DEFAULT NULL,
>>>> `i_shapeIxIyCov` double DEFAULT NULL,
>>>> `i_shapeIxx` double DEFAULT NULL,
>>>> `i_shapeIyy` double DEFAULT NULL,
>>>> `i_shapeIxy` double DEFAULT NULL,
>>>> `i_shapeIxxVar` double DEFAULT NULL,
>>>> `i_shapeIyyVar` double DEFAULT NULL,
>>>> `i_shapeIxyVar` double DEFAULT NULL,
>>>> `i_shapeIxxIyyCov` double DEFAULT NULL,
>>>> `i_shapeIxxIxyCov` double DEFAULT NULL,
>>>> `i_shapeIyyIxyCov` double DEFAULT NULL,
>>>> `i_extendedness` double DEFAULT NULL,
>>>> `i_flagNegative` bit(1) DEFAULT NULL,
>>>> `i_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>> `i_flagPixEdge` bit(1) DEFAULT NULL,
>>>> `i_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>> `i_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>> `i_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>> `i_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>> `i_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>> `i_flagBadApFlux` bit(1) DEFAULT NULL,
>>>> `i_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>> `i_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>> `i_flagBadCentroid` bit(1) DEFAULT NULL,
>>>> `i_flagBadShape` bit(1) DEFAULT NULL,
>>>> `z_psfFlux` double DEFAULT NULL,
>>>> `z_psfFluxSigma` double DEFAULT NULL,
>>>> `z_apFlux` double DEFAULT NULL,
>>>> `z_apFluxSigma` double DEFAULT NULL,
>>>> `z_modelFlux` double DEFAULT NULL,
>>>> `z_modelFluxSigma` double DEFAULT NULL,
>>>> `z_instFlux` double DEFAULT NULL,
>>>> `z_instFluxSigma` double DEFAULT NULL,
>>>> `z_apCorrection` double DEFAULT NULL,
>>>> `z_apCorrectionSigma` double DEFAULT NULL,
>>>> `z_shapeIx` double DEFAULT NULL,
>>>> `z_shapeIy` double DEFAULT NULL,
>>>> `z_shapeIxVar` double DEFAULT NULL,
>>>> `z_shapeIyVar` double DEFAULT NULL,
>>>> `z_shapeIxIyCov` double DEFAULT NULL,
>>>> `z_shapeIxx` double DEFAULT NULL,
>>>> `z_shapeIyy` double DEFAULT NULL,
>>>> `z_shapeIxy` double DEFAULT NULL,
>>>> `z_shapeIxxVar` double DEFAULT NULL,
>>>> `z_shapeIyyVar` double DEFAULT NULL,
>>>> `z_shapeIxyVar` double DEFAULT NULL,
>>>> `z_shapeIxxIyyCov` double DEFAULT NULL,
>>>> `z_shapeIxxIxyCov` double DEFAULT NULL,
>>>> `z_shapeIyyIxyCov` double DEFAULT NULL,
>>>> `z_extendedness` double DEFAULT NULL,
>>>> `z_flagNegative` bit(1) DEFAULT NULL,
>>>> `z_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>> `z_flagPixEdge` bit(1) DEFAULT NULL,
>>>> `z_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>> `z_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>> `z_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>> `z_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>> `z_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>> `z_flagBadApFlux` bit(1) DEFAULT NULL,
>>>> `z_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>> `z_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>> `z_flagBadCentroid` bit(1) DEFAULT NULL,
>>>> `z_flagBadShape` bit(1) DEFAULT NULL,
>>>> `y_psfFlux` double DEFAULT NULL,
>>>> `y_psfFluxSigma` double DEFAULT NULL,
>>>> `y_apFlux` double DEFAULT NULL,
>>>> `y_apFluxSigma` double DEFAULT NULL,
>>>> `y_modelFlux` double DEFAULT NULL,
>>>> `y_modelFluxSigma` double DEFAULT NULL,
>>>> `y_instFlux` double DEFAULT NULL,
>>>> `y_instFluxSigma` double DEFAULT NULL,
>>>> `y_apCorrection` double DEFAULT NULL,
>>>> `y_apCorrectionSigma` double DEFAULT NULL,
>>>> `y_shapeIx` double DEFAULT NULL,
>>>> `y_shapeIy` double DEFAULT NULL,
>>>> `y_shapeIxVar` double DEFAULT NULL,
>>>> `y_shapeIyVar` double DEFAULT NULL,
>>>> `y_shapeIxIyCov` double DEFAULT NULL,
>>>> `y_shapeIxx` double DEFAULT NULL,
>>>> `y_shapeIyy` double DEFAULT NULL,
>>>> `y_shapeIxy` double DEFAULT NULL,
>>>> `y_shapeIxxVar` double DEFAULT NULL,
>>>> `y_shapeIyyVar` double DEFAULT NULL,
>>>> `y_shapeIxyVar` double DEFAULT NULL,
>>>> `y_shapeIxxIyyCov` double DEFAULT NULL,
>>>> `y_shapeIxxIxyCov` double DEFAULT NULL,
>>>> `y_shapeIyyIxyCov` double DEFAULT NULL,
>>>> `y_extendedness` double DEFAULT NULL,
>>>> `y_flagNegative` bit(1) DEFAULT NULL,
>>>> `y_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>> `y_flagPixEdge` bit(1) DEFAULT NULL,
>>>> `y_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>> `y_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>> `y_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>> `y_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>> `y_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>> `y_flagBadApFlux` bit(1) DEFAULT NULL,
>>>> `y_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>> `y_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>> `y_flagBadCentroid` bit(1) DEFAULT NULL,
>>>> `y_flagBadShape` bit(1) DEFAULT NULL,
>>>> PRIMARY KEY (`deepSourceId`),
>>>> KEY `subChunkId` (`subChunkId`)
>>>> )"}" 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR
>>>> ccontrol.UserQueryFactory
>>>> (core/modules/ccontrol/UserQueryFactory.cc:97) - Unknown failure
>>>> occured setting up QuerySession (query is invalid).
>>>> 2015-11-20T14:12:27.774Z [0x7f80d06d1700] INFO root
>>>> (core/modules/ccontrol/UserQuery.cc:275) - Discarded UserQuery(2)
>>>> 2015-11-20T14:12:27.777Z [0x7f80d06d1700] ERROR root
>>>> (appInterface.py:138) - Returning error to proxy: ("'Unknown failure
>>>> occured setting up QuerySession (query is invalid).'", False, False,
>>>> False)
>>>
>>> ########################################################################
>>> Use REPLY-ALL to reply to list
>>>
>>> To unsubscribe from the QSERV-L list, click the following link:
>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
