Print

Print


Hi Fabrice,

I'm attaching a modified script that you need to re-run to 
update CSS. I needs to be run on a czar node and you 
need to setup Qserv as you normally do. It should remove
and re-create CSS in a format which is recognizable by most
recent CSS version. 

It assumes that mysql server with CSS runs on port 13306, 
if younfiguration is different then you may need to update
this string in a script:

connInfo = 'mysql:[log in to unmask]:13306/qservCssData'


Let me know how it works.

Cheers,
Andy

Fabrice Jammes wrote on 2015-11-20:
> I used master branch tip from tuesday.
> 
> Cheers,
> 
> Fabrice
> 
> On 11/20/2015 07:10 PM, Salnikov, Andrei A. wrote:
>> Hi Fabrice,
>> 
>> which Qserv version do we currently have there, does it include
>> DM-4138 or is it released 2015_10.0?
>> 
>> Cheers,
>> Andy
>> 
>> Fabrice Jammes wrote on 2015-11-20:
>>> Hi Andy,
>>> 
>>> Docker install is still beta but I have something running on in2p3
>>> cluster.
>>> 
>>> (to log to docker instance running qserv
>>> 
>>> ssh ccqserv125.in2p3.fr
>>> sudo -u qserv bash
>>> docker exec -it --rm qserv bash
>>> ls /qserv
>>> 
>>> )
>>> 
>>> Nevertheless they're might be an inconsistency in CSS data:
>>> 
>>> Next query:
>>> 
>>> time mysql --host ccqserv125 --port 4040 --user qsmaster LSST -e
>>> "select count(*) from Object;"; ERROR 4110 (Proxy) at line 1: Query
>>> processing error: 'Unknown failure occured setting up QuerySession
>>> (query is invalid).'
>>> 
>>> real    0m0.035s
>>> user    0m0.006s
>>> sys     0m0.013s
>>> 
>>> 
>>> produce error log below in Qserv czar, would you have an idea please?
>>> 
>>> 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR css.CssAccess
>>> (core/modules/css/CssAccess.cc:978) - unpackJson error: <unspecified
>>> file>(1): invalid code sequence data="{"compression": "0", "match":
>>> "0", "schema": "(
>>>     `deepSourceId` bigint(20) NOT NULL,
>>>     `ra` double NOT NULL,
>>>     `decl` double NOT NULL,
>>>     `raVar` double DEFAULT NULL,
>>>     `declVar` double DEFAULT NULL,
>>>     `radeclCov` double DEFAULT NULL,
>>>     `chunkId` int(11) NOT NULL,
>>>     `subChunkId` int(11) NOT NULL,
>>>     `u_psfFlux` double DEFAULT NULL,
>>>     `u_psfFluxSigma` double DEFAULT NULL,
>>>     `u_apFlux` double DEFAULT NULL,
>>>     `u_apFluxSigma` double DEFAULT NULL,
>>>     `u_modelFlux` double DEFAULT NULL,
>>>     `u_modelFluxSigma` double DEFAULT NULL,
>>>     `u_instFlux` double DEFAULT NULL,
>>>     `u_instFluxSigma` double DEFAULT NULL,
>>>     `u_apCorrection` double DEFAULT NULL,
>>>     `u_apCorrectionSigma` double DEFAULT NULL,
>>>     `u_shapeIx` double DEFAULT NULL,
>>>     `u_shapeIy` double DEFAULT NULL,
>>>     `u_shapeIxVar` double DEFAULT NULL,
>>>     `u_shapeIyVar` double DEFAULT NULL,
>>>     `u_shapeIxIyCov` double DEFAULT NULL,
>>>     `u_shapeIxx` double DEFAULT NULL,
>>>     `u_shapeIyy` double DEFAULT NULL,
>>>     `u_shapeIxy` double DEFAULT NULL,
>>>     `u_shapeIxxVar` double DEFAULT NULL,
>>>     `u_shapeIyyVar` double DEFAULT NULL,
>>>     `u_shapeIxyVar` double DEFAULT NULL,
>>>     `u_shapeIxxIyyCov` double DEFAULT NULL,
>>>     `u_shapeIxxIxyCov` double DEFAULT NULL,
>>>     `u_shapeIyyIxyCov` double DEFAULT NULL,
>>>     `u_extendedness` double DEFAULT NULL,
>>>     `u_flagNegative` bit(1) DEFAULT NULL,
>>>     `u_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>     `u_flagPixEdge` bit(1) DEFAULT NULL,
>>>     `u_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>     `u_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>     `u_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>     `u_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>     `u_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>     `u_flagBadApFlux` bit(1) DEFAULT NULL,
>>>     `u_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>     `u_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>     `u_flagBadCentroid` bit(1) DEFAULT NULL,
>>>     `u_flagBadShape` bit(1) DEFAULT NULL,
>>>     `g_psfFlux` double DEFAULT NULL,
>>>     `g_psfFluxSigma` double DEFAULT NULL,
>>>     `g_apFlux` double DEFAULT NULL,
>>>     `g_apFluxSigma` double DEFAULT NULL,
>>>     `g_modelFlux` double DEFAULT NULL,
>>>     `g_modelFluxSigma` double DEFAULT NULL,
>>>     `g_instFlux` double DEFAULT NULL,
>>>     `g_instFluxSigma` double DEFAULT NULL,
>>>     `g_apCorrection` double DEFAULT NULL,
>>>     `g_apCorrectionSigma` double DEFAULT NULL,
>>>     `g_shapeIx` double DEFAULT NULL,
>>>     `g_shapeIy` double DEFAULT NULL,
>>>     `g_shapeIxVar` double DEFAULT NULL,
>>>     `g_shapeIyVar` double DEFAULT NULL,
>>>     `g_shapeIxIyCov` double DEFAULT NULL,
>>>     `g_shapeIxx` double DEFAULT NULL,
>>>     `g_shapeIyy` double DEFAULT NULL,
>>>     `g_shapeIxy` double DEFAULT NULL,
>>>     `g_shapeIxxVar` double DEFAULT NULL,
>>>     `g_shapeIyyVar` double DEFAULT NULL,
>>>     `g_shapeIxyVar` double DEFAULT NULL,
>>>     `g_shapeIxxIyyCov` double DEFAULT NULL,
>>>     `g_shapeIxxIxyCov` double DEFAULT NULL,
>>>     `g_shapeIyyIxyCov` double DEFAULT NULL,
>>>     `g_extendedness` double DEFAULT NULL,
>>>     `g_flagNegative` bit(1) DEFAULT NULL,
>>>     `g_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>     `g_flagPixEdge` bit(1) DEFAULT NULL,
>>>     `g_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>     `g_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>     `g_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>     `g_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>     `g_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>     `g_flagBadApFlux` bit(1) DEFAULT NULL,
>>>     `g_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>     `g_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>     `g_flagBadCentroid` bit(1) DEFAULT NULL,
>>>     `g_flagBadShape` bit(1) DEFAULT NULL,
>>>     `r_psfFlux` double DEFAULT NULL,
>>>     `r_psfFluxSigma` double DEFAULT NULL,
>>>     `r_apFlux` double DEFAULT NULL,
>>>     `r_apFluxSigma` double DEFAULT NULL,
>>>     `r_modelFlux` double DEFAULT NULL,
>>>     `r_modelFluxSigma` double DEFAULT NULL,
>>>     `r_instFlux` double DEFAULT NULL,
>>>     `r_instFluxSigma` double DEFAULT NULL,
>>>     `r_apCorrection` double DEFAULT NULL,
>>>     `r_apCorrectionSigma` double DEFAULT NULL,
>>>     `r_shapeIx` double DEFAULT NULL,
>>>     `r_shapeIy` double DEFAULT NULL,
>>>     `r_shapeIxVar` double DEFAULT NULL,
>>>     `r_shapeIyVar` double DEFAULT NULL,
>>>     `r_shapeIxIyCov` double DEFAULT NULL,
>>>     `r_shapeIxx` double DEFAULT NULL,
>>>     `r_shapeIyy` double DEFAULT NULL,
>>>     `r_shapeIxy` double DEFAULT NULL,
>>>     `r_shapeIxxVar` double DEFAULT NULL,
>>>     `r_shapeIyyVar` double DEFAULT NULL,
>>>     `r_shapeIxyVar` double DEFAULT NULL,
>>>     `r_shapeIxxIyyCov` double DEFAULT NULL,
>>>     `r_shapeIxxIxyCov` double DEFAULT NULL,
>>>     `r_shapeIyyIxyCov` double DEFAULT NULL,
>>>     `r_extendedness` double DEFAULT NULL,
>>>     `r_flagNegative` bit(1) DEFAULT NULL,
>>>     `r_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>     `r_flagPixEdge` bit(1) DEFAULT NULL,
>>>     `r_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>     `r_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>     `r_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>     `r_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>     `r_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>     `r_flagBadApFlux` bit(1) DEFAULT NULL,
>>>     `r_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>     `r_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>     `r_flagBadCentroid` bit(1) DEFAULT NULL,
>>>     `r_flagBadShape` bit(1) DEFAULT NULL,
>>>     `i_psfFlux` double DEFAULT NULL,
>>>     `i_psfFluxSigma` double DEFAULT NULL,
>>>     `i_apFlux` double DEFAULT NULL,
>>>     `i_apFluxSigma` double DEFAULT NULL,
>>>     `i_modelFlux` double DEFAULT NULL,
>>>     `i_modelFluxSigma` double DEFAULT NULL,
>>>     `i_instFlux` double DEFAULT NULL,
>>>     `i_instFluxSigma` double DEFAULT NULL,
>>>     `i_apCorrection` double DEFAULT NULL,
>>>     `i_apCorrectionSigma` double DEFAULT NULL,
>>>     `i_shapeIx` double DEFAULT NULL,
>>>     `i_shapeIy` double DEFAULT NULL,
>>>     `i_shapeIxVar` double DEFAULT NULL,
>>>     `i_shapeIyVar` double DEFAULT NULL,
>>>     `i_shapeIxIyCov` double DEFAULT NULL,
>>>     `i_shapeIxx` double DEFAULT NULL,
>>>     `i_shapeIyy` double DEFAULT NULL,
>>>     `i_shapeIxy` double DEFAULT NULL,
>>>     `i_shapeIxxVar` double DEFAULT NULL,
>>>     `i_shapeIyyVar` double DEFAULT NULL,
>>>     `i_shapeIxyVar` double DEFAULT NULL,
>>>     `i_shapeIxxIyyCov` double DEFAULT NULL,
>>>     `i_shapeIxxIxyCov` double DEFAULT NULL,
>>>     `i_shapeIyyIxyCov` double DEFAULT NULL,
>>>     `i_extendedness` double DEFAULT NULL,
>>>     `i_flagNegative` bit(1) DEFAULT NULL,
>>>     `i_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>     `i_flagPixEdge` bit(1) DEFAULT NULL,
>>>     `i_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>     `i_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>     `i_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>     `i_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>     `i_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>     `i_flagBadApFlux` bit(1) DEFAULT NULL,
>>>     `i_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>     `i_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>     `i_flagBadCentroid` bit(1) DEFAULT NULL,
>>>     `i_flagBadShape` bit(1) DEFAULT NULL,
>>>     `z_psfFlux` double DEFAULT NULL,
>>>     `z_psfFluxSigma` double DEFAULT NULL,
>>>     `z_apFlux` double DEFAULT NULL,
>>>     `z_apFluxSigma` double DEFAULT NULL,
>>>     `z_modelFlux` double DEFAULT NULL,
>>>     `z_modelFluxSigma` double DEFAULT NULL,
>>>     `z_instFlux` double DEFAULT NULL,
>>>     `z_instFluxSigma` double DEFAULT NULL,
>>>     `z_apCorrection` double DEFAULT NULL,
>>>     `z_apCorrectionSigma` double DEFAULT NULL,
>>>     `z_shapeIx` double DEFAULT NULL,
>>>     `z_shapeIy` double DEFAULT NULL,
>>>     `z_shapeIxVar` double DEFAULT NULL,
>>>     `z_shapeIyVar` double DEFAULT NULL,
>>>     `z_shapeIxIyCov` double DEFAULT NULL,
>>>     `z_shapeIxx` double DEFAULT NULL,
>>>     `z_shapeIyy` double DEFAULT NULL,
>>>     `z_shapeIxy` double DEFAULT NULL,
>>>     `z_shapeIxxVar` double DEFAULT NULL,
>>>     `z_shapeIyyVar` double DEFAULT NULL,
>>>     `z_shapeIxyVar` double DEFAULT NULL,
>>>     `z_shapeIxxIyyCov` double DEFAULT NULL,
>>>     `z_shapeIxxIxyCov` double DEFAULT NULL,
>>>     `z_shapeIyyIxyCov` double DEFAULT NULL,
>>>     `z_extendedness` double DEFAULT NULL,
>>>     `z_flagNegative` bit(1) DEFAULT NULL,
>>>     `z_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>     `z_flagPixEdge` bit(1) DEFAULT NULL,
>>>     `z_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>     `z_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>     `z_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>     `z_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>     `z_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>     `z_flagBadApFlux` bit(1) DEFAULT NULL,
>>>     `z_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>     `z_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>     `z_flagBadCentroid` bit(1) DEFAULT NULL,
>>>     `z_flagBadShape` bit(1) DEFAULT NULL,
>>>     `y_psfFlux` double DEFAULT NULL,
>>>     `y_psfFluxSigma` double DEFAULT NULL,
>>>     `y_apFlux` double DEFAULT NULL,
>>>     `y_apFluxSigma` double DEFAULT NULL,
>>>     `y_modelFlux` double DEFAULT NULL,
>>>     `y_modelFluxSigma` double DEFAULT NULL,
>>>     `y_instFlux` double DEFAULT NULL,
>>>     `y_instFluxSigma` double DEFAULT NULL,
>>>     `y_apCorrection` double DEFAULT NULL,
>>>     `y_apCorrectionSigma` double DEFAULT NULL,
>>>     `y_shapeIx` double DEFAULT NULL,
>>>     `y_shapeIy` double DEFAULT NULL,
>>>     `y_shapeIxVar` double DEFAULT NULL,
>>>     `y_shapeIyVar` double DEFAULT NULL,
>>>     `y_shapeIxIyCov` double DEFAULT NULL,
>>>     `y_shapeIxx` double DEFAULT NULL,
>>>     `y_shapeIyy` double DEFAULT NULL,
>>>     `y_shapeIxy` double DEFAULT NULL,
>>>     `y_shapeIxxVar` double DEFAULT NULL,
>>>     `y_shapeIyyVar` double DEFAULT NULL,
>>>     `y_shapeIxyVar` double DEFAULT NULL,
>>>     `y_shapeIxxIyyCov` double DEFAULT NULL,
>>>     `y_shapeIxxIxyCov` double DEFAULT NULL,
>>>     `y_shapeIyyIxyCov` double DEFAULT NULL,
>>>     `y_extendedness` double DEFAULT NULL,
>>>     `y_flagNegative` bit(1) DEFAULT NULL,
>>>     `y_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>     `y_flagPixEdge` bit(1) DEFAULT NULL,
>>>     `y_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>     `y_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>     `y_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>     `y_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>     `y_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>     `y_flagBadApFlux` bit(1) DEFAULT NULL,
>>>     `y_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>     `y_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>     `y_flagBadCentroid` bit(1) DEFAULT NULL,
>>>     `y_flagBadShape` bit(1) DEFAULT NULL,
>>>     PRIMARY KEY (`deepSourceId`),
>>>     KEY `subChunkId` (`subChunkId`)
>>> )"}" 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR
>>> ccontrol.UserQueryFactory
>>> (core/modules/ccontrol/UserQueryFactory.cc:97) - Unknown failure
>>> occured setting up QuerySession (query is invalid).
>>> 2015-11-20T14:12:27.774Z [0x7f80d06d1700] INFO  root
>>> (core/modules/ccontrol/UserQuery.cc:275) - Discarded UserQuery(2)
>>> 2015-11-20T14:12:27.777Z [0x7f80d06d1700] ERROR root
>>> (appInterface.py:138) - Returning error to proxy: ("'Unknown failure
>>> occured setting up QuerySession (query is invalid).'", False, False,
>>> False)
>> 
>> 
>> ########################################################################
>> Use REPLY-ALL to reply to list
>> 
>> To unsubscribe from the QSERV-L list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1



########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1