LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  November 2015

QSERV-L November 2015

Subject:

Re: CSS error on IN2P3 cluster

From:

Fabrice Jammes <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Fri, 20 Nov 2015 22:50:03 +0100

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (343 lines)

Thanks so much Andy, I let you know soon.
Shall we create a ticket for this? Data migration is cost-effective and 
we may track it?

FYI I'm running qserv from master branch commit n° 
25295192bddaec16ed080a531b9fbe45bf62e377

Have a nice day :-)

On 11/20/2015 10:14 PM, Salnikov, Andrei A. wrote:
> Hi Fabrice,
>
> I'm attaching a modified script that you need to re-run to
> update CSS. I needs to be run on a czar node and you
> need to setup Qserv as you normally do. It should remove
> and re-create CSS in a format which is recognizable by most
> recent CSS version.
>
> It assumes that mysql server with CSS runs on port 13306,
> if younfiguration is different then you may need to update
> this string in a script:
>
> connInfo = 'mysql:[log in to unmask]:13306/qservCssData'
>
>
> Let me know how it works.
>
> Cheers,
> Andy
>
> Fabrice Jammes wrote on 2015-11-20:
>> I used master branch tip from tuesday.
>>
>> Cheers,
>>
>> Fabrice
>>
>> On 11/20/2015 07:10 PM, Salnikov, Andrei A. wrote:
>>> Hi Fabrice,
>>>
>>> which Qserv version do we currently have there, does it include
>>> DM-4138 or is it released 2015_10.0?
>>>
>>> Cheers,
>>> Andy
>>>
>>> Fabrice Jammes wrote on 2015-11-20:
>>>> Hi Andy,
>>>>
>>>> Docker install is still beta but I have something running on in2p3
>>>> cluster.
>>>>
>>>> (to log to docker instance running qserv
>>>>
>>>> ssh ccqserv125.in2p3.fr
>>>> sudo -u qserv bash
>>>> docker exec -it --rm qserv bash
>>>> ls /qserv
>>>>
>>>> )
>>>>
>>>> Nevertheless they're might be an inconsistency in CSS data:
>>>>
>>>> Next query:
>>>>
>>>> time mysql --host ccqserv125 --port 4040 --user qsmaster LSST -e
>>>> "select count(*) from Object;"; ERROR 4110 (Proxy) at line 1: Query
>>>> processing error: 'Unknown failure occured setting up QuerySession
>>>> (query is invalid).'
>>>>
>>>> real    0m0.035s
>>>> user    0m0.006s
>>>> sys     0m0.013s
>>>>
>>>>
>>>> produce error log below in Qserv czar, would you have an idea please?
>>>>
>>>> 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR css.CssAccess
>>>> (core/modules/css/CssAccess.cc:978) - unpackJson error: <unspecified
>>>> file>(1): invalid code sequence data="{"compression": "0", "match":
>>>> "0", "schema": "(
>>>>      `deepSourceId` bigint(20) NOT NULL,
>>>>      `ra` double NOT NULL,
>>>>      `decl` double NOT NULL,
>>>>      `raVar` double DEFAULT NULL,
>>>>      `declVar` double DEFAULT NULL,
>>>>      `radeclCov` double DEFAULT NULL,
>>>>      `chunkId` int(11) NOT NULL,
>>>>      `subChunkId` int(11) NOT NULL,
>>>>      `u_psfFlux` double DEFAULT NULL,
>>>>      `u_psfFluxSigma` double DEFAULT NULL,
>>>>      `u_apFlux` double DEFAULT NULL,
>>>>      `u_apFluxSigma` double DEFAULT NULL,
>>>>      `u_modelFlux` double DEFAULT NULL,
>>>>      `u_modelFluxSigma` double DEFAULT NULL,
>>>>      `u_instFlux` double DEFAULT NULL,
>>>>      `u_instFluxSigma` double DEFAULT NULL,
>>>>      `u_apCorrection` double DEFAULT NULL,
>>>>      `u_apCorrectionSigma` double DEFAULT NULL,
>>>>      `u_shapeIx` double DEFAULT NULL,
>>>>      `u_shapeIy` double DEFAULT NULL,
>>>>      `u_shapeIxVar` double DEFAULT NULL,
>>>>      `u_shapeIyVar` double DEFAULT NULL,
>>>>      `u_shapeIxIyCov` double DEFAULT NULL,
>>>>      `u_shapeIxx` double DEFAULT NULL,
>>>>      `u_shapeIyy` double DEFAULT NULL,
>>>>      `u_shapeIxy` double DEFAULT NULL,
>>>>      `u_shapeIxxVar` double DEFAULT NULL,
>>>>      `u_shapeIyyVar` double DEFAULT NULL,
>>>>      `u_shapeIxyVar` double DEFAULT NULL,
>>>>      `u_shapeIxxIyyCov` double DEFAULT NULL,
>>>>      `u_shapeIxxIxyCov` double DEFAULT NULL,
>>>>      `u_shapeIyyIxyCov` double DEFAULT NULL,
>>>>      `u_extendedness` double DEFAULT NULL,
>>>>      `u_flagNegative` bit(1) DEFAULT NULL,
>>>>      `u_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>      `u_flagPixEdge` bit(1) DEFAULT NULL,
>>>>      `u_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>      `u_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>      `u_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>      `u_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>      `u_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>      `u_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>      `u_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>      `u_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>      `u_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>      `u_flagBadShape` bit(1) DEFAULT NULL,
>>>>      `g_psfFlux` double DEFAULT NULL,
>>>>      `g_psfFluxSigma` double DEFAULT NULL,
>>>>      `g_apFlux` double DEFAULT NULL,
>>>>      `g_apFluxSigma` double DEFAULT NULL,
>>>>      `g_modelFlux` double DEFAULT NULL,
>>>>      `g_modelFluxSigma` double DEFAULT NULL,
>>>>      `g_instFlux` double DEFAULT NULL,
>>>>      `g_instFluxSigma` double DEFAULT NULL,
>>>>      `g_apCorrection` double DEFAULT NULL,
>>>>      `g_apCorrectionSigma` double DEFAULT NULL,
>>>>      `g_shapeIx` double DEFAULT NULL,
>>>>      `g_shapeIy` double DEFAULT NULL,
>>>>      `g_shapeIxVar` double DEFAULT NULL,
>>>>      `g_shapeIyVar` double DEFAULT NULL,
>>>>      `g_shapeIxIyCov` double DEFAULT NULL,
>>>>      `g_shapeIxx` double DEFAULT NULL,
>>>>      `g_shapeIyy` double DEFAULT NULL,
>>>>      `g_shapeIxy` double DEFAULT NULL,
>>>>      `g_shapeIxxVar` double DEFAULT NULL,
>>>>      `g_shapeIyyVar` double DEFAULT NULL,
>>>>      `g_shapeIxyVar` double DEFAULT NULL,
>>>>      `g_shapeIxxIyyCov` double DEFAULT NULL,
>>>>      `g_shapeIxxIxyCov` double DEFAULT NULL,
>>>>      `g_shapeIyyIxyCov` double DEFAULT NULL,
>>>>      `g_extendedness` double DEFAULT NULL,
>>>>      `g_flagNegative` bit(1) DEFAULT NULL,
>>>>      `g_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>      `g_flagPixEdge` bit(1) DEFAULT NULL,
>>>>      `g_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>      `g_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>      `g_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>      `g_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>      `g_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>      `g_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>      `g_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>      `g_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>      `g_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>      `g_flagBadShape` bit(1) DEFAULT NULL,
>>>>      `r_psfFlux` double DEFAULT NULL,
>>>>      `r_psfFluxSigma` double DEFAULT NULL,
>>>>      `r_apFlux` double DEFAULT NULL,
>>>>      `r_apFluxSigma` double DEFAULT NULL,
>>>>      `r_modelFlux` double DEFAULT NULL,
>>>>      `r_modelFluxSigma` double DEFAULT NULL,
>>>>      `r_instFlux` double DEFAULT NULL,
>>>>      `r_instFluxSigma` double DEFAULT NULL,
>>>>      `r_apCorrection` double DEFAULT NULL,
>>>>      `r_apCorrectionSigma` double DEFAULT NULL,
>>>>      `r_shapeIx` double DEFAULT NULL,
>>>>      `r_shapeIy` double DEFAULT NULL,
>>>>      `r_shapeIxVar` double DEFAULT NULL,
>>>>      `r_shapeIyVar` double DEFAULT NULL,
>>>>      `r_shapeIxIyCov` double DEFAULT NULL,
>>>>      `r_shapeIxx` double DEFAULT NULL,
>>>>      `r_shapeIyy` double DEFAULT NULL,
>>>>      `r_shapeIxy` double DEFAULT NULL,
>>>>      `r_shapeIxxVar` double DEFAULT NULL,
>>>>      `r_shapeIyyVar` double DEFAULT NULL,
>>>>      `r_shapeIxyVar` double DEFAULT NULL,
>>>>      `r_shapeIxxIyyCov` double DEFAULT NULL,
>>>>      `r_shapeIxxIxyCov` double DEFAULT NULL,
>>>>      `r_shapeIyyIxyCov` double DEFAULT NULL,
>>>>      `r_extendedness` double DEFAULT NULL,
>>>>      `r_flagNegative` bit(1) DEFAULT NULL,
>>>>      `r_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>      `r_flagPixEdge` bit(1) DEFAULT NULL,
>>>>      `r_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>      `r_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>      `r_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>      `r_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>      `r_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>      `r_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>      `r_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>      `r_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>      `r_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>      `r_flagBadShape` bit(1) DEFAULT NULL,
>>>>      `i_psfFlux` double DEFAULT NULL,
>>>>      `i_psfFluxSigma` double DEFAULT NULL,
>>>>      `i_apFlux` double DEFAULT NULL,
>>>>      `i_apFluxSigma` double DEFAULT NULL,
>>>>      `i_modelFlux` double DEFAULT NULL,
>>>>      `i_modelFluxSigma` double DEFAULT NULL,
>>>>      `i_instFlux` double DEFAULT NULL,
>>>>      `i_instFluxSigma` double DEFAULT NULL,
>>>>      `i_apCorrection` double DEFAULT NULL,
>>>>      `i_apCorrectionSigma` double DEFAULT NULL,
>>>>      `i_shapeIx` double DEFAULT NULL,
>>>>      `i_shapeIy` double DEFAULT NULL,
>>>>      `i_shapeIxVar` double DEFAULT NULL,
>>>>      `i_shapeIyVar` double DEFAULT NULL,
>>>>      `i_shapeIxIyCov` double DEFAULT NULL,
>>>>      `i_shapeIxx` double DEFAULT NULL,
>>>>      `i_shapeIyy` double DEFAULT NULL,
>>>>      `i_shapeIxy` double DEFAULT NULL,
>>>>      `i_shapeIxxVar` double DEFAULT NULL,
>>>>      `i_shapeIyyVar` double DEFAULT NULL,
>>>>      `i_shapeIxyVar` double DEFAULT NULL,
>>>>      `i_shapeIxxIyyCov` double DEFAULT NULL,
>>>>      `i_shapeIxxIxyCov` double DEFAULT NULL,
>>>>      `i_shapeIyyIxyCov` double DEFAULT NULL,
>>>>      `i_extendedness` double DEFAULT NULL,
>>>>      `i_flagNegative` bit(1) DEFAULT NULL,
>>>>      `i_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>      `i_flagPixEdge` bit(1) DEFAULT NULL,
>>>>      `i_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>      `i_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>      `i_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>      `i_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>      `i_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>      `i_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>      `i_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>      `i_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>      `i_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>      `i_flagBadShape` bit(1) DEFAULT NULL,
>>>>      `z_psfFlux` double DEFAULT NULL,
>>>>      `z_psfFluxSigma` double DEFAULT NULL,
>>>>      `z_apFlux` double DEFAULT NULL,
>>>>      `z_apFluxSigma` double DEFAULT NULL,
>>>>      `z_modelFlux` double DEFAULT NULL,
>>>>      `z_modelFluxSigma` double DEFAULT NULL,
>>>>      `z_instFlux` double DEFAULT NULL,
>>>>      `z_instFluxSigma` double DEFAULT NULL,
>>>>      `z_apCorrection` double DEFAULT NULL,
>>>>      `z_apCorrectionSigma` double DEFAULT NULL,
>>>>      `z_shapeIx` double DEFAULT NULL,
>>>>      `z_shapeIy` double DEFAULT NULL,
>>>>      `z_shapeIxVar` double DEFAULT NULL,
>>>>      `z_shapeIyVar` double DEFAULT NULL,
>>>>      `z_shapeIxIyCov` double DEFAULT NULL,
>>>>      `z_shapeIxx` double DEFAULT NULL,
>>>>      `z_shapeIyy` double DEFAULT NULL,
>>>>      `z_shapeIxy` double DEFAULT NULL,
>>>>      `z_shapeIxxVar` double DEFAULT NULL,
>>>>      `z_shapeIyyVar` double DEFAULT NULL,
>>>>      `z_shapeIxyVar` double DEFAULT NULL,
>>>>      `z_shapeIxxIyyCov` double DEFAULT NULL,
>>>>      `z_shapeIxxIxyCov` double DEFAULT NULL,
>>>>      `z_shapeIyyIxyCov` double DEFAULT NULL,
>>>>      `z_extendedness` double DEFAULT NULL,
>>>>      `z_flagNegative` bit(1) DEFAULT NULL,
>>>>      `z_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>      `z_flagPixEdge` bit(1) DEFAULT NULL,
>>>>      `z_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>      `z_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>      `z_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>      `z_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>      `z_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>      `z_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>      `z_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>      `z_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>      `z_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>      `z_flagBadShape` bit(1) DEFAULT NULL,
>>>>      `y_psfFlux` double DEFAULT NULL,
>>>>      `y_psfFluxSigma` double DEFAULT NULL,
>>>>      `y_apFlux` double DEFAULT NULL,
>>>>      `y_apFluxSigma` double DEFAULT NULL,
>>>>      `y_modelFlux` double DEFAULT NULL,
>>>>      `y_modelFluxSigma` double DEFAULT NULL,
>>>>      `y_instFlux` double DEFAULT NULL,
>>>>      `y_instFluxSigma` double DEFAULT NULL,
>>>>      `y_apCorrection` double DEFAULT NULL,
>>>>      `y_apCorrectionSigma` double DEFAULT NULL,
>>>>      `y_shapeIx` double DEFAULT NULL,
>>>>      `y_shapeIy` double DEFAULT NULL,
>>>>      `y_shapeIxVar` double DEFAULT NULL,
>>>>      `y_shapeIyVar` double DEFAULT NULL,
>>>>      `y_shapeIxIyCov` double DEFAULT NULL,
>>>>      `y_shapeIxx` double DEFAULT NULL,
>>>>      `y_shapeIyy` double DEFAULT NULL,
>>>>      `y_shapeIxy` double DEFAULT NULL,
>>>>      `y_shapeIxxVar` double DEFAULT NULL,
>>>>      `y_shapeIyyVar` double DEFAULT NULL,
>>>>      `y_shapeIxyVar` double DEFAULT NULL,
>>>>      `y_shapeIxxIyyCov` double DEFAULT NULL,
>>>>      `y_shapeIxxIxyCov` double DEFAULT NULL,
>>>>      `y_shapeIyyIxyCov` double DEFAULT NULL,
>>>>      `y_extendedness` double DEFAULT NULL,
>>>>      `y_flagNegative` bit(1) DEFAULT NULL,
>>>>      `y_flagBadMeasCentroid` bit(1) DEFAULT NULL,
>>>>      `y_flagPixEdge` bit(1) DEFAULT NULL,
>>>>      `y_flagPixInterpAny` bit(1) DEFAULT NULL,
>>>>      `y_flagPixInterpCen` bit(1) DEFAULT NULL,
>>>>      `y_flagPixSaturAny` bit(1) DEFAULT NULL,
>>>>      `y_flagPixSaturCen` bit(1) DEFAULT NULL,
>>>>      `y_flagBadPsfFlux` bit(1) DEFAULT NULL,
>>>>      `y_flagBadApFlux` bit(1) DEFAULT NULL,
>>>>      `y_flagBadModelFlux` bit(1) DEFAULT NULL,
>>>>      `y_flagBadInstFlux` bit(1) DEFAULT NULL,
>>>>      `y_flagBadCentroid` bit(1) DEFAULT NULL,
>>>>      `y_flagBadShape` bit(1) DEFAULT NULL,
>>>>      PRIMARY KEY (`deepSourceId`),
>>>>      KEY `subChunkId` (`subChunkId`)
>>>> )"}" 2015-11-20T14:12:27.773Z [0x7f80d06d1700] ERROR
>>>> ccontrol.UserQueryFactory
>>>> (core/modules/ccontrol/UserQueryFactory.cc:97) - Unknown failure
>>>> occured setting up QuerySession (query is invalid).
>>>> 2015-11-20T14:12:27.774Z [0x7f80d06d1700] INFO  root
>>>> (core/modules/ccontrol/UserQuery.cc:275) - Discarded UserQuery(2)
>>>> 2015-11-20T14:12:27.777Z [0x7f80d06d1700] ERROR root
>>>> (appInterface.py:138) - Returning error to proxy: ("'Unknown failure
>>>> occured setting up QuerySession (query is invalid).'", False, False,
>>>> False)
>>>
>>> ########################################################################
>>> Use REPLY-ALL to reply to list
>>>
>>> To unsubscribe from the QSERV-L list, click the following link:
>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use