Print

Print


Hi Fabrice,

it looks likely due to missing database for CSS data.
Did you swich to the latest qserv release already? Did
you run qserv-configure when you did that?

If you do not want to run qserv-configure with a new release
you need to do some manual work for updating your setup:

- create database and tables for CSS:

$ mysql -S /path/to/socket/file -uroot -p*** < admin/templates/configuration/tmp/configure/sql/CssData.sql

- update czar config file with CSS options, section [css]
should look like:

[css]
technology=mysql
hostname =
port =
username = qsmaster
password =
database = qservCssData
socket = /czar_instance_run_dir/var/lib/mysql/mysql.sock

- restart czar

Cheers,
Andy


From: [log in to unmask] [mailto:[log in to unmask]] On Behalf Of Fabrice Jammes
Sent: Tuesday, November 10, 2015 9:42 AM
To: qserv-l
Subject: [QSERV-L] Upgrade of IN2P3 css metadata

Hello,

CSS metadata is still stored in zookeeper on cc-in2p3 cluster, so any SQL query on a partitioned table crashes Qserv.
Does somebody knows how to upgrade css metadata to new format?

If it is proven that the crash is due to wrong metadata format, I'll open a bug, this shouldn't crash Qserv but print explicit log message instead, isn't i?

Error report is available below.

Thanks,


-------- Forwarded Message --------
Subject:

About docker install

Date:

Mon, 09 Nov 2015 16:58:23 -0800

From:

Fabrice Jammes <[log in to unmask]><mailto:[log in to unmask]>

To:

John Gates <[log in to unmask]><mailto:[log in to unmask]>



Hi John,



It seems our docker configuration is working a bit:

fjammes@ccosvms0070:~$ time mysql --host ccqserv125 --port 4040 --user

qsmaster LSST -e "show tables;";

+------------------------------------+

| Tables_in_LSST                     |

+------------------------------------+

| ForcedSource                       |

| ForcedSourceFullOverlap_1234567890 |

| ForcedSource_1234567890            |

| Object                             |

| ObjectFullOverlap_1234567890       |

| Object_1234567890                  |

| Source                             |

| SourceFullOverlap_1234567890       |

| Source_1234567890                  |

+------------------------------------+



real    0m0.027s

user    0m0.010s

sys     0m0.013s



Nevertheless next query fails and crash qserv czar:

fjammes@ccosvms0070:~$ time mysql --host ccqserv125 --port 4040 --user

qsmaster LSST -e "select count(*) from Object;";

ERROR 4005 (Proxy) at line 1: Unable to run lua xmlrpc client, message:

...inux64/lua/5.1.4.lsst1/share/lua/5.1/xmlrpc/http.lua:41: closed







real    0m0.105s

user    0m0.004s

sys     0m0.009s



qserv-czar.log doesn't print any error message:

qserv@ccqserv125:/qserv$ tail /qserv/run/var/log/qserv-czar.log

user = qsmaster

port = 0





2015-11-10T00:53:52.413Z [0x7f98d86af700] DEBUG root

(appInterface.py:70) - _idCounter 27996832412

2015-11-10T00:53:52.413Z [0x7f98d86af700] INFO  root (server.py:137) -

endpoints: [<bound method AppInterface.cancelEverything of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method AppInterface.check of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method AppInterface.joinQuery of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method AppInterface.killQuery of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method AppInterface.killQueryUgly of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method AppInterface.resultTableString of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method AppInterface.results of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method AppInterface.submitQuery of

<lsst.qserv.czar.appInterface.AppInterface instance at 0x7f98cba83878>>,

<bound method Czar.echo of <lsst.qserv.czar.server.Czar instance at

0x7f98cba83830>>, <bound method Czar.stop of

<lsst.qserv.czar.server.Czar instance at 0x7f98cba83830>>, <bound method

Czar.reset of <lsst.qserv.czar.server.Czar instance at 0x7f98cba83830>>]

2015-11-10T00:53:52.420Z [0x7f98d86af700] INFO  root (server.py:128) -

Starting Qserv interface on port: 7080

2015-11-10T00:56:40.602Z [0x7f98d86af700] DEBUG root

(appInterface.py:119) - taskId 27996832412

2015-11-10T00:56:40.613Z [0x7f98d86af700] DEBUG css.CssAccess

(core/modules/css/CssAccess.cc:95) - Create CSS instance from config map

2015-11-10T00:56:40.613Z [0x7f98d86af700] DEBUG css.CssAccess

(core/modules/css/CssAccess.cc:148) - Create CSS instance with mysql store





________________________________

Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1