LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  September 2014

QSERV-L September 2014

Subject:

Re: troubles with qserv-configure.py

From:

Jacek Becla <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Mon, 22 Sep 2014 23:27:11 -0700

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (356 lines)

Fabrice

I am running into the same problem Daniel did.

I did try

eups distrib install scisql 0.3.2 
--repository=http://lsst-web.ncsa.illinois.edu/~fjammes/qserv-dev

and it did not help. Fabrice, the tip of the master is broken, we can't 
do a fresh qserv install, please look into that! I don't want to hack
things as Daniel did. More info for the record:

  eups list scisql
    0.3+3      	current Winter2014 b4 b5 b6 b3 setup
    0.3.2      	b98


eups list qserv
    2014_06.0  	current b74
    u.jbecla.DM-207-gf8e7177d8d-dirty 	setup



qserv-configure.py -a -R ~/qservDev/qserv-run
INFO: Qserv configuration tool
=======================================================================
INFO: Initializing template configuration in 
/usr/local/home/becla/qservDev/qserv-run using 
/usr/local/home/becla/qservDev/Linux64/qserv/u.jbecla.DM-207-gf8e7177d8d-dirty/admin

WARNING : Do you want to erase all configuration data in 
/usr/local/home/becla/qservDev/qserv-run ? [y/n]
y
INFO: Reading meta-configuration file
INFO: Defining main directory structure
INFO: Qserv directory structure creation succeeded
INFO: Qserv symlinks creation for externalized directories succeeded
INFO: Creating configuration files in 
/usr/local/home/becla/qservDev/qserv-run/etc and scripts in 
/usr/local/home/becla/qservDev/qserv-run/tmp
INFO: Creating configuration using templates files
INFO: Running configuration scripts
INFO: Running : 
/usr/local/home/becla/qservDev/qserv-run/tmp/configure/mysql.sh
INFO: 	stdout :
--
-- Removing previous data.
-- .
-- Installing mysql database files.
-- Starting mysql server.
Starting MySQL.                                            [  OK  ]
-- Changing mysql root password.
-- Shutting down mysql server.
Shutting down MySQL.                                       [  OK  ]
INFO: MySQL initialization SUCCESSFUL
--
INFO: Running : 
/usr/local/home/becla/qservDev/qserv-run/tmp/configure/xrootd.sh
INFO: 	stdout :
--
INFO: xrootd installation and configuration SUCCESSFUL
--
INFO: Running : 
/usr/local/home/becla/qservDev/qserv-run/tmp/configure/qserv-czar.sh
INFO: 	stdout :
--

-- Initializing Qserv czar database
Starting MySQL.                                            [  OK  ]
-- Inserting data
--------------
CREATE DATABASE IF NOT EXISTS LSST
--------------

Query OK, 1 row affected (0.00 sec)

--------------
CREATE DATABASE IF NOT EXISTS qservResult
--------------

Query OK, 1 row affected (0.00 sec)

--------------
CREATE DATABASE IF NOT EXISTS qservScratch
--------------

Query OK, 1 row affected (0.00 sec)

--------------
GRANT ALL ON LSST.* TO 'qsmaster'@'localhost'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
GRANT ALL ON qservResult.* TO 'qsmaster'@'localhost'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
GRANT ALL ON qservScratch.* TO 'qsmaster'@'localhost'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
GRANT SELECT ON *.* TO 'qsmaster'@'localhost'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
GRANT EXECUTE ON `LSST`.* TO 'qsmaster'@'localhost'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
GRANT SELECT ON `qserv`.* TO 'qsmaster'@'localhost'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, DROP, REFERENCES, INDEX, 
ALTER, CREATE TEMPORARY TABLES, LOCK TABLES, EXECUTE, CREATE VIEW, SHOW 
VIEW, CREATE ROUTINE, ALTER ROUTINE ON `Subchunks\_%`.* TO 
'qsmaster'@'localhost' WITH GRANT OPTION
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, DROP, REFERENCES, INDEX, 
ALTER, CREATE TEMPORARY TABLES, LOCK TABLES, EXECUTE, CREATE VIEW, SHOW 
VIEW, CREATE ROUTINE, ALTER ROUTINE ON `q\_%`.* TO 
'qsmaster'@'localhost' WITH GRANT OPTION
--------------

Query OK, 0 rows affected (0.00 sec)

Bye
--------------
DROP DATABASE IF EXISTS qservw_worker
--------------

Query OK, 0 rows affected, 1 warning (0.00 sec)

--------------
CREATE DATABASE qservw_worker
--------------

Query OK, 1 row affected (0.00 sec)

--------------
GRANT ALL ON qservw_worker.* TO 'qsmaster'@'localhost'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
FLUSH PRIVILEGES
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
CREATE TABLE qservw_worker.Dbs (
   `db` char(200) NOT NULL
)
--------------

Query OK, 0 rows affected (0.02 sec)

--------------
INSERT INTO qservw_worker.Dbs VALUES('LSST')
--------------

Query OK, 1 row affected (0.00 sec)

Bye
Shutting down MySQL.                                       [  OK  ]
INFO: Qserv Czar initialization SUCCESSFUL
--
INFO: Running : 
/usr/local/home/becla/qservDev/qserv-run/tmp/configure/scisql.sh
INFO: 	stdout :
--
Starting MySQL.                                            [  OK  ]
-- Installing and configuring sciSQL
--
INFO: 	stderr :
--
/usr/local/home/becla/qservDev/qserv-run/tmp/configure/scisql.sh: line 
21: ./configure: No such file or directory
--
CRITICAL: Error code returned by command : 
/usr/local/home/becla/qservDev/qserv-run/tmp/configure/scisql.sh








On 09/18/2014 06:48 PM, Daniel L. Wang wrote:
> That might be it.
> Anyway, I worked around it and installed scisql manually. I seem to have
> a working qserv. But I have no qserv-test-integration.py and
> qserv-check-integration.py . These seem to have been removed as part of
> DM-953 , but I can't seem to find a qserv_testdata version that has them.
>
> [danielw@lsst-dbdev1 run]$ eups distrib list qserv_testdata
> No matching products available from primary server
> (http://sw.lsstcorp.org/eupspkg)
> [danielw@lsst-dbdev1 run]$ eups distrib list qserv_testdata   -s
> http://lsst-web.ncsa.illinois.edu/~fjammes/qserv
>    qserv_testdata       generic    2014_05.0
>    qserv_testdata       generic    2014_06.0
> [danielw@lsst-dbdev1 run]$
>
> So I cloned the qserv_testdata repo and did the setup -r . + eupspkg
> -er... dance, and it seems to work now.
>
> Anyway, I hope Jacek is able to make something work.
> -Daniel
>
>
> On 09/18/2014 05:55 PM, Serge Monkewitz wrote:
>> Hi Daniel,
>>
>>      You probably got scisql from the official distserver
>> (EUPS_PKGROOT=http://sw.lsstcorp.org/eupspkg) after following my phone
>> instructions. Can you run:
>>
>> eups distrib install scisql 0.3.2
>> --repository=http://lsst-web.ncsa.illinois.edu/~fjammes/qserv-dev
>>
>> then remove the previous version from your stack (it should be named
>> something like 0.3+3)? I think that may take care of your problem.
>>
>> Serge
>>
>> On Sep 18, 2014, at 5:01 PM, Daniel L. Wang
>> <[log in to unmask]> wrote:
>>
>>> Jacek,
>>>
>>> I didn't encounter your error, but do you have qserv_testdata setup?
>>>
>>> For some reason, I'm having a different problem. qserv-configure.py
>>> bails out during the installation of scisql. This looks related to
>>> the use of eups-distributed scisql.
>>> -----------
>>> -- Installing and configuring sciSQL
>>> --
>>> INFO:     stderr :
>>> --
>>> /usr/local/home/danielw/t4/run/tmp/configure/scisql.sh: line 21:
>>> ./configure: No such file or directory
>>> --
>>> CRITICAL: Error code returned by command :
>>> /usr/local/home/danielw/t4/run/tmp/configure/scisql.sh
>>> -------------
>>>
>>> At this point, I dug into scisql.sh, and noticed that it does cd
>>> $SCISQL_DIR and then ./configure..., which fails because SCISQL_DIR
>>> (/usr/local/home/danielw/t4/Linux64/scisql/0.3+5) seems to contain
>>> (almost) nothing of value for qserv. That is, the eups-installed
>>> scisql seems useless for qserv. I have a feeling that there is
>>> another scisql version in eups that isn't useless, but I don't know
>>> where it is.
>>>
>>> But if there isn't another eups scisql, I don't see how scisql.sh
>>> could work. DM-602 introduced a change to rely on an eups-installed
>>> scisql, and I do see in JIRA that someone tested DM-602 in a
>>> disconnected environment, but did it get tested on a fresh install
>>> over the network? The scisql.sh template hasn't changed since DM-602,
>>> so I don't see how it worked back then.
>>>
>>> For the record, I'm testing the current tip of master: e4f80b629 ,
>>> which gives the mangled eups version: master-ge4f80b629f
>>>
>>> What am I missing?
>>>
>>> -Daniel
>>>
>>>
>>> On 09/18/2014 09:52 AM, Jacek Becla wrote:
>>>> Fabrice,
>>>>
>>>> What am I missing? I tried to test the latest master,
>>>> here is what I am getting:
>>>>
>>>>
>>>> setup -r .
>>>> setup xrootd 4.0.0rc3-qsClient2
>>>> setup qserv_testdata
>>>> eupspkg -er build
>>>> eupspkg -er install
>>>> eupspkg -er decl
>>>> setup qserv master-ge4f80b629f
>>>>
>>>> qserv-configure.py -R ~/qservDev/qserv-run
>>>> INFO: Qserv configuration tool
>>>> =======================================================================
>>>> INFO: Reading meta-configuration file
>>>> INFO: Defining main directory structure
>>>> INFO: Qserv directory structure creation succeeded
>>>> INFO: Qserv symlinks creation for externalized directories succeeded
>>>> INFO: Creating configuration files in
>>>> /usr/local/home/becla/qservDev/qserv-run/etc and scripts in
>>>> /usr/local/home/becla/qservDev/qserv-run/tmp
>>>> INFO: Creating configuration using templates files
>>>> CRITICAL: Template "QSERV_TESTDATA_DIR" in file
>>>> /usr/local/home/becla/qservDev/qserv-run/templates/server/etc/qserv-client.conf
>>>> is not defined in configuration tool
>>>>
>>>>
>>>> ---
>>>>
>>>>
>>>> qserv-configure.py
>>>> INFO: Qserv configuration tool
>>>> =======================================================================
>>>> INFO: Reading meta-configuration file
>>>> CRITICAL: qserv configuration file not found :
>>>> /usr/local/home/becla/qserv-run/2014_09.0/qserv.conf
>>>>
>>>>
>>>> You have been changing this code ~Sept 5. Does it work for you?
>>>>
>>>> Jacek
>>>>
>>>> ########################################################################
>>>>
>>>> Use REPLY-ALL to reply to list
>>>>
>>>> To unsubscribe from the QSERV-L list, click the following link:
>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>>> ########################################################################
>>> Use REPLY-ALL to reply to list
>>>
>>> To unsubscribe from the QSERV-L list, click the following link:
>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use