LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  June 2014

QSERV-L June 2014

Subject:

Re: qserv.conf

From:

Fabrice Jammes <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Mon, 2 Jun 2014 18:14:07 +0200

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (73 lines)

Hi Daniel and KT,

In my mind, installation/configuration/execution have to be tree 
distinct steps.
I think this will ease Qserv maintenance and modularity.

I'll try to provide a first implement of this modularity in 
https://jira.lsstcorp.org/browse/DM-622.

It will respect next rules :

- eups install directory will only contain immutable data
- a qserv_run_dir directory will be created outside of eups stack, it 
will contains configuration data, but also data related to execution 
like datadir or pid files.
- In DM-622, there will be a 1 to 1 relationship between a qserv_run_dir 
and a running Qserv instance. Here we will have to be carefull that a 
given qserv_run_dir is compliant with the Qserv instance which use it.

I hope that my DM-622 proposal will be optimized in later tickets.

About Daniel proposal, I think that generating configuration files from 
templates in init.d files can be a mix between configuration and execution ?
But this feature is worth being discussed : indeed the real 
configuration data is in qserv.conf and templates files, and not in 
configuration files which are only build products.

On my side, I think sysadmins would enjoy being able to update directly 
configuration files and then restart services with theses updated versions.
Furthermore, a classical sysadmin may not have to understand Qserv 
template procedure. He may run it only one time after install step in 
order to generate configuration files, and then edit them by hand (This 
doesn't prevent all worker configuration files to be on a shared system 
which distribute them to all nodes.)

That's why I propose to implement soon DM-622, using you previous 
remarks, and then to iterate from this first configuration procedure 
prototype ?

Have a nice day,

Fabrice

On 05/30/2014 09:19 PM, Kian-Tat Lim wrote:
> Daniel,
>
>> I would like to push for not generating any config files for qserv
>> services during setup or installation. Instead, we create a template
>> qserv.conf.in, that is human-editable. When trying to start any
>> service (czar, worker, proxy, mysql?, etc.), the startup script
>> reads that qserv.conf.in and generates the configuration for that
>> particular service, logs it in the appropriate file, and starts it.
>> If we do this, the services should almost always be consistently
>> configured (or will be, after a process kill/restart).
> 	I like this, except perhaps for the human-editable part.  For
> consistency across the cluster of machines, the meta-configuration needs
> to either be in a single shared repository or distributed in read-only
> form (the original source can be read/write).
>
> 	The other issue that comes to mind is this: if the
> meta-configuration is updated, is there a way to determine which
> underlying Qserv services need to be kicked/restarted, or do they all
> need to be?  One possible mechanism is to regenerate the config file,
> check it against the current version, and leave the process alone if
> nothing has changed.
>

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use