LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  March 2013

QSERV-L March 2013

Subject:

notes from qserv mtg (mar 28)

From:

Jacek Becla <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Thu, 28 Mar 2013 22:20:26 -0700

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (68 lines)

Attendees: Serge, Daniel, Douglas, KT, Jacek

* supporting multiple instances of qserv on single machine
   - almost there, worthwhile to finish
   - configuring ports mostly done (by in2p3 team)
     - still need to template the lua script
     - consecutive port numbers: start from a single config
       file, generate sub configs
     - to use the code for configuring ports, need to fix
       issues with requiring root access
   - should not share /dev/shm/ between qserv instances
      - solution: /dev/shm/qserv/qserv.<pid>
      - the /dev/shm/qserv can be set through config file,
        pid auto-appended by qserv
      - might need to chmod /dev/shm/qserv to world-writable
        - ok for chmod to fail if local policies disallow
      - /dev/shm too small for intermediate results?
        - no problem in short term,
        - in long term it will be used only for caching,
          and results will be streamed directly from worker
          to master without hitting scratch space
   - note: AndyH discourages running multiple xrootds
     on one machine, we work-arounded it
  --> document recent lessons learned [Jacek]


* releases
   - use lsst buildbot (talk to Robyn)
   - rerun every time master changes
   - ok to redo full install each time, using existing scripts
   - once full auto-test done, plug it in buildbot too
     (installing qserv, loading data to qserv and plain mysql,
     comparing results)
  - master branch should always be stable please,
    if you break it, you have to fix it asap
  - for complex merges, we will use dedicated integration
    branches


* setup W13 through qserv on lsst10?
  - yes, try it, should be relatively easy [Douglas or Jacek]


* 120 note setup on yillis: uncovered very unusual bug,
   see #2772 opened after mtg for details


nodes at @in2p3 coming in May
  - in2p3 team planning to use puppet, not clear how easy
    it will be to install qserv that way
  - need to start working on it now to not delay large
    scale tests

* large test files got committed to git (accidentally?)
   by in2p3 team, this should not have happened, will
   have to permanently remove from git

* partitioner code/ticket done, preparing for review
   - fighting some issues with scons

Jacek

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use