LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  February 2014

QSERV-L February 2014

Subject:

Notes from Qserv mtg (Feb 20)

From:

Jacek Becla <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Thu, 20 Feb 2014 14:24:59 -0800

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (131 lines)

Attendees: AndyS, Serge, Fabrice, AndyH, Bill, Daniel, Jacek


Agenda:
  - round table status report
  - post 3/15/2014 Qserv activities



round table status report
=========================

Serge
  - wrapping up WISE work, will be done this week
  - SciDB tests and LSST next


Jacek
  - MariaDB (Aria/MyISAM tests)
    https://dev.lsstcorp.org/trac/wiki/db/tests/MySql/AriaVsMyISAM
    - suggestion: wait until "10.0.8 release candidate" will become
      an official release, then switch (just Qserv), then when it
      becomes "stable" release, switch lsst10.
  - revisited all W14 tasks
  - work on 2 XLDB workshops


Bill
  - have all environment set up based on new qserv,
    in some places hacked old Douglas' config/startup scripts
    - document on trac
    - clean and commit the fixes
  - discussion: ideally would like logging prototype in
    separate package, but setting up no trivial, mostly
    because of swig, so for now continue using a qserv branch


Daniel
  - most time spent on join syntax, have draft implementation,
    hopefully will have it working this week, then need feedback
    from Serge about api
  - tweaks to xldb report


AndyH
  - new xrootd client 80% done, on track to deliver by 3/31
  - getting busy (cern trip, organizing workshop)


Fabrice
  - need to integrate install system (done by Fabrice) with
    build system (done by Daniel)
    - Daniel is going to pull Fabrice's proposed code for
      custom.py into the build system
    - Daniel will implement "prefix", need to open ticket for it.
  - phone call Monday 1pm pacific (Daniel/Fabrice/AndyS/Jacek)
    to discuss install/build integration


AndyS
  - talked to Daniel about build system


post 3/15/2014 Qserv activities (extracted from pmcs)
=====================================================

finish before 3/15:
  * downselect db technology
  * Write XLDB 2013 report
  * New XRootD RPC interface implementation, --> split, open new
    task "test" 3/16-3/31
  * Qserv design: distributed metadata/state
  * Qserv: query representation
     --> join syntax work is part of that, but we also wanted
      to do cleanup Serge suggested, open new task for S14
  * Qserv design: data ingest and loading, serge will look
  * Qserv: Logging (software API)
  * Qserv: packaging, build install yes, but config in S14
  * Qserv documentation
  * W14 database tune up


move to S14:
  * Integrating Ref*Match into qserv
  * Develop new master-worker result system
  * Plug in new xrootd client
  * Qserv: setup new cluster at IN2P3 for continuous integration/testing
    --> check with Dominique when hardware arrives [Jacek]
  * MySQL wrapper


delete:
  * Prepare to deploy qserv for small number of users (~10)
  * Qserv: User-friendly communication (syntax support)


others:
  * Data ingest from pipeline – code refurbishing
    - not sure if there is enough interest from Apps Team,
     --> check with Mario/K-T [Jacek]

  * Qserv: Logging (distributed log collection)
    - perhaps NCSA could take lead on that?

  * Qserv: automated testbed
  * Qserv: setup infrastructure for continuous integration
    - this heavily depends on config script
    - config scripts need major refresh
      --> move to S14

  * Qserv: unit testing (controller module)
    - this is not just about adding unit tests, but
      need to understand  how to do unit tests,
      eg, build dummy version of the whole world
      that controller controls?
    --> move to S14

  * Qserv: unit testing (query execution)
    --> maybe S14

  * Qserv: unit testing (admin/loading)
   - think about it when planning S14

Jacek

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use