Print

Print


Attendees: AndyS, Serge, Fabrice, AndyH, Bill, Daniel, Jacek


Agenda:
  - round table status report
  - post 3/15/2014 Qserv activities



round table status report
=========================

Serge
  - wrapping up WISE work, will be done this week
  - SciDB tests and LSST next


Jacek
  - MariaDB (Aria/MyISAM tests)
    https://dev.lsstcorp.org/trac/wiki/db/tests/MySql/AriaVsMyISAM
    - suggestion: wait until "10.0.8 release candidate" will become
      an official release, then switch (just Qserv), then when it
      becomes "stable" release, switch lsst10.
  - revisited all W14 tasks
  - work on 2 XLDB workshops


Bill
  - have all environment set up based on new qserv,
    in some places hacked old Douglas' config/startup scripts
    - document on trac
    - clean and commit the fixes
  - discussion: ideally would like logging prototype in
    separate package, but setting up no trivial, mostly
    because of swig, so for now continue using a qserv branch


Daniel
  - most time spent on join syntax, have draft implementation,
    hopefully will have it working this week, then need feedback
    from Serge about api
  - tweaks to xldb report


AndyH
  - new xrootd client 80% done, on track to deliver by 3/31
  - getting busy (cern trip, organizing workshop)


Fabrice
  - need to integrate install system (done by Fabrice) with
    build system (done by Daniel)
    - Daniel is going to pull Fabrice's proposed code for
      custom.py into the build system
    - Daniel will implement "prefix", need to open ticket for it.
  - phone call Monday 1pm pacific (Daniel/Fabrice/AndyS/Jacek)
    to discuss install/build integration


AndyS
  - talked to Daniel about build system


post 3/15/2014 Qserv activities (extracted from pmcs)
=====================================================

finish before 3/15:
  * downselect db technology
  * Write XLDB 2013 report
  * New XRootD RPC interface implementation, --> split, open new
    task "test" 3/16-3/31
  * Qserv design: distributed metadata/state
  * Qserv: query representation
     --> join syntax work is part of that, but we also wanted
      to do cleanup Serge suggested, open new task for S14
  * Qserv design: data ingest and loading, serge will look
  * Qserv: Logging (software API)
  * Qserv: packaging, build install yes, but config in S14
  * Qserv documentation
  * W14 database tune up


move to S14:
  * Integrating Ref*Match into qserv
  * Develop new master-worker result system
  * Plug in new xrootd client
  * Qserv: setup new cluster at IN2P3 for continuous integration/testing
    --> check with Dominique when hardware arrives [Jacek]
  * MySQL wrapper


delete:
  * Prepare to deploy qserv for small number of users (~10)
  * Qserv: User-friendly communication (syntax support)


others:
  * Data ingest from pipeline – code refurbishing
    - not sure if there is enough interest from Apps Team,
     --> check with Mario/K-T [Jacek]

  * Qserv: Logging (distributed log collection)
    - perhaps NCSA could take lead on that?

  * Qserv: automated testbed
  * Qserv: setup infrastructure for continuous integration
    - this heavily depends on config script
    - config scripts need major refresh
      --> move to S14

  * Qserv: unit testing (controller module)
    - this is not just about adding unit tests, but
      need to understand  how to do unit tests,
      eg, build dummy version of the whole world
      that controller controls?
    --> move to S14

  * Qserv: unit testing (query execution)
    --> maybe S14

  * Qserv: unit testing (admin/loading)
   - think about it when planning S14

Jacek

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1