Daniel, AndyH, Douglas, Bill, Serge, Jacek


fdr related
  - need shared scans section from Daniel
  - need wike page with 300-node test descr from Douglas


release planning
  - need tasks (2-4 week worth of work) covering
    now-Aug 2014 (due Oct 9 to Jeff, Jacek coordinating)


discussion about automated testing:
  - use the same data for all tests
  - keep multiple qserv releases (for comparison)
  - run tests before cutting release, then do release,
    then install the release for future comparisons
  - once the core set of queries stabilize,
     it will be easier to compare, now some syntax
     still broken due to new parser
  --> Douglas will implement that


merge engine
  - useful for at least 2 cases:
     a) might be able to avoid subchunks
     b) can be used to subdivide largest tables


logging
  - distinction between local and distributed logging
    is impportant
  - logging is very difficult for large scale distributed
    systems, very few succeeded
  - dedicated discussion within the group, Tue morning 9:15
  - will write proposal about logging and discuss with
    the rest of DM


short term tasks:
* automated testbed
* ingest [Serge]
* logging [Bill likes this topic]
* supported syntax detection
* build system / code organization (scons),
   we are struggling with understanding how
   to use scons, how to structure code, how
   to write clean, proper scons
* packaging (eups?)
    - what about people outside of lsst...
* run time administration, distribution etc,
    - Douglas will write a page on trac
* distributed metadata mgmt
--> Jacek will reorg trac page to reflect that,
     and we will revisit what is left out



[discussion with KT after the meeting:
   - revisit partitioning/subchunking: consider
     tree vs list structure
   - side interface in addition to sql, for things like
     query progress, L3
   - supported syntax detection: pass syntax through
     and auto-validate, don't try to implement code for
     catching each syntax/condition separately]

Jacek

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1