Daniel, AndyH, Douglas, Bill, Serge, Jacek
fdr related
- need shared scans section from Daniel
- need wike page with 300-node test descr from Douglas
release planning
- need tasks (2-4 week worth of work) covering
now-Aug 2014 (due Oct 9 to Jeff, Jacek coordinating)
discussion about automated testing:
- use the same data for all tests
- keep multiple qserv releases (for comparison)
- run tests before cutting release, then do release,
then install the release for future comparisons
- once the core set of queries stabilize,
it will be easier to compare, now some syntax
still broken due to new parser
--> Douglas will implement that
merge engine
- useful for at least 2 cases:
a) might be able to avoid subchunks
b) can be used to subdivide largest tables
logging
- distinction between local and distributed logging
is impportant
- logging is very difficult for large scale distributed
systems, very few succeeded
- dedicated discussion within the group, Tue morning 9:15
- will write proposal about logging and discuss with
the rest of DM
short term tasks:
* automated testbed
* ingest [Serge]
* logging [Bill likes this topic]
* supported syntax detection
* build system / code organization (scons),
we are struggling with understanding how
to use scons, how to structure code, how
to write clean, proper scons
* packaging (eups?)
- what about people outside of lsst...
* run time administration, distribution etc,
- Douglas will write a page on trac
* distributed metadata mgmt
--> Jacek will reorg trac page to reflect that,
and we will revisit what is left out
[discussion with KT after the meeting:
- revisit partitioning/subchunking: consider
tree vs list structure
- side interface in addition to sql, for things like
query progress, L3
- supported syntax detection: pass syntax through
and auto-validate, don't try to implement code for
catching each syntax/condition separately]
Jacek
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
