Attendees: AndyS, Serge, Fabrice, AndyH, Bill, Daniel, Jacek Agenda: - round table status report - post 3/15/2014 Qserv activities round table status report ========================= Serge - wrapping up WISE work, will be done this week - SciDB tests and LSST next Jacek - MariaDB (Aria/MyISAM tests) https://dev.lsstcorp.org/trac/wiki/db/tests/MySql/AriaVsMyISAM - suggestion: wait until "10.0.8 release candidate" will become an official release, then switch (just Qserv), then when it becomes "stable" release, switch lsst10. - revisited all W14 tasks - work on 2 XLDB workshops Bill - have all environment set up based on new qserv, in some places hacked old Douglas' config/startup scripts - document on trac - clean and commit the fixes - discussion: ideally would like logging prototype in separate package, but setting up no trivial, mostly because of swig, so for now continue using a qserv branch Daniel - most time spent on join syntax, have draft implementation, hopefully will have it working this week, then need feedback from Serge about api - tweaks to xldb report AndyH - new xrootd client 80% done, on track to deliver by 3/31 - getting busy (cern trip, organizing workshop) Fabrice - need to integrate install system (done by Fabrice) with build system (done by Daniel) - Daniel is going to pull Fabrice's proposed code for custom.py into the build system - Daniel will implement "prefix", need to open ticket for it. - phone call Monday 1pm pacific (Daniel/Fabrice/AndyS/Jacek) to discuss install/build integration AndyS - talked to Daniel about build system post 3/15/2014 Qserv activities (extracted from pmcs) ===================================================== finish before 3/15: * downselect db technology * Write XLDB 2013 report * New XRootD RPC interface implementation, --> split, open new task "test" 3/16-3/31 * Qserv design: distributed metadata/state * Qserv: query representation --> join syntax work is part of that, but we also wanted to do cleanup Serge suggested, open new task for S14 * Qserv design: data ingest and loading, serge will look * Qserv: Logging (software API) * Qserv: packaging, build install yes, but config in S14 * Qserv documentation * W14 database tune up move to S14: * Integrating Ref*Match into qserv * Develop new master-worker result system * Plug in new xrootd client * Qserv: setup new cluster at IN2P3 for continuous integration/testing --> check with Dominique when hardware arrives [Jacek] * MySQL wrapper delete: * Prepare to deploy qserv for small number of users (~10) * Qserv: User-friendly communication (syntax support) others: * Data ingest from pipeline – code refurbishing - not sure if there is enough interest from Apps Team, --> check with Mario/K-T [Jacek] * Qserv: Logging (distributed log collection) - perhaps NCSA could take lead on that? * Qserv: automated testbed * Qserv: setup infrastructure for continuous integration - this heavily depends on config script - config scripts need major refresh --> move to S14 * Qserv: unit testing (controller module) - this is not just about adding unit tests, but need to understand how to do unit tests, eg, build dummy version of the whole world that controller controls? --> move to S14 * Qserv: unit testing (query execution) --> maybe S14 * Qserv: unit testing (admin/loading) - think about it when planning S14 Jacek ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1