Attendees: Serge, Daniel, Bill, Jacek

Serge
  - has workable design for the partitioner,
    implementing, need few more days

Daniel
  - export paths almost done, all tested, need to
    do final integration tests
  - then finishing parser, then shared scans
  - shared scans: ~2 weeks initial implementation,
    ~ 2 months total to complete

Jacek
  - working on qserv + metadata integration,
    might have it working in ~a week

Bill
  - issues with pluming, need to talk to Daniel
  - planning to finish error handling, maybe this
    week, and start work on fault tolerance


Helping Dave Monet
  - Dave run into issues in his local mysql and on lsst10
  - queries we saw him running in the past: dump
    everything from a given very large box
  - based on emails, queries he needs to run involve
    light curves for bright stars
  - existing data layout for ForcedSource not great
    (ccd-based)
  - pipeQA probably operates ccd-at-a-time, sorting
    the way we planned (by objectId) would help Dave
    but would make pipeQA worse
    --> need to check with pipeQA about access patterns
  - long term possibility: each replica sorted differently
     - would require some smarts in query scheduler
       to take advantage of this


new xrootd client
  - agreed on api with AndyH
  - Andy will provide a header
  - Daniel will figure which parts of qserv will be affected
    - parts of worker will need to be changed for sure
  - timescales:
     - implementing new client ~ 1 month
     - then integration 1-2 months
        - might not finish before large scale tests (late June)
          (Daniel busy with shared scans)
  - we will have new threading model on the master
    implemented before large scale tests
    - should help a lot with concurrency
    - having new threading model makes new xrootd client
      less critical
  - xrootd git branch
    - we are using special "lsst" branch of xrootd
      - features on that branch not exercised (eg related
        to load reporting and resource loading)
      - new client will be on the main branch of xrootd
      - we will switch


Technical Meeting
  - August 12 – 16 in Tucson
  - planning to have lots of internal qserv discussions
   (Daniel, Douglas, Serge, Jacek all going)

Jacek

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1