Attendees: Serge, Daniel, Douglas, KT, Jacek
* supporting multiple instances of qserv on single machine
- almost there, worthwhile to finish
- configuring ports mostly done (by in2p3 team)
- still need to template the lua script
- consecutive port numbers: start from a single config
file, generate sub configs
- to use the code for configuring ports, need to fix
issues with requiring root access
- should not share /dev/shm/ between qserv instances
- solution: /dev/shm/qserv/qserv.<pid>
- the /dev/shm/qserv can be set through config file,
pid auto-appended by qserv
- might need to chmod /dev/shm/qserv to world-writable
- ok for chmod to fail if local policies disallow
- /dev/shm too small for intermediate results?
- no problem in short term,
- in long term it will be used only for caching,
and results will be streamed directly from worker
to master without hitting scratch space
- note: AndyH discourages running multiple xrootds
on one machine, we work-arounded it
--> document recent lessons learned [Jacek]
* releases
- use lsst buildbot (talk to Robyn)
- rerun every time master changes
- ok to redo full install each time, using existing scripts
- once full auto-test done, plug it in buildbot too
(installing qserv, loading data to qserv and plain mysql,
comparing results)
- master branch should always be stable please,
if you break it, you have to fix it asap
- for complex merges, we will use dedicated integration
branches
* setup W13 through qserv on lsst10?
- yes, try it, should be relatively easy [Douglas or Jacek]
* 120 note setup on yillis: uncovered very unusual bug,
see #2772 opened after mtg for details
nodes at @in2p3 coming in May
- in2p3 team planning to use puppet, not clear how easy
it will be to install qserv that way
- need to start working on it now to not delay large
scale tests
* large test files got committed to git (accidentally?)
by in2p3 team, this should not have happened, will
have to permanently remove from git
* partitioner code/ticket done, preparing for review
- fighting some issues with scons
Jacek
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
|