Bob,
On my side I'm very happy to help some adventurous early adopters :-)
My lab is located in Clermont-Ferrand, local LSST project manager is Emmanuel Gangler, local LSST computing manager is Philippe Gris, and Bogdan Vulpescu and I are engineers.
Bodgan explores multiple parts of LSST stack, both on the technical and science sides, and I'm fully dedicated to Qserv (I closely work with SLAC since a 3 years).
Are Marcus and Eckhard available right now for starting technical discussions? Which amount how data do you plan to load?
Here's the plan we could follow:
- The first step is to prepare a consistent, ~10MB, sample of your dataset.
- The second step is to integrate it in our integration tests, so that it will be automatically loaded on a Qserv mono-node instance. I can help here.
- Third step will be to determine manual data-loading procedure from point below. Bogdan Vulpescu and I might help here.
- Final step will be to set up a Qserv cluster and run manual data-loading procedure against it. We support CentOS7 + Docker on bare-metal or OpenStack infrasctructure.
Regards,
Fabrice
---------- Forwarded message ----------
From:
Bob Mann <[log in to unmask]>Date: 22 June 2016 at 17:53
Subject: ingesting data into qserv
To: "
[log in to unmask]" <
[log in to unmask]>
Cc: Dominique Boutigny <
[log in to unmask]>, "
[log in to unmask]" <
[log in to unmask]>, Eckhard Sutorius <
[log in to unmask]>, George Beckett <
[log in to unmask]>
Fabrice,
Apologies for emailing you out of the blue, but Dominique suggested your name as a contact from whom to seek advice about ingesting data into qserv.
As you may know, there is now a team in Edinburgh funded to make preparations for a UK DAC. and one of the things we are wanting to do is to load into qserv one of our own sky survey archives - probably one of the recent releases from UKIDSS - for which we have a log of user-executed queries, so that we can see how qserv performs on a realistic query workload.
We had heard from the LSST DM team that bulk ingest into qserv was still not easy, but that it had improved significantly recently, and Dominique suggested that you would be a good contact to find out more about that. Would you be able to offer us some advice on that? At our end, Marcus Ebert and Eckhard Sutorius (both Cc’d above) are the people doing the work, George Beckett is the LSST:Uk Project Manager and I am the LSST:UK Project Leader.
Many thanks
Bob Mann 
