--

Dr George Beckett,

University of Edinburgh

Email: [log in to unmask]

Tel: +44 131 651 3577 (EPCC) /

      +44 131 6688 255 (Astronomy)

Web: http://www.epcc.ed.ac.uk/

--

Dr George Beckett,

University of Edinburgh

Email: [log in to unmask]

Tel: +44 131 651 3577 (EPCC) /

      +44 131 6688 255 (Astronomy)

Web: http://www.epcc.ed.ac.uk/

Hi Georges,

Yes I would be very interested to collaborate with you! Coudl we plan a phone call soon or a videoconf soon (URL: http://lst.st/nwb)? I'll be available on thursday and friday morning.
You might also be interested in XLDB2017 in France: http://xldb2017.uca.fr, there is a very interesting program and it take place in my city, so we could plan a few days to work together next to the conference.

Regards,

Fabrice


XLDB 2017 Conference in Clermont-Ferrand
Register now: http://xldb2017.uca.fr

De: "George Beckett" <[log in to unmask]>
À: "fabrice jammes" <[log in to unmask]>
Cc: "Bob Mann" <[log in to unmask]>
Envoyé: Mardi 8 Août 2017 12:39:47
Objet : Questions about 'Scaling Cloud for LSST catalogue at IN2P3'





Dear Fabrice,



I trust this email find you well. I recently read the slides from your talk at the Lyon workshop on ‘Scaling Cloud for LSST catalogue at IN2P3’ :



https://indico.in2p3.fr/event/13811/session/3/contribution/43/material/slides/0.pdf



Sadly I was unable to make the workshop, due to other commitments. However it would have been good to hear about you plans -- I am particularly interested in the Galactica project objective, to deploy Qserv onto a cloud (OpenStack+Ceph) environment.



Here in UK, the STFC research council has released a short-notice call for capital funding to provide computing infrastructure for significant physics experiments. Bob (cc’ed) and I are working on a proposal for a high-performance database infrastructure that can host both current astronomy catalogues and to provide a test-bed for future catalogues – most notably LSST. We are hoping to secure enough funding to deploy around 1PB of database storage distributed across 20—30 physical nodes, plus 10 or so further compute nodes for data-analysis applications.



It is important that we can make the infrastructure available to a wide number of groups and to support both transient and persistent database applications in a flexible manner. Given this, a cloud-like environment looks to be an attractive option, except that we are concerned that the overhead of running large-scale databases in the cloud may mean this is not possible (particularly, given the impact on I/O rates between storage and database nodes). However, Slide 17 of your talk suggests you have an idea about how to deploy a distributed database in the cloud, so that it wouldn’t suffer from I/O performance problems.



We would be interested to hear any thoughts on how to ensure databases (e.g. Qserv) run efficiently in the cloud and if you have made progress with the deployment you describe in Slide 17. Also, assuming we are successful to secure funding for the infrastructure, are you interest to collaborate on experiments with use of OpenStack and Ceph for this kind of service?



Thanks in advance for any help,

George.



Cc: Bob Mann.



--

Dr George Beckett,

University of Edinburgh



Email: [log in to unmask]

Tel: +44 131 651 3577 (EPCC) /

+44 131 6688 255 (Astronomy)

Web: http://www.epcc.ed.ac.uk/


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.