Some additional notes from the hangout:
Non-partitioned tables:
* Serge is concerned about the size of these tables that we're planning
on putting on a shared filesystem or replicating on every worker node.
He notes that Science_Ccd_Exposure itself will be about 1 billion
(relatively-wide) rows. 189 ccds * 5.5million images ~= 1 billion.
If we decide to partition it, we would need the addition of another
table type in the system (and greatly increase complexity in the
join-analysis code).
* Daniel hopes that we can have a wonderfully-cached shared filesystem
so we won't need such complicated code. Also, this is something that
won't be a big deal in early DR catalogs.
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
|