Jacek,
> Yes, for sure. I added a section about it to DataLoading page:
>
> https://dev.lsstcorp.org/trac/wiki/db/Qserv/DataLoading#Notesonusingmergeengineaspartofdataloading
>
> we would end up with 7.2 billion files...
I think the average number of files contributing to a subchunk
might be 1, or at most a few, unless the subchunks are a lot bigger than
I thought. Just look at the number of rows per file if Jacek were
correct.
And are all the files open at all times? Or only when a table
is accessed?
Is it ridiculous in terms of overhead or scheduling or something
else to have one MySQL server (and hence process) per chunk?
--
Kian-Tat Lim, LSST Data Management, [log in to unmask]
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
|