 |
 |
Jacek, > Yes, for sure. I added a section about it to DataLoading page: > > https://dev.lsstcorp.org/trac/wiki/db/Qserv/DataLoading#Notesonusingmergeengineaspartofdataloading > > we would end up with 7.2 billion files... I think the average number of files contributing to a subchunk might be 1, or at most a few, unless the subchunks are a lot bigger than I thought. Just look at the number of rows per file if Jacek were correct. And are all the files open at all times? Or only when a table is accessed? Is it ridiculous in terms of overhead or scheduling or something else to have one MySQL server (and hence process) per chunk? -- Kian-Tat Lim, LSST Data Management, [log in to unmask] ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1