 |
 |
Hi Andy, I'm OK with this, DM-1724 created. Cheers, Fabrice On 12/19/2014 04:10 PM, Salnikov, Andrei A. wrote: > Hi Fabrice, > > I can make separate option for unzipped file location but I do not > think it has to be a required option. There will be cases when people > load uncompressed data and I don't want them to specify options > that are not used. Probably we can require it only if there are > compressed files given as input. Can you open a ticket for it? > > Cheers, > Andy > > > Fabrice Jammes wrote on 2014-12-19: >> Hi Andy, >> >> Maybe chunkDir could be renamed to workDir as it is also used to unzip >> input data for non partitioned table? >> If yes, it's documentation could also be updated. >> >> Indeed I first thought this directory wasn't used for non partitioned >> table so I didn't specified it, and its default value was used. >> Maybe we could also remove its default value (loader_chunks/ in the >> execution directory) and force the user to specify >> it? Indeed for now it creates this directory in the execution directory, >> this is dangerous in case of large amount of data. >> Imagine a sysadmin/DBA which would launch it on / and fill it. >> >> Cheers, >> >> Fabrice >> >> On 12/19/2014 03:19 PM, Fabrice Jammes wrote: >>> Hi Andy, >>> >>> partitioner derails on w13 input data, that's why I would need a >>> --keep-input-data option in data-loader, in order to easily test the >>> partitioner cmd-line. >>> This is not straightforward to add because input data is unzipped in >>> chunkDir, so if --keep-chunks option isn't specified input data will >>> be deleted. >>> It is of course also deleted if --keep-chunks is specified. >>> >>> For now I'll comment the code which remove this directory, but could >>> you please provide me this option? >>> >>> Thanks, >>> >>> Fabrice >>> >>> ######################################################################## >>> Use REPLY-ALL to reply to list >>> >>> To unsubscribe from the QSERV-L list, click the following link: >>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 > > ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1