Hi Andy,

I'm OK with this, DM-1724 created.

Cheers,

Fabrice

On 12/19/2014 04:10 PM, Salnikov, Andrei A. wrote:
> Hi Fabrice,
>
> I can make separate option for unzipped file location but I do not
> think it has to be a required option. There will be cases when people
> load uncompressed data and I don't want them to specify options
> that are not used. Probably we can require it only if there are
> compressed files given as input. Can you open a ticket for it?
>
> Cheers,
> Andy
>
>
> Fabrice Jammes wrote on 2014-12-19:
>> Hi Andy,
>>
>> Maybe chunkDir could be renamed to workDir as it is also used to unzip
>> input data for non partitioned table?
>> If yes, it's documentation could also be updated.
>>
>> Indeed I first thought this directory wasn't used for non partitioned
>> table so I didn't specified it, and its default value was used.
>> Maybe we could also remove its default value (loader_chunks/ in the
>> execution directory) and force the user to specify
>> it? Indeed for now it creates this directory in the execution directory,
>> this is dangerous in case of large amount of data.
>> Imagine a sysadmin/DBA which would launch it on / and fill it.
>>
>> Cheers,
>>
>> Fabrice
>>
>> On 12/19/2014 03:19 PM, Fabrice Jammes wrote:
>>> Hi Andy,
>>>
>>> partitioner derails on w13 input data, that's why I would need a
>>> --keep-input-data option in data-loader, in order to easily test the
>>> partitioner cmd-line.
>>> This is not straightforward to add because input data is unzipped in
>>> chunkDir, so if --keep-chunks option isn't specified input data will
>>> be deleted.
>>> It is of course also deleted if --keep-chunks is specified.
>>>
>>> For now I'll comment the code which remove this directory, but could
>>> you please provide me this option?
>>>
>>> Thanks,
>>>
>>> Fabrice
>>>
>>> ########################################################################
>>> Use REPLY-ALL to reply to list
>>>
>>> To unsubscribe from the QSERV-L list, click the following link:
>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>
>

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1