Print

Print


So for W13/case03:

CREATE TABLE `AvgForcedPhotYearly` (
   `deepSourceId` bigint(20) NOT NULL,
   `year` tinyint(4) NOT NULL,

but if I set id = deepSourceId
in AvgForcedPhotYearly.cfg then the loader return the error message:

[DEBUG] Loader: query: INSERT INTO 
qservTest_case03_qserv__AvgForcedPhotYearly SELECT deepSourceId, 
chunkId, subChunkId FROM qservTest_case03_qserv.AvgForcedPhotYearly_6995
[DEBUG] Loader: Deleting directory: 
/home/qserv/qserv-run/2014_12/tmp/loader_chunks/AvgForcedPhotYearly/tmplGJJTj
[DEBUG] Loader: Deleting directory: 
/home/qserv/qserv-run/2014_12/tmp/loader_chunks/AvgForcedPhotYearly
[CRITICAL] root: Exception occured: (1062, "Duplicate entry 
'1398579058967235' for key 'PRIMARY'")
Traceback (most recent call last):
   File "/home/qserv/src/qserv/bin/qserv-data-loader.py", line 249, in 
<module>
     sys.exit(loader.run())
   File "/home/qserv/src/qserv/bin/qserv-data-loader.py", line 217, in run
     self.loader.load(self.args.database, self.args.table, 
self.args.schema, self.args.data)
   File 
"/home/qserv/src/qserv/lib/python/lsst/qserv/admin/dataLoader.py", line 
147, in load
     return self._run(database, table, schema, data)
   File 
"/home/qserv/src/qserv/lib/python/lsst/qserv/admin/dataLoader.py", line 
188, in _run
     self._makeIndex(database, table)
   File 
"/home/qserv/src/qserv/lib/python/lsst/qserv/admin/dataLoader.py", line 
710, in _makeIndex
     cursor.execute(q)
   File "build/bdist.linux-x86_64/egg/MySQLdb/cursors.py", line 174, in 
execute
     self.errorhandler(self, exc, value)
   File "build/bdist.linux-x86_64/egg/MySQLdb/connections.py", line 36, 
in defaulterrorhandler
     raise errorclass, errorvalue
IntegrityError: (1062, "Duplicate entry '1398579058967235' for key 
'PRIMARY'")
--
2014-12-18 18:08:15,190 CRITICAL Error code returned by command : 
qserv-data-loader.py --verbose-all -vvv 
--config=/home/qserv/src/qserv_testdata/datasets/case03/data/common.cfg 
--css-remove --user=root --password=changeme 
--socket=/home/qserv/qserv-run/2014_12/var/lib/mysql/mysql.sock 
--empty-chunks=/home/qserv/qserv-run/2014_12/var/lib/qserv/empty_qservTest_case03_qserv.txt 
--delete-tables 
--config=/home/qserv/src/qserv_testdata/datasets/case03/data/AvgForcedPhotYearly.cfg 
--chunks-dir=/home/qserv/qserv-run/2014_12/tmp/loader_chunks/AvgForcedPhotYearly 
qservTest_case03_qserv AvgForcedPhotYearly 
/home/qserv/src/qserv_testdata/datasets/case03/data/AvgForcedPhotYearly.sql 
/home/qserv/src/qserv_testdata/datasets/case03/data/AvgForcedPhotYearly.txt.gz 


The key of this table is (deepSourceId,year), so it's normal to have 
duplicated deepSourceId.

Could you help please?

Cheers,


On 12/18/2014 04:50 PM, Salnikov, Andrei A. wrote:
>
> I should have said "it's a coumn name in a partitioned table
>
> which points to a ID column in a director table".
>
> Cheers,
> Andy
>
>
> *From:*Salnikov, Andrei A.
> *Sent:* Thursday, December 18, 2014 4:46 PM
> *To:* 'Fabrice Jammes'
> *Subject:* RE: [QSERV-L] LOADER: support for multi-column PK
>
> Why do you care about primary key? I don't think 'id' is related
>
> to primary key, it should be a column name in a director table.
>
> Cheers,
> Andy
>
> *From:*Fabrice Jammes [mailto:[log in to unmask]]
> *Sent:* Thursday, December 18, 2014 4:35 PM
> *To:* Salnikov, Andrei A.
> *Subject:* Fwd: [QSERV-L] LOADER: support for multi-column PK
>
> Andy,
>
> After a quick look at the data-loader code, I think you don't manage 
> 'id' as a list.
> I' think I need a patch to load data in integration test03.
>
> Thanks,
>
> Fabrice
>
>
>
> -------- Forwarded Message --------
>
> *Subject: *
>
> 	
>
> [QSERV-L] LOADER: support for multi-column PK
>
> *Date: *
>
> 	
>
> Thu, 18 Dec 2014 16:21:47 -0800
>
> *From: *
>
> 	
>
> Fabrice Jammes <[log in to unmask]> <mailto:[log in to unmask]>
>
> *To: *
>
> 	
>
> qserv-l <[log in to unmask]> <mailto:[log in to unmask]>
>
> Hello,
>   
> Do you know if I can specify a multi-column primary key in the id field
> of a cfg file?
> Indeed, for AvgForcedPhotYearly
> PRIMARY KEY is (`deepSourceId`,`year`),
>   
> Cheers,
>   
> Fabrice
>   
> ########################################################################
> Use REPLY-ALL to reply to list
>   
> To unsubscribe from the QSERV-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>


########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1