LISTSERV 16.5 - QSERV-L Archives

Print

So for W13/case03:

CREATE TABLE `AvgForcedPhotYearly` (
`deepSourceId` bigint(20) NOT NULL,
`year` tinyint(4) NOT NULL,

but if I set id = deepSourceId
in AvgForcedPhotYearly.cfg then the loader return the error message:

[DEBUG] Loader: query: INSERT INTO qservTest_case03_qserv__AvgForcedPhotYearly SELECT deepSourceId, chunkId, subChunkId FROM qservTest_case03_qserv.AvgForcedPhotYearly_6995
[DEBUG] Loader: Deleting directory: /home/qserv/qserv-run/2014_12/tmp/loader_chunks/AvgForcedPhotYearly/tmplGJJTj
[DEBUG] Loader: Deleting directory: /home/qserv/qserv-run/2014_12/tmp/loader_chunks/AvgForcedPhotYearly
[CRITICAL] root: Exception occured: (1062, "Duplicate entry '1398579058967235' for key 'PRIMARY'")
Traceback (most recent call last):
File "/home/qserv/src/qserv/bin/qserv-data-loader.py", line 249, in <module>
    sys.exit(loader.run())
File "/home/qserv/src/qserv/bin/qserv-data-loader.py", line 217, in run
    self.loader.load(self.args.database, self.args.table, self.args.schema, self.args.data)
File "/home/qserv/src/qserv/lib/python/lsst/qserv/admin/dataLoader.py", line 147, in load
    return self._run(database, table, schema, data)
File "/home/qserv/src/qserv/lib/python/lsst/qserv/admin/dataLoader.py", line 188, in _run
    self._makeIndex(database, table)
File "/home/qserv/src/qserv/lib/python/lsst/qserv/admin/dataLoader.py", line 710, in _makeIndex
    cursor.execute(q)
File "build/bdist.linux-x86_64/egg/MySQLdb/cursors.py", line 174, in execute
    self.errorhandler(self, exc, value)
File "build/bdist.linux-x86_64/egg/MySQLdb/connections.py", line 36, in defaulterrorhandler
    raise errorclass, errorvalue
IntegrityError: (1062, "Duplicate entry '1398579058967235' for key 'PRIMARY'")
--
2014-12-18 18:08:15,190 CRITICAL Error code returned by command : qserv-data-loader.py --verbose-all -vvv --config=/home/qserv/src/qserv_testdata/datasets/case03/data/common.cfg --css-remove --user=root --password=changeme --socket=/home/qserv/qserv-run/2014_12/var/lib/mysql/mysql.sock --empty-chunks=/home/qserv/qserv-run/2014_12/var/lib/qserv/empty_qservTest_case03_qserv.txt --delete-tables --config=/home/qserv/src/qserv_testdata/datasets/case03/data/AvgForcedPhotYearly.cfg --chunks-dir=/home/qserv/qserv-run/2014_12/tmp/loader_chunks/AvgForcedPhotYearly qservTest_case03_qserv AvgForcedPhotYearly /home/qserv/src/qserv_testdata/datasets/case03/data/AvgForcedPhotYearly.sql /home/qserv/src/qserv_testdata/datasets/case03/data/AvgForcedPhotYearly.txt.gz

The key of this table is (deepSourceId,year), so it's normal to have duplicated deepSourceId.

Could you help please?

Cheers,

On 12/18/2014 04:50 PM, Salnikov, Andrei A. wrote:

[log in to unmask]" type="cite">
I should have said "it's a coumn name in a partitioned table

which points to a ID column in a director table".

Cheers,
Andy
From: Salnikov, Andrei A.
Sent: Thursday, December 18, 2014 4:46 PM
To: 'Fabrice Jammes'
Subject: RE: [QSERV-L] LOADER: support for multi-column PK

Why do you care about primary key? I don't think 'id' is related

to primary key, it should be a column name in a director table.

Cheers,
Andy
From: Fabrice Jammes [mailto:[log in to unmask]]
Sent: Thursday, December 18, 2014 4:35 PM
To: Salnikov, Andrei A.
Subject: Fwd: [QSERV-L] LOADER: support for multi-column PK

Andy,

After a quick look at the data-loader code, I think you don't manage 'id' as a list.
I' think I need a patch to load data in integration test03.

Thanks,

Fabrice
-------- Forwarded Message --------

Subject:

[QSERV-L] LOADER: support for multi-column PK

Date:

Thu, 18 Dec 2014 16:21:47 -0800

From:

Fabrice Jammes <[log in to unmask]>

To:

qserv-l <[log in to unmask]>
Hello,
 
Do you know if I can specify a multi-column primary key in the id field 
of a cfg file?
Indeed, for AvgForcedPhotYearly
PRIMARY KEY is (`deepSourceId`,`year`),
 
Cheers,
 
Fabrice
 
########################################################################
Use REPLY-ALL to reply to list
 
To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1