LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  September 2013

QSERV-L September 2013

Subject:

Re: Fwd: QMS and partitioning

From:

"Daniel L. Wang" <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Wed, 4 Sep 2013 13:26:44 -0700

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (55 lines)

Hi Bill,

> I believe you're recommending that I set up data replication using your mysqld on lsst-dev01 as the master and mine on lsst-dev03 as a slave. I don't believe this is trivial to set up (although, it doesn't look too hard):
> http://dev.mysql.com/doc/refman/5.0/en/replication-howto.html
This wasn't--I was trying to give you the simplest method that could 
work, and formal mysql replication is not the simplest. I'm glad you 
copied the data instead.

> Is there an obvious reason why I shouldn't simply copy the data over? Because, that's what I did. . .
No, that's exactly what I was hoping.

> I copied all object data over using mysqldump. I also copied the two qms databases. qserv and qms seem to startup okay, but I receive the following error in response to a simple query:
> mysql> select * from Object limit 1;
> ERROR 4120 (Proxy): Error during execution: 'open failed for chunk(s): 1234567890'
My understanding was that those databases were the only meta and data 
state that mattered to qserv (aside from the objectId indexes, which are 
in qservMeta for now). It seems that your emptychunks is incorrect, or 
the partitioning settings are still in disagreement. You should see the 
frontend print out its notion of table partitioning when it starts up. 
Mine prints:

Metadata Cache in C++:
db: LSST: is partitioned (nStripes=60, nSubStripes=18, defOvF=0.0001, 
defOvNN=0.25).
   Tables:
    Object: is partitioned (overlap=0.025, phiCol=ra_PS, 
thetaCol=decl_PS, objIdCol=objectId, phiColNo=2, thetaColNo=4, 
objIdColNo=0, logPart=2, physChunking=33).

    Source: is partitioned (overlap=0, phiCol=raObject, 
thetaCol=declObject, objIdCol=objectId, phiColNo=33, thetaColNo=34, 
objIdColNo=3, logPart=1, physChunking=33).

> Any suggestions?
>
> Also, what does your empyChunks.txt look like? I believe I need a copy of this.
Mine is located in lsst-dev01:/u1/lsst/run/master
The frontend should printout what chunks are being rejected as 'empty' 
as it prepares the query for execution, and you can verify whether the 
correct chunks are being rejected (or whether the master believes the 
table is partitioned at all).

I've updated the troubleshooting page to mention the qms, but feel free 
to add/correct it: 
https://dev.lsstcorp.org/trac/wiki/db/Qserv/Troubleshooting

Hope this helps,
-Daniel

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use