LISTSERV mailing list manager LISTSERV 16.5

Help for QSERV-L Archives


QSERV-L Archives

QSERV-L Archives


QSERV-L@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

QSERV-L Home

QSERV-L Home

QSERV-L  March 2013

QSERV-L March 2013

Subject:

notes from qserv mtg (mar 14)

From:

Jacek Becla <[log in to unmask]>

Reply-To:

General discussion for qserv (LSST prototype baseline catalog)

Date:

Thu, 14 Mar 2013 14:10:40 -0700

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (74 lines)

Attendees: Serge, Daniel, Douglas, Jacek

db reviews will be renamed to:
  - "physical schema" --> "data products", it'll
    be project wide, not just dm-wide
  - "logical schema & qserv" --> "database architecture"


larger telecon (with KT, in2p3) planned for next
3rd week of each month), so Thu next week at 12pm pdt


need to update schema browser (add W13 schema)


Steve B. mentioned hyper-supreme-cam might be interested
in getting advice with db
  - they have plans to go up to 60 TB
  - 1h-oncePerMonth-level interactions would surely
    be useful for both sides


metadata (Jacek)
  - in-memory cache structures implemented, waiting
    for review
  - isRefMatch table flag implemented
  - ~2 more weeks to finish the work on integrating
    metadata into qserv, depends on interruptions
  - mention to in2p3 team that their ticket 2014 has
    been reviewed


Serge wrapping up work on partitioner tomorrow
  - then 1, max 2 weeks to wrap up work on duplicator


planning discussion
  - qserv needs to be modified to support refmatch
     - 2 weeks to implement using the old parser
     - or ~1/2 week using the (yet-unfinished) new parser
  - 2-3 weeks to finish the new parser
  - Serge can do the ref match plugging into qserv
    instead of work on thread scheduling
  - thread scheduling work touches the same code
    as shared scans
  --> revisit schedule for Serge next week


Daniel
  - done with exportpath, reviewed, merged,
    finishing documentation
  - back to writing parser (table aliasing)


Douglas:
  - w13 on lsst-db2, 2 installs (full, 1K objects) completed
     - proxy ports: 4040, 5040
  - had issues with how views were dumped
  - non-materialized views, especially if they have
    joins behind will be nontrivial to support in qserv
    --> avoid, or it will delay implementing core of qserv!
    --> and ask mysql gurus about potential issues
        related to views in mysql [Jacek]
  - test setup on yillies will be completed
    by beginning of next week

Jacek

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

March 2018
February 2018
January 2018
December 2017
August 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use