--Apple-Mail=_CF2F8F8B-6EC0-4287-8183-124820265DA2 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iJwEAQEKAAYFAlXwhcwACgkQKcygTlDZAwJBZwQAhWPfor+ca+F2/VePfFcLcjea IVy3Gp0w5i1z7D5wp6VMuX4GpQnQgDgfvSDP8oxoOcf3GqHwDQ6KSJ2GQY8t3tlc 3Qag0sf5Z4cHgWpjTcfDVbtG8ST34wEI3E916xIaXZKpNWxjctpM8XEUTao1db28 rq5sbEsyUOTYELeq7qk= =wCPQ -----END PGP SIGNATURE----- --Apple-Mail=_CF2F8F8B-6EC0-4287-8183-124820265DA2-- ========================================================================= Date: Wed, 9 Sep 2015 20:12:23 +0000 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: "Van Klaveren, Brian N." <[log in to unmask]> Subject: Re: dynamic selection of utils Comments: To: "Becla, Jacek" <[log in to unmask]> Comments: cc: qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Content-Type: multipart/alternative; boundary="_000_BE0776952F20442194AEA3B8FEEE103Fslacstanfordedu_" MIME-Version: 1.0 Message-ID: <[log in to unmask]> --_000_BE0776952F20442194AEA3B8FEEE103Fslacstanfordedu_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable dbExists is probably best implemented this way: from sqlalchemy.inspection import inspect def dbExists(self, dbName): return dbName in inspect(self.engine).get_schema_names() Brian On Sep 9, 2015, at 12:17 PM, Becla, Jacek <[log in to unmask][log in to unmask]>> wrote: Begin forwarded message: From: Jacek Becla <[log in to unmask]> Subject: dynamic selection of utils Date: September 9, 2015 at 11:27:46 AM PDT To: Andy Salnikov <[log in to unmask]> Andy See attached, what do you think? Jacek ________________________________ Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 ________________________________ Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --_000_BE0776952F20442194AEA3B8FEEE103Fslacstanfordedu_ Content-Type: text/html; charset="us-ascii" Content-ID: <[log in to unmask]> Content-Transfer-Encoding: quoted-printable
dbExists is probably best implemented this way:

from sqlalchemy.inspection import inspect

def dbExists(self, dbName):
    return dbName in inspect(self.engine).ge= t_schema_names()

Brian


On Sep 9, 2015, at 12:17 PM, Becla, Jacek <[log in to unmask]" class=3D"">[log in to unmask]> wr= ote:



Begin forwarded message:

From: Jacek Becla <[log in to unmask]>
Subject: dynamic selection of util= s
Date: September 9, 2015 at 11:27:46 AM PDT
To: Andy Salnikov <[log in to unmask]" class=3D"">[log in to unmask]>

Andy

See attached, what do you think?

Jacek


Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click = the following link:
https://listserv.slac.stanford.edu/c= gi-bin/wa?SUBED1=3DQSERV-L&A=3D1

[log in to unmask]"><= ;utils.py>



Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click = the following link:
https://listserv.slac.stanford.edu/c= gi-bin/wa?SUBED1=3DQSERV-L&A=3D1




Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1

--_000_BE0776952F20442194AEA3B8FEEE103Fslacstanfordedu_-- ========================================================================= Date: Thu, 10 Sep 2015 10:31:24 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Jacek Becla <[log in to unmask]> Organization: SLAC National Accelerator Laboratory Subject: Re: dynamic selection of utils Comments: To: "Van Klaveren, Brian N." <[log in to unmask]> Comments: cc: qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> It is a nice and compact code, but looks very inefficient to me. It transfers all database names to client first, right? I tried my version and sqlalchemy.inspect, I called it 20 times, the timing was 0.014 (mine) vs 0.766 (inspect) - 54x difference Jacek On 09/09/2015 01:12 PM, Van Klaveren, Brian N. wrote: > dbExists is probably best implemented this way: > > from sqlalchemy.inspection import inspect > > def dbExists(self, dbName): > return dbName in inspect(self.engine).get_schema_names() > > Brian > > >> On Sep 9, 2015, at 12:17 PM, Becla, Jacek <[log in to unmask] >> > wrote: >> >> >> >>> Begin forwarded message: >>> >>> *From: *Jacek Becla <[log in to unmask] >>> > >>> *Subject: **dynamic selection of utils* >>> *Date: *September 9, 2015 at 11:27:46 AM PDT >>> *To: *Andy Salnikov <[log in to unmask] >>> > >>> >>> Andy >>> >>> See attached, what do you think? >>> >>> Jacek >> >> ------------------------------------------------------------------------ >> >> Use REPLY-ALL to reply to list >> >> To unsubscribe from the QSERV-L list, click the following link: >> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 >> >> >> >> >> ------------------------------------------------------------------------ >> >> Use REPLY-ALL to reply to list >> >> To unsubscribe from the QSERV-L list, click the following link: >> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 >> > ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 11 Sep 2015 10:34:37 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: Warning about Docker version on SL7 Comments: To: "[log in to unmask]" <[log in to unmask]> Comments: cc: qserv-l <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> Hi Fabio and Yvan, With Qserv team, we would like to test Qserv/Docker integration on IN2P3 cluster. Nevertheless, I can only install Docker 1.0.0 on SL7, and latest Docker version is 1.9. This problem could become a blocker soon as 1.0.0 lacks lots of features. Do you think it would be possible to switch to a distrib with better Docker support on ccqserv125 to ccqserv149, for test purpose? Cheers, Fabrice ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 11 Sep 2015 10:36:13 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Yvan Calas <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Fabrice Jammes <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/signed; boundary="Apple-Mail=_D924F354-95F5-4205-9BBB-236018D1675B"; protocol="application/pkcs7-signature"; micalg=sha1 Message-ID: <[log in to unmask]> --Apple-Mail=_D924F354-95F5-4205-9BBB-236018D1675B Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On 11 Sep 2015, at 10:34, Fabrice Jammes <[log in to unmask]> = wrote: >=20 > With Qserv team, we would like to test Qserv/Docker integration on = IN2P3 cluster. > Nevertheless, I can only install Docker 1.0.0 on SL7, and latest = Docker version is 1.9. > This problem could become a blocker soon as 1.0.0 lacks lots of = features. > Do you think it would be possible to switch to a distrib with better = Docker support on ccqserv125 to ccqserv149, for test purpose? Which distribution do you propose?=20 --- Yvan Calas CC-IN2P3 -- Storage Group 21 Avenue Pierre de Coubertin CS70202 F-69627 Villeurbanne Cedex Tel: +33 4 72 69 41 73 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --Apple-Mail=_D924F354-95F5-4205-9BBB-236018D1675B Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEtDCCBLAw ggOYoAMCAQICAwCGrTANBgkqhkiG9w0BAQUFADA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQwHhcNMTQwNjI4MTcyODM4WhcNMTYwNjI3MTcyODM4 WjBqMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEQMA4GA1UECxMHVVNSNjQwMjETMBEGA1UE AxMKWXZhbiBDYWxhczElMCMGCSqGSIb3DQEJARYWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjCCASIw DQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMSunBFU9vojz8GC5ZKIR+JJZi8z+HhashdpRv8E practHl/AMcbu+IjRg4NNDjbfGaNvk5ELhAidvLo9usY71KgH2ApfRznLvkf+9QkNSXbAv1P+B66 NNps3a4+pS9fiaLls19PD5zDpYNLZpSS25uvNG7Bl2N+LznvR+OXjo7B02mH6VpnafAz1aE9V+8f GWi9D3SLeOxihxFJ3IbcuMNx4NYdkrrA6LqsROVqsxOOSvh/2T/9eh56wgMrU9fdBPpJCxPZB+PD YWDSlsr4QUbbniyFSg6H6pynBfy/zHa3aTMY3ih2CQ1Vk0ObO+UvuJDqs/ysQlW6CUss2lG/GVcC AwEAAaOCAZIwggGOMAwGA1UdEwEB/wQCMAAwEQYJYIZIAYb4QgEBBAQDAgSwMA4GA1UdDwEB/wQE AwIF4DB6BglghkgBhvhCAQ0EbRZrQ2VydGlmaWNhdCBDTlJTMi1TdGFuZGFyZC4gUG91ciB0b3V0 ZSBpbmZvcm1hdGlvbiBzZSByZXBvcnRlciDgIGh0dHA6Ly9pZ2Muc2VydmljZXMuY25ycy5mci9D TlJTMi1TdGFuZGFyZC8wHQYDVR0OBBYEFJGL2oqbAMIamqx0cqg1ux4+m7DZMFQGA1UdIwRNMEuA FBHj2dFSRxtZsTwbeGZr9KGI7QpboTCkLjAsMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEO MAwGA1UEAxMFQ05SUzKCAQMwIQYDVR0RBBowGIEWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjBHBgNV HR8EQDA+MDygOqA4hjZodHRwOi8vY3Jscy5zZXJ2aWNlcy5jbnJzLmZyL0NOUlMyLVN0YW5kYXJk L2dldGRlci5jcmwwDQYJKoZIhvcNAQEFBQADggEBAI7ogIxm+kXORLbkiS1fdcSWFYqe5V15msMu WHAALFaiAah3AYKUFJvbZpknGb4p3RfDbNoynwVTBClAHE8+T5e4NGQSxtTo5gHuaSu214aV8iJD 1xOaUkBKkKOGXPfSd2LsumyfhxRvvc1wrSH0zIZnBWUS1i9NTeDmP8z1hFvC0hV6s/XJuBV7O3nc gTZXLRTJYCX3o0xF/4wDkES8319+7E4bRka8mR0a4MCmsKy7U44910gY809VYQF2uNQSq/wDUXnH juTqnYkTJOo23NwZiVkwusxGckv2eGw3feeHLR9qc+Dw/NJI2glNE6ifBqddHgtcZF2tWf1cBwD7 w6oxggJfMIICWwIBATA8MDUxCzAJBgNVBAYTAkZSMQ0wCwYDVQQKEwRDTlJTMRcwFQYDVQQDEw5D TlJTMi1TdGFuZGFyZAIDAIatMAkGBSsOAwIaBQCggfkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMTUwOTExMDgzNjE0WjAjBgkqhkiG9w0BCQQxFgQUMru3FFVobq+l kZtOtoLPFxzQph0wSwYJKwYBBAGCNxAEMT4wPDA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQCAwCGrTBNBgsqhkiG9w0BCRACCzE+oDwwNTELMAkG A1UEBhMCRlIxDTALBgNVBAoTBENOUlMxFzAVBgNVBAMTDkNOUlMyLVN0YW5kYXJkAgMAhq0wDQYJ KoZIhvcNAQEBBQAEggEAqGJnkDO9U4AhQjqtAoo8eIEDre87biIhRiMpezg7XqFAjoPpMt5ZPpCC jrsnrSlW6s4Oxx00NB9Ey6Yxj6x2+yqPonNBG89f8KUhZe/IoRfPHjWQfwn7gBtZF6IR7nl6yope bzswPuqmp2LkmUIRy/ZGaYXimXBvBFFic4ZNqY0y2QVFBoDiw/QNTWqRYi5EZqZGlIb/avsCBlcH V0H77RonJPNvEloWQwlKeIvBM37284+RlpFzwJUnV9ArIIM7N9HDrgdm+uxoahcs3Q14gXKAcIiU vnR8fBygiBL8smiaeMkS26uwUnyrcfjOsDmgKJ2UNVyHSVI3voQ8HXMBHAAAAAAAAA== --Apple-Mail=_D924F354-95F5-4205-9BBB-236018D1675B-- ========================================================================= Date: Fri, 11 Sep 2015 10:42:04 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Yvan Calas <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="------------000804050303020807050908" Message-ID: <[log in to unmask]> This is a multi-part message in MIME format. --------------000804050303020807050908 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 09/11/2015 10:36 AM, Yvan Calas wrote: >> On 11 Sep 2015, at 10:34, Fabrice Jammes <[log in to unmask]> wrote: >> >> With Qserv team, we would like to test Qserv/Docker integration on IN2P3 cluster. >> Nevertheless, I can only install Docker 1.0.0 on SL7, and latest Docker version is 1.9. >> This problem could become a blocker soon as 1.0.0 lacks lots of features. >> Do you think it would be possible to switch to a distrib with better Docker support on ccqserv125 to ccqserv149, for test purpose? > Which distribution do you propose? > > --- > Yvan Calas > CC-IN2P3 -- Storage Group > 21 Avenue Pierre de Coubertin > CS70202 > F-69627 Villeurbanne Cedex > Tel: +33 4 72 69 41 73 > > > ######################################################################## > Use REPLY-ALL to reply to list > > To unsubscribe from the QSERV-L list, click the following link: > https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 Hi Yvan, I think CentOS7 would be the less disruptive distro we could switch to. Furthermore it is Docker-supporter:https://docs.docker.com/installation/ Cheers, Fabrice ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 --------------000804050303020807050908 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 7bit
On 09/11/2015 10:36 AM, Yvan Calas wrote:
[log in to unmask]" type="cite">

      
On 11 Sep 2015, at 10:34, Fabrice Jammes <[log in to unmask]> wrote:

With Qserv team, we would like to test Qserv/Docker integration on IN2P3 cluster.
Nevertheless, I can only install Docker 1.0.0 on SL7, and latest Docker version is 1.9.
This problem could become a blocker soon as 1.0.0 lacks lots of features.
Do you think it would be possible to switch to a distrib with better Docker support on ccqserv125 to ccqserv149, for test purpose?
Which distribution do you propose? 

---
Yvan Calas
CC-IN2P3 -- Storage Group
21 Avenue Pierre de Coubertin
CS70202
F-69627 Villeurbanne Cedex
Tel: +33 4 72 69 41 73


########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
Hi Yvan,

I think CentOS7 would be the less disruptive distro we could switch to.
Furthermore it is Docker-supporter: https://docs.docker.com/installation/

Cheers,

Fabrice


Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

--------------000804050303020807050908-- ========================================================================= Date: Fri, 11 Sep 2015 10:45:49 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Yvan Calas <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Fabrice Jammes <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/signed; boundary="Apple-Mail=_F072E07A-94C9-4245-870B-C05D30FD30FB"; protocol="application/pkcs7-signature"; micalg=sha1 Message-ID: <[log in to unmask]> --Apple-Mail=_F072E07A-94C9-4245-870B-C05D30FD30FB Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 > On 11 Sep 2015, at 10:42, Fabrice Jammes <[log in to unmask]> = wrote: >=20 > I think CentOS7 would be the less disruptive distro we could switch = to. > Furthermore it is Docker-supporter: = https://docs.docker.com/installation/ Ok I will ask to our sysadmins if it can be done easily/quickly ;) BTW, did you try to install the following package instead:=20 = http://rpm.pbone.net/index.php3/stat/4/idpl/30712489/dir/scientific_linux_= 7/com/docker-1.7.1-108.sl7.x86_64.rpm.html --- Yvan Calas CC-IN2P3 -- Storage Group 21 Avenue Pierre de Coubertin CS70202 F-69627 Villeurbanne Cedex Tel: +33 4 72 69 41 73 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --Apple-Mail=_F072E07A-94C9-4245-870B-C05D30FD30FB Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEtDCCBLAw ggOYoAMCAQICAwCGrTANBgkqhkiG9w0BAQUFADA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQwHhcNMTQwNjI4MTcyODM4WhcNMTYwNjI3MTcyODM4 WjBqMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEQMA4GA1UECxMHVVNSNjQwMjETMBEGA1UE AxMKWXZhbiBDYWxhczElMCMGCSqGSIb3DQEJARYWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjCCASIw DQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMSunBFU9vojz8GC5ZKIR+JJZi8z+HhashdpRv8E practHl/AMcbu+IjRg4NNDjbfGaNvk5ELhAidvLo9usY71KgH2ApfRznLvkf+9QkNSXbAv1P+B66 NNps3a4+pS9fiaLls19PD5zDpYNLZpSS25uvNG7Bl2N+LznvR+OXjo7B02mH6VpnafAz1aE9V+8f GWi9D3SLeOxihxFJ3IbcuMNx4NYdkrrA6LqsROVqsxOOSvh/2T/9eh56wgMrU9fdBPpJCxPZB+PD YWDSlsr4QUbbniyFSg6H6pynBfy/zHa3aTMY3ih2CQ1Vk0ObO+UvuJDqs/ysQlW6CUss2lG/GVcC AwEAAaOCAZIwggGOMAwGA1UdEwEB/wQCMAAwEQYJYIZIAYb4QgEBBAQDAgSwMA4GA1UdDwEB/wQE AwIF4DB6BglghkgBhvhCAQ0EbRZrQ2VydGlmaWNhdCBDTlJTMi1TdGFuZGFyZC4gUG91ciB0b3V0 ZSBpbmZvcm1hdGlvbiBzZSByZXBvcnRlciDgIGh0dHA6Ly9pZ2Muc2VydmljZXMuY25ycy5mci9D TlJTMi1TdGFuZGFyZC8wHQYDVR0OBBYEFJGL2oqbAMIamqx0cqg1ux4+m7DZMFQGA1UdIwRNMEuA FBHj2dFSRxtZsTwbeGZr9KGI7QpboTCkLjAsMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEO MAwGA1UEAxMFQ05SUzKCAQMwIQYDVR0RBBowGIEWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjBHBgNV HR8EQDA+MDygOqA4hjZodHRwOi8vY3Jscy5zZXJ2aWNlcy5jbnJzLmZyL0NOUlMyLVN0YW5kYXJk L2dldGRlci5jcmwwDQYJKoZIhvcNAQEFBQADggEBAI7ogIxm+kXORLbkiS1fdcSWFYqe5V15msMu WHAALFaiAah3AYKUFJvbZpknGb4p3RfDbNoynwVTBClAHE8+T5e4NGQSxtTo5gHuaSu214aV8iJD 1xOaUkBKkKOGXPfSd2LsumyfhxRvvc1wrSH0zIZnBWUS1i9NTeDmP8z1hFvC0hV6s/XJuBV7O3nc gTZXLRTJYCX3o0xF/4wDkES8319+7E4bRka8mR0a4MCmsKy7U44910gY809VYQF2uNQSq/wDUXnH juTqnYkTJOo23NwZiVkwusxGckv2eGw3feeHLR9qc+Dw/NJI2glNE6ifBqddHgtcZF2tWf1cBwD7 w6oxggJfMIICWwIBATA8MDUxCzAJBgNVBAYTAkZSMQ0wCwYDVQQKEwRDTlJTMRcwFQYDVQQDEw5D TlJTMi1TdGFuZGFyZAIDAIatMAkGBSsOAwIaBQCggfkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMTUwOTExMDg0NTQ5WjAjBgkqhkiG9w0BCQQxFgQUp4Gn/XBUBMjT 7tbOwB4zWK7LIBIwSwYJKwYBBAGCNxAEMT4wPDA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQCAwCGrTBNBgsqhkiG9w0BCRACCzE+oDwwNTELMAkG A1UEBhMCRlIxDTALBgNVBAoTBENOUlMxFzAVBgNVBAMTDkNOUlMyLVN0YW5kYXJkAgMAhq0wDQYJ KoZIhvcNAQEBBQAEggEActPUJjVw24TlqcpmZn1BWcXbnDXzOsF1CpT6TOUt6p8Vc1Cwu8dbaxIk 8VEJZkx7zWYF7zIqzszeLJlRnn1focylwIHorlmGWd+RAqM1iKGLItCrlgpA+mBwZnONwW7xQhAm DFaJ6pe3UmMU2kkQoI5FRGWgzGe/nVv2TK8d+LdmESGFKowKJNlDRqkl9M+9lHfXNybnQesVaU6L FmAjYLEsPldfgRgo+EjiK8PPziQa/T65RZuJuiVTx+AgsAqSfOnoKSdUJ75Lbqi2roZ3/CF79bSh SX54Xk115qvJqR+WRCl1JZbNlIeQ7WNiOscnTVUoEyzASrLwyd3AOuph2wAAAAAAAA== --Apple-Mail=_F072E07A-94C9-4245-870B-C05D30FD30FB-- ========================================================================= Date: Fri, 11 Sep 2015 10:47:51 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Yvan Calas <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> On 09/11/2015 10:45 AM, Yvan Calas wrote: >> On 11 Sep 2015, at 10:42, Fabrice Jammes <[log in to unmask]> wrote: >> >> I think CentOS7 would be the less disruptive distro we could switch to. >> Furthermore it is Docker-supporter: https://docs.docker.com/installation/ > Ok I will ask to our sysadmins if it can be done easily/quickly ;) > > BTW, did you try to install the following package instead: > > http://rpm.pbone.net/index.php3/stat/4/idpl/30712489/dir/scientific_linux_7/com/docker-1.7.1-108.sl7.x86_64.rpm.html > > > > --- > Yvan Calas > CC-IN2P3 -- Storage Group > 21 Avenue Pierre de Coubertin > CS70202 > F-69627 Villeurbanne Cedex > Tel: +33 4 72 69 41 73 > > > ######################################################################## > Use REPLY-ALL to reply to list > > To unsubscribe from the QSERV-L list, click the following link: > https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 No I didn't try it. I'll try it today and let you know. 1.7 would be enough. Thanks :-) ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 11 Sep 2015 10:48:58 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Yvan Calas <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Fabrice Jammes <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/signed; boundary="Apple-Mail=_5D67FEA8-8F8D-4B6E-84F6-B5D34B5FD2EE"; protocol="application/pkcs7-signature"; micalg=sha1 Message-ID: <[log in to unmask]> --Apple-Mail=_5D67FEA8-8F8D-4B6E-84F6-B5D34B5FD2EE Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 > On 11 Sep 2015, at 10:47, Fabrice Jammes <[log in to unmask]> = wrote: >=20 > On 09/11/2015 10:45 AM, Yvan Calas wrote: >>> On 11 Sep 2015, at 10:42, Fabrice Jammes <[log in to unmask]> = wrote: >>>=20 >>> I think CentOS7 would be the less disruptive distro we could switch = to. >>> Furthermore it is Docker-supporter: = https://docs.docker.com/installation/ >> Ok I will ask to our sysadmins if it can be done easily/quickly ;) >>=20 >> BTW, did you try to install the following package instead: >>=20 >> = http://rpm.pbone.net/index.php3/stat/4/idpl/30712489/dir/scientific_linux_= 7/com/docker-1.7.1-108.sl7.x86_64.rpm.html >>=20 >>=20 >>=20 >> --- >> Yvan Calas >> CC-IN2P3 -- Storage Group >> 21 Avenue Pierre de Coubertin >> CS70202 >> F-69627 Villeurbanne Cedex >> Tel: +33 4 72 69 41 73 >>=20 >>=20 >> = ######################################################################## >> Use REPLY-ALL to reply to list >>=20 >> To unsubscribe from the QSERV-L list, click the following link: >> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 > No I didn't try it. I'll try it today and let you know. 1.7 would be = enough. And did you try to install the CentOS package on one of our qserv server = directly?. It should work as well... --- Yvan Calas CC-IN2P3 -- Storage Group 21 Avenue Pierre de Coubertin CS70202 F-69627 Villeurbanne Cedex Tel: +33 4 72 69 41 73 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --Apple-Mail=_5D67FEA8-8F8D-4B6E-84F6-B5D34B5FD2EE Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEtDCCBLAw ggOYoAMCAQICAwCGrTANBgkqhkiG9w0BAQUFADA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQwHhcNMTQwNjI4MTcyODM4WhcNMTYwNjI3MTcyODM4 WjBqMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEQMA4GA1UECxMHVVNSNjQwMjETMBEGA1UE AxMKWXZhbiBDYWxhczElMCMGCSqGSIb3DQEJARYWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjCCASIw DQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMSunBFU9vojz8GC5ZKIR+JJZi8z+HhashdpRv8E practHl/AMcbu+IjRg4NNDjbfGaNvk5ELhAidvLo9usY71KgH2ApfRznLvkf+9QkNSXbAv1P+B66 NNps3a4+pS9fiaLls19PD5zDpYNLZpSS25uvNG7Bl2N+LznvR+OXjo7B02mH6VpnafAz1aE9V+8f GWi9D3SLeOxihxFJ3IbcuMNx4NYdkrrA6LqsROVqsxOOSvh/2T/9eh56wgMrU9fdBPpJCxPZB+PD YWDSlsr4QUbbniyFSg6H6pynBfy/zHa3aTMY3ih2CQ1Vk0ObO+UvuJDqs/ysQlW6CUss2lG/GVcC AwEAAaOCAZIwggGOMAwGA1UdEwEB/wQCMAAwEQYJYIZIAYb4QgEBBAQDAgSwMA4GA1UdDwEB/wQE AwIF4DB6BglghkgBhvhCAQ0EbRZrQ2VydGlmaWNhdCBDTlJTMi1TdGFuZGFyZC4gUG91ciB0b3V0 ZSBpbmZvcm1hdGlvbiBzZSByZXBvcnRlciDgIGh0dHA6Ly9pZ2Muc2VydmljZXMuY25ycy5mci9D TlJTMi1TdGFuZGFyZC8wHQYDVR0OBBYEFJGL2oqbAMIamqx0cqg1ux4+m7DZMFQGA1UdIwRNMEuA FBHj2dFSRxtZsTwbeGZr9KGI7QpboTCkLjAsMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEO MAwGA1UEAxMFQ05SUzKCAQMwIQYDVR0RBBowGIEWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjBHBgNV HR8EQDA+MDygOqA4hjZodHRwOi8vY3Jscy5zZXJ2aWNlcy5jbnJzLmZyL0NOUlMyLVN0YW5kYXJk L2dldGRlci5jcmwwDQYJKoZIhvcNAQEFBQADggEBAI7ogIxm+kXORLbkiS1fdcSWFYqe5V15msMu WHAALFaiAah3AYKUFJvbZpknGb4p3RfDbNoynwVTBClAHE8+T5e4NGQSxtTo5gHuaSu214aV8iJD 1xOaUkBKkKOGXPfSd2LsumyfhxRvvc1wrSH0zIZnBWUS1i9NTeDmP8z1hFvC0hV6s/XJuBV7O3nc gTZXLRTJYCX3o0xF/4wDkES8319+7E4bRka8mR0a4MCmsKy7U44910gY809VYQF2uNQSq/wDUXnH juTqnYkTJOo23NwZiVkwusxGckv2eGw3feeHLR9qc+Dw/NJI2glNE6ifBqddHgtcZF2tWf1cBwD7 w6oxggJfMIICWwIBATA8MDUxCzAJBgNVBAYTAkZSMQ0wCwYDVQQKEwRDTlJTMRcwFQYDVQQDEw5D TlJTMi1TdGFuZGFyZAIDAIatMAkGBSsOAwIaBQCggfkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMTUwOTExMDg0ODU4WjAjBgkqhkiG9w0BCQQxFgQULf6VnHT/UOCO 4F7xwb5aMU96sbcwSwYJKwYBBAGCNxAEMT4wPDA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQCAwCGrTBNBgsqhkiG9w0BCRACCzE+oDwwNTELMAkG A1UEBhMCRlIxDTALBgNVBAoTBENOUlMxFzAVBgNVBAMTDkNOUlMyLVN0YW5kYXJkAgMAhq0wDQYJ KoZIhvcNAQEBBQAEggEAXbuExdI/W9+73pxeJAakFCGWrD6FEfoQXe4ok31JsqpwJ5rP+UgxiihF wzBkIOplBvMjWfeSVUHp8UhATBknKeZ1EedA4qnbVbXZ9JiJYQzBsO7HwuBelCkx439vdkEwdnPz f41XCrJW6Pm//gsatzm/c1jqzDbe+gwvHKtrIZq+3T4nX12OHw4VicN8Zm9BVhmINptsYvRD4j4T CQXlVYofKEGkw649JWaxHGMLPSHgX9U2y87kYUpHe/V1bI115ccG2OExdT8S3e5zCqNBT2xfAklt V2jWc+3GLxHoGusM0gv3zJBJuh8S/AmpIV0h0IcKtj4avM5YMJ+1/GnfDgAAAAAAAA== --Apple-Mail=_5D67FEA8-8F8D-4B6E-84F6-B5D34B5FD2EE-- ========================================================================= Date: Fri, 11 Sep 2015 11:07:39 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Yvan Calas <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Message-ID: <[log in to unmask]> On 09/11/2015 10:48 AM, Yvan Calas wrote: >> On 11 Sep 2015, at 10:47, Fabrice Jammes <[log in to unmask]> wrote: >> >> On 09/11/2015 10:45 AM, Yvan Calas wrote: >>>> On 11 Sep 2015, at 10:42, Fabrice Jammes <[log in to unmask]> wrote: >>>> >>>> I think CentOS7 would be the less disruptive distro we could switch to. >>>> Furthermore it is Docker-supporter: https://docs.docker.com/installation/ >>> Ok I will ask to our sysadmins if it can be done easily/quickly ;) >>> >>> BTW, did you try to install the following package instead: >>> >>> http://rpm.pbone.net/index.php3/stat/4/idpl/30712489/dir/scientific_linux_7/com/docker-1.7.1-108.sl7.x86_64.rpm.html >>> >>> >>> >>> --- >>> Yvan Calas >>> CC-IN2P3 -- Storage Group >>> 21 Avenue Pierre de Coubertin >>> CS70202 >>> F-69627 Villeurbanne Cedex >>> Tel: +33 4 72 69 41 73 >>> >>> >>> ######################################################################## >>> Use REPLY-ALL to reply to list >>> >>> To unsubscribe from the QSERV-L list, click the following link: >>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 >> No I didn't try it. I'll try it today and let you know. 1.7 would be enough. > And did you try to install the CentOS package on one of our qserv server directly?. It should work as well... > > --- > Yvan Calas > CC-IN2P3 -- Storage Group > 21 Avenue Pierre de Coubertin > CS70202 > F-69627 Villeurbanne Cedex > Tel: +33 4 72 69 41 73 > Hi Yvan, It's been a few hour I'm working on these docker install issue. I easilly installed docker on Debian/stable and on CentOS but's it's really tricky to do it on SL7. Installing from rpm make me fall in cascading dependencies (see below), it would be better to have a yum repos which eanble install/upgrade in a few seconds. Could we please think in switching to CentOS7 please? [root@ccqserv149 fjammes]$ rpm -uvh docker-1.7.1-108.sl7.x86_64.rpm rpm: -uvh: unknown option [root@ccqserv149 fjammes]$ rpm -Uvh docker-1.7.1-108.sl7.x86_64.rpm warning: docker-1.7.1-108.sl7.x86_64.rpm: Header V4 DSA/SHA1 Signature, key ID 192a7d7d: NOKEY error: Failed dependencies: docker-selinux >= 1.7.1-108.sl7 is needed by docker-1.7.1-108.sl7.x86_64 subscription-manager is needed by docker-1.7.1-108.sl7.x86_64 [root@ccqserv149 fjammes]$ wget ftp://mirror.switch.ch/pool/4/mirror/scientificlinux/7x/external_products/extras/x86_64/docker-selinux-1.7.1-108.sl7.x86_64.rpm --2015-09-11 11:02:06-- ftp://mirror.switch.ch/pool/4/mirror/scientificlinux/7x/external_products/extras/x86_64/docker-selinux-1.7.1-108.sl7.x86_64.rpm Connecting to 134.158.239.70:3128... connected. Proxy request sent, awaiting response... 200 Gatewaying Length: 57916 (57K) [application/x-rpm] Saving to: ‘docker-selinux-1.7.1-108.sl7.x86_64.rpm’ 100%[===================================================================================================================================================================================================>] 57,916 --.-K/s in 0.03s 2015-09-11 11:02:06 (1.85 MB/s) - ‘docker-selinux-1.7.1-108.sl7.x86_64.rpm’ saved [57916/57916] [root@ccqserv149 fjammes]$ rpm -Uvh docker-selinux-1.7.1-108.sl7.x86_64.rpm warning: docker-selinux-1.7.1-108.sl7.x86_64.rpm: Header V4 DSA/SHA1 Signature, key ID 192a7d7d: NOKEY error: Failed dependencies: ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 11 Sep 2015 13:24:24 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Yvan Calas <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Fabrice Jammes <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/signed; boundary="Apple-Mail=_9818C00E-E7A7-40BE-9CB4-6129AD60A1EB"; protocol="application/pkcs7-signature"; micalg=sha1 Message-ID: <[log in to unmask]> --Apple-Mail=_9818C00E-E7A7-40BE-9CB4-6129AD60A1EB Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On 11 Sep 2015, at 11:07, Fabrice Jammes <[log in to unmask]> = wrote: >=20 > Hi Yvan, >=20 > It's been a few hour I'm working on these docker install issue. I = easilly installed docker on Debian/stable and on CentOS but's it's = really tricky to do it on SL7. > Installing from rpm make me fall in cascading dependencies (see = below), it would be better to have a yum repos which eanble = install/upgrade in a few seconds. > Could we please think in switching to CentOS7 please? I just succeeded to install the latest version of docker available on = the official repository [1] on ccqserv148:=20 = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D [root@ccqserv148 Docker]$ rpm -qa | grep docker docker-engine-1.8.2-1.el7.centos.x86_64 [root@ccqserv148 Docker]$ /etc/init.d/docker status docker.service - Docker Application Container Engine Loaded: loaded (/usr/lib/systemd/system/docker.service; disabled) Active: inactive (dead) Docs: https://docs.docker.com [root@ccqserv148 Docker]$ service docker start Starting docker (via systemctl): [ OK ] [root@ccqserv148 Docker]$ service docker status docker.service - Docker Application Container Engine Loaded: loaded (/usr/lib/systemd/system/docker.service; disabled) Active: active (running) since Fri 2015-09-11 13:17:43 CEST; 7s ago Docs: https://docs.docker.com Main PID: 100898 (docker) CGroup: /system.slice/docker.service =E2=94=94=E2=94=80100898 /usr/bin/docker daemon -H fd:// Sep 11 13:17:42 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:42.772067915+02:00" level=3Dinfo msg=3D"Option = DefaultDriver: bridge" Sep 11 13:17:42 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:42.772199789+02:00" level=3Dinfo msg=3D"Option = DefaultNetwork: bridge" Sep 11 13:17:43 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:43.033806093+02:00" level=3Dwarning = msg=3D"Running modprobe bridge nf_nat br_netfilter failed with message: = modprobe: WARNING: Module br_netfilter not f...r: exit status 1" Sep 11 13:17:43 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:43.037232245+02:00" level=3Dinfo msg=3D"Firewalld= running: false" Sep 11 13:17:43 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:43.212167116+02:00" level=3Dinfo msg=3D"Loading = containers: start." Sep 11 13:17:43 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:43.212635262+02:00" level=3Dinfo msg=3D"Loading = containers: done." Sep 11 13:17:43 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:43.212672089+02:00" level=3Dinfo msg=3D"Daemon = has completed initialization" Sep 11 13:17:43 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:43.212700779+02:00" level=3Dinfo msg=3D"Docker = daemon" commit=3D0a8c2e3 execdriver=3Dnative-0.2 = graphdriver=3Ddevicemapper version=3D1.8.2 Sep 11 13:17:43 ccqserv148 docker[100898]: = time=3D"2015-09-11T13:17:43.212841360+02:00" level=3Dinfo msg=3D"Listening= for HTTP on fd ()" Sep 11 13:17:43 ccqserv148 systemd[1]: Started Docker Application = Container Engine. Hint: Some lines were ellipsized, use -l to show in full. [root@ccqserv148 Docker]$ ps auxwww | grep docker root 100898 0.3 0.1 357324 18500 ? Ssl 13:17 0:00 = /usr/bin/docker daemon -H fd:// root 101073 0.0 0.0 112640 960 pts/2 S+ 13:18 0:00 grep = --color=3Dauto docker [root@ccqserv148 Docker]$ = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D Please try to do some further tests and if it is ok for you I will = deploy docker-engine on ccqserv{145..149}. Yvan [1] https://yum.dockerproject.org/repo/main/centos/7 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --Apple-Mail=_9818C00E-E7A7-40BE-9CB4-6129AD60A1EB Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEtDCCBLAw ggOYoAMCAQICAwCGrTANBgkqhkiG9w0BAQUFADA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQwHhcNMTQwNjI4MTcyODM4WhcNMTYwNjI3MTcyODM4 WjBqMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEQMA4GA1UECxMHVVNSNjQwMjETMBEGA1UE AxMKWXZhbiBDYWxhczElMCMGCSqGSIb3DQEJARYWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjCCASIw DQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMSunBFU9vojz8GC5ZKIR+JJZi8z+HhashdpRv8E practHl/AMcbu+IjRg4NNDjbfGaNvk5ELhAidvLo9usY71KgH2ApfRznLvkf+9QkNSXbAv1P+B66 NNps3a4+pS9fiaLls19PD5zDpYNLZpSS25uvNG7Bl2N+LznvR+OXjo7B02mH6VpnafAz1aE9V+8f GWi9D3SLeOxihxFJ3IbcuMNx4NYdkrrA6LqsROVqsxOOSvh/2T/9eh56wgMrU9fdBPpJCxPZB+PD YWDSlsr4QUbbniyFSg6H6pynBfy/zHa3aTMY3ih2CQ1Vk0ObO+UvuJDqs/ysQlW6CUss2lG/GVcC AwEAAaOCAZIwggGOMAwGA1UdEwEB/wQCMAAwEQYJYIZIAYb4QgEBBAQDAgSwMA4GA1UdDwEB/wQE AwIF4DB6BglghkgBhvhCAQ0EbRZrQ2VydGlmaWNhdCBDTlJTMi1TdGFuZGFyZC4gUG91ciB0b3V0 ZSBpbmZvcm1hdGlvbiBzZSByZXBvcnRlciDgIGh0dHA6Ly9pZ2Muc2VydmljZXMuY25ycy5mci9D TlJTMi1TdGFuZGFyZC8wHQYDVR0OBBYEFJGL2oqbAMIamqx0cqg1ux4+m7DZMFQGA1UdIwRNMEuA FBHj2dFSRxtZsTwbeGZr9KGI7QpboTCkLjAsMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEO MAwGA1UEAxMFQ05SUzKCAQMwIQYDVR0RBBowGIEWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjBHBgNV HR8EQDA+MDygOqA4hjZodHRwOi8vY3Jscy5zZXJ2aWNlcy5jbnJzLmZyL0NOUlMyLVN0YW5kYXJk L2dldGRlci5jcmwwDQYJKoZIhvcNAQEFBQADggEBAI7ogIxm+kXORLbkiS1fdcSWFYqe5V15msMu WHAALFaiAah3AYKUFJvbZpknGb4p3RfDbNoynwVTBClAHE8+T5e4NGQSxtTo5gHuaSu214aV8iJD 1xOaUkBKkKOGXPfSd2LsumyfhxRvvc1wrSH0zIZnBWUS1i9NTeDmP8z1hFvC0hV6s/XJuBV7O3nc gTZXLRTJYCX3o0xF/4wDkES8319+7E4bRka8mR0a4MCmsKy7U44910gY809VYQF2uNQSq/wDUXnH juTqnYkTJOo23NwZiVkwusxGckv2eGw3feeHLR9qc+Dw/NJI2glNE6ifBqddHgtcZF2tWf1cBwD7 w6oxggJfMIICWwIBATA8MDUxCzAJBgNVBAYTAkZSMQ0wCwYDVQQKEwRDTlJTMRcwFQYDVQQDEw5D TlJTMi1TdGFuZGFyZAIDAIatMAkGBSsOAwIaBQCggfkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMTUwOTExMTEyNDI1WjAjBgkqhkiG9w0BCQQxFgQUAdljXy2YYtHX TB07tbxvcmdcfsswSwYJKwYBBAGCNxAEMT4wPDA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQCAwCGrTBNBgsqhkiG9w0BCRACCzE+oDwwNTELMAkG A1UEBhMCRlIxDTALBgNVBAoTBENOUlMxFzAVBgNVBAMTDkNOUlMyLVN0YW5kYXJkAgMAhq0wDQYJ KoZIhvcNAQEBBQAEggEAU0PM2dHluh9AWZnF6MC7SNie+y1w9TH0qs2Qy4Mfvg9iBrs8i3hElGr4 8VvCu2EjrPWCYOobKD3PF3wvUwJHbL7mSgViCs+JVBJImyTuf31XeBfeK0t9H7S58hD3pZ0vO1A3 XGS9PcjvObNAUzpPmyPnPi9gBt+3tAMWffamljMPaLs0BWOY365Jv9wX7quIK+OGqAi8KgEK97g/ Fxbkjy4Hx6yTvZSsHkOX8Yy9iBTdOs2js1Ucz4glPpAn++ARdb6cH1BcEIMr9hyrd0u1Kju6Mg+3 +86VpP+ykZ0ES97HDbUsiSfOLp9a6p5Xpq4AlLG82pIe1UonAfzTdsOwiAAAAAAAAA== --Apple-Mail=_9818C00E-E7A7-40BE-9CB4-6129AD60A1EB-- ========================================================================= Date: Fri, 11 Sep 2015 14:46:36 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Yvan Calas <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Message-ID: <[log in to unmask]> On 09/11/2015 01:24 PM, Yvan Calas wrote: >> On 11 Sep 2015, at 11:07, Fabrice Jammes <[log in to unmask]> wrote: >> >> Hi Yvan, >> >> It's been a few hour I'm working on these docker install issue. I easilly installed docker on Debian/stable and on CentOS but's it's really tricky to do it on SL7. >> Installing from rpm make me fall in cascading dependencies (see below), it would be better to have a yum repos which eanble install/upgrade in a few seconds. >> Could we please think in switching to CentOS7 please? > I just succeeded to install the latest version of docker available on the official repository [1] on ccqserv148: > > ============================================================================== > [root@ccqserv148 Docker]$ rpm -qa | grep docker > docker-engine-1.8.2-1.el7.centos.x86_64 > > [root@ccqserv148 Docker]$ /etc/init.d/docker status > docker.service - Docker Application Container Engine > Loaded: loaded (/usr/lib/systemd/system/docker.service; disabled) > Active: inactive (dead) > Docs: https://docs.docker.com > > [root@ccqserv148 Docker]$ service docker start > Starting docker (via systemctl): [ OK ] > > [root@ccqserv148 Docker]$ service docker status > docker.service - Docker Application Container Engine > Loaded: loaded (/usr/lib/systemd/system/docker.service; disabled) > Active: active (running) since Fri 2015-09-11 13:17:43 CEST; 7s ago > Docs: https://docs.docker.com > Main PID: 100898 (docker) > CGroup: /system.slice/docker.service > └─100898 /usr/bin/docker daemon -H fd:// > > Sep 11 13:17:42 ccqserv148 docker[100898]: time="2015-09-11T13:17:42.772067915+02:00" level=info msg="Option DefaultDriver: bridge" > Sep 11 13:17:42 ccqserv148 docker[100898]: time="2015-09-11T13:17:42.772199789+02:00" level=info msg="Option DefaultNetwork: bridge" > Sep 11 13:17:43 ccqserv148 docker[100898]: time="2015-09-11T13:17:43.033806093+02:00" level=warning msg="Running modprobe bridge nf_nat br_netfilter failed with message: modprobe: WARNING: Module br_netfilter not f...r: exit status 1" > Sep 11 13:17:43 ccqserv148 docker[100898]: time="2015-09-11T13:17:43.037232245+02:00" level=info msg="Firewalld running: false" > Sep 11 13:17:43 ccqserv148 docker[100898]: time="2015-09-11T13:17:43.212167116+02:00" level=info msg="Loading containers: start." > Sep 11 13:17:43 ccqserv148 docker[100898]: time="2015-09-11T13:17:43.212635262+02:00" level=info msg="Loading containers: done." > Sep 11 13:17:43 ccqserv148 docker[100898]: time="2015-09-11T13:17:43.212672089+02:00" level=info msg="Daemon has completed initialization" > Sep 11 13:17:43 ccqserv148 docker[100898]: time="2015-09-11T13:17:43.212700779+02:00" level=info msg="Docker daemon" commit=0a8c2e3 execdriver=native-0.2 graphdriver=devicemapper version=1.8.2 > Sep 11 13:17:43 ccqserv148 docker[100898]: time="2015-09-11T13:17:43.212841360+02:00" level=info msg="Listening for HTTP on fd ()" > Sep 11 13:17:43 ccqserv148 systemd[1]: Started Docker Application Container Engine. > Hint: Some lines were ellipsized, use -l to show in full. > [root@ccqserv148 Docker]$ ps auxwww | grep docker > root 100898 0.3 0.1 357324 18500 ? Ssl 13:17 0:00 /usr/bin/docker daemon -H fd:// > root 101073 0.0 0.0 112640 960 pts/2 S+ 13:18 0:00 grep --color=auto docker > [root@ccqserv148 Docker]$ > ============================================================================== > > Please try to do some further tests and if it is ok for you I will deploy docker-engine on ccqserv{145..149}. > > Yvan > > > > > [1] https://yum.dockerproject.org/repo/main/centos/7 > Ok Yvan, thank you so much :-) ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 11 Sep 2015 15:03:44 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Yvan Calas <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Fabrice Jammes <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/signed; boundary="Apple-Mail=_F8ECB870-9E05-42FE-9B88-32010AD6AA12"; protocol="application/pkcs7-signature"; micalg=sha1 Message-ID: <[log in to unmask]> --Apple-Mail=_F8ECB870-9E05-42FE-9B88-32010AD6AA12 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On 11 Sep 2015, at 14:46, Fabrice Jammes <[log in to unmask]> = wrote: >=20 >> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D >>=20 >> Please try to do some further tests and if it is ok for you I will = deploy docker-engine on ccqserv{145..149}. >>=20 >>=20 > Ok Yvan, thank you so much :-) Fabrice, do you want docker-engine deployed on nodes ccqserv{125..149} ?=20= ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --Apple-Mail=_F8ECB870-9E05-42FE-9B88-32010AD6AA12 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEtDCCBLAw ggOYoAMCAQICAwCGrTANBgkqhkiG9w0BAQUFADA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQwHhcNMTQwNjI4MTcyODM4WhcNMTYwNjI3MTcyODM4 WjBqMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEQMA4GA1UECxMHVVNSNjQwMjETMBEGA1UE AxMKWXZhbiBDYWxhczElMCMGCSqGSIb3DQEJARYWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjCCASIw DQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMSunBFU9vojz8GC5ZKIR+JJZi8z+HhashdpRv8E practHl/AMcbu+IjRg4NNDjbfGaNvk5ELhAidvLo9usY71KgH2ApfRznLvkf+9QkNSXbAv1P+B66 NNps3a4+pS9fiaLls19PD5zDpYNLZpSS25uvNG7Bl2N+LznvR+OXjo7B02mH6VpnafAz1aE9V+8f GWi9D3SLeOxihxFJ3IbcuMNx4NYdkrrA6LqsROVqsxOOSvh/2T/9eh56wgMrU9fdBPpJCxPZB+PD YWDSlsr4QUbbniyFSg6H6pynBfy/zHa3aTMY3ih2CQ1Vk0ObO+UvuJDqs/ysQlW6CUss2lG/GVcC AwEAAaOCAZIwggGOMAwGA1UdEwEB/wQCMAAwEQYJYIZIAYb4QgEBBAQDAgSwMA4GA1UdDwEB/wQE AwIF4DB6BglghkgBhvhCAQ0EbRZrQ2VydGlmaWNhdCBDTlJTMi1TdGFuZGFyZC4gUG91ciB0b3V0 ZSBpbmZvcm1hdGlvbiBzZSByZXBvcnRlciDgIGh0dHA6Ly9pZ2Muc2VydmljZXMuY25ycy5mci9D TlJTMi1TdGFuZGFyZC8wHQYDVR0OBBYEFJGL2oqbAMIamqx0cqg1ux4+m7DZMFQGA1UdIwRNMEuA FBHj2dFSRxtZsTwbeGZr9KGI7QpboTCkLjAsMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEO MAwGA1UEAxMFQ05SUzKCAQMwIQYDVR0RBBowGIEWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjBHBgNV HR8EQDA+MDygOqA4hjZodHRwOi8vY3Jscy5zZXJ2aWNlcy5jbnJzLmZyL0NOUlMyLVN0YW5kYXJk L2dldGRlci5jcmwwDQYJKoZIhvcNAQEFBQADggEBAI7ogIxm+kXORLbkiS1fdcSWFYqe5V15msMu WHAALFaiAah3AYKUFJvbZpknGb4p3RfDbNoynwVTBClAHE8+T5e4NGQSxtTo5gHuaSu214aV8iJD 1xOaUkBKkKOGXPfSd2LsumyfhxRvvc1wrSH0zIZnBWUS1i9NTeDmP8z1hFvC0hV6s/XJuBV7O3nc gTZXLRTJYCX3o0xF/4wDkES8319+7E4bRka8mR0a4MCmsKy7U44910gY809VYQF2uNQSq/wDUXnH juTqnYkTJOo23NwZiVkwusxGckv2eGw3feeHLR9qc+Dw/NJI2glNE6ifBqddHgtcZF2tWf1cBwD7 w6oxggJfMIICWwIBATA8MDUxCzAJBgNVBAYTAkZSMQ0wCwYDVQQKEwRDTlJTMRcwFQYDVQQDEw5D TlJTMi1TdGFuZGFyZAIDAIatMAkGBSsOAwIaBQCggfkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMTUwOTExMTMwMzQ0WjAjBgkqhkiG9w0BCQQxFgQUBNr+SsopHgVr HQsTQZRYB5cbtV0wSwYJKwYBBAGCNxAEMT4wPDA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQCAwCGrTBNBgsqhkiG9w0BCRACCzE+oDwwNTELMAkG A1UEBhMCRlIxDTALBgNVBAoTBENOUlMxFzAVBgNVBAMTDkNOUlMyLVN0YW5kYXJkAgMAhq0wDQYJ KoZIhvcNAQEBBQAEggEApFRJEkhbWKzDfua3kDGhFcnX+gJ/w6bh/b7bZAfLsBTzIAPTLBujL6ON eWswLKanIIx5wICkytK2JPHofOk28MF+lNOakY/HM4aQ3jRs4Q6KZUqgrHHE2vHa7I+BqDJvafIF i8hErlpuwupIBCU6/km+Pj97khk5co/vTQStjVF6rEC/vjJ9Z2SHHabiqd30sa4zZ35gGXsrQWJO giACxJaENGuAndh6OpZmCL1DLK0K44Aw0xSyI5B03n3WygoGccGb/0hAupbH+RU4BSG6Z1w5pU6D 6OInsVb4XS7RXZVQVMDT0pix6qHFQqoer/kRSCUJIRHL9QgsND5pjZSzsQAAAAAAAA== --Apple-Mail=_F8ECB870-9E05-42FE-9B88-32010AD6AA12-- ========================================================================= Date: Fri, 11 Sep 2015 15:22:10 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Yvan Calas <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> On 09/11/2015 03:03 PM, Yvan Calas wrote: >> On 11 Sep 2015, at 14:46, Fabrice Jammes <[log in to unmask]> wrote: >> >>> ============================================================================== >>> >>> Please try to do some further tests and if it is ok for you I will deploy docker-engine on ccqserv{145..149}. >>> >>> >> Ok Yvan, thank you so much :-) > Fabrice, do you want docker-engine deployed on nodes ccqserv{125..149} ? > > Yes please :-); for now I'm copying data from ccqserv{100.124} to ccqserv{125..149} and than I'll use intensively docker. ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 11 Sep 2015 15:47:58 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Yvan Calas <[log in to unmask]> Subject: Re: Warning about Docker version on SL7 Comments: To: Fabrice Jammes <[log in to unmask]> Comments: cc: "[log in to unmask]" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/signed; boundary="Apple-Mail=_047931EA-957A-42A4-ABFA-4619A791FCD5"; protocol="application/pkcs7-signature"; micalg=sha1 Message-ID: <[log in to unmask]> --Apple-Mail=_047931EA-957A-42A4-ABFA-4619A791FCD5 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=windows-1252 > On 11 Sep 2015, at 15:22, Fabrice Jammes <[log in to unmask]> wrote: > > ccqserv{125..149} and than I'll use intensively docker. Ok done for those servers. ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 --Apple-Mail=_047931EA-957A-42A4-ABFA-4619A791FCD5 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEtDCCBLAw ggOYoAMCAQICAwCGrTANBgkqhkiG9w0BAQUFADA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQwHhcNMTQwNjI4MTcyODM4WhcNMTYwNjI3MTcyODM4 WjBqMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEQMA4GA1UECxMHVVNSNjQwMjETMBEGA1UE AxMKWXZhbiBDYWxhczElMCMGCSqGSIb3DQEJARYWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjCCASIw DQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMSunBFU9vojz8GC5ZKIR+JJZi8z+HhashdpRv8E practHl/AMcbu+IjRg4NNDjbfGaNvk5ELhAidvLo9usY71KgH2ApfRznLvkf+9QkNSXbAv1P+B66 NNps3a4+pS9fiaLls19PD5zDpYNLZpSS25uvNG7Bl2N+LznvR+OXjo7B02mH6VpnafAz1aE9V+8f GWi9D3SLeOxihxFJ3IbcuMNx4NYdkrrA6LqsROVqsxOOSvh/2T/9eh56wgMrU9fdBPpJCxPZB+PD YWDSlsr4QUbbniyFSg6H6pynBfy/zHa3aTMY3ih2CQ1Vk0ObO+UvuJDqs/ysQlW6CUss2lG/GVcC AwEAAaOCAZIwggGOMAwGA1UdEwEB/wQCMAAwEQYJYIZIAYb4QgEBBAQDAgSwMA4GA1UdDwEB/wQE AwIF4DB6BglghkgBhvhCAQ0EbRZrQ2VydGlmaWNhdCBDTlJTMi1TdGFuZGFyZC4gUG91ciB0b3V0 ZSBpbmZvcm1hdGlvbiBzZSByZXBvcnRlciDgIGh0dHA6Ly9pZ2Muc2VydmljZXMuY25ycy5mci9D TlJTMi1TdGFuZGFyZC8wHQYDVR0OBBYEFJGL2oqbAMIamqx0cqg1ux4+m7DZMFQGA1UdIwRNMEuA FBHj2dFSRxtZsTwbeGZr9KGI7QpboTCkLjAsMQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05SUzEO MAwGA1UEAxMFQ05SUzKCAQMwIQYDVR0RBBowGIEWeXZhbi5jYWxhc0BjYy5pbjJwMy5mcjBHBgNV HR8EQDA+MDygOqA4hjZodHRwOi8vY3Jscy5zZXJ2aWNlcy5jbnJzLmZyL0NOUlMyLVN0YW5kYXJk L2dldGRlci5jcmwwDQYJKoZIhvcNAQEFBQADggEBAI7ogIxm+kXORLbkiS1fdcSWFYqe5V15msMu WHAALFaiAah3AYKUFJvbZpknGb4p3RfDbNoynwVTBClAHE8+T5e4NGQSxtTo5gHuaSu214aV8iJD 1xOaUkBKkKOGXPfSd2LsumyfhxRvvc1wrSH0zIZnBWUS1i9NTeDmP8z1hFvC0hV6s/XJuBV7O3nc gTZXLRTJYCX3o0xF/4wDkES8319+7E4bRka8mR0a4MCmsKy7U44910gY809VYQF2uNQSq/wDUXnH juTqnYkTJOo23NwZiVkwusxGckv2eGw3feeHLR9qc+Dw/NJI2glNE6ifBqddHgtcZF2tWf1cBwD7 w6oxggJfMIICWwIBATA8MDUxCzAJBgNVBAYTAkZSMQ0wCwYDVQQKEwRDTlJTMRcwFQYDVQQDEw5D TlJTMi1TdGFuZGFyZAIDAIatMAkGBSsOAwIaBQCggfkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEH ATAcBgkqhkiG9w0BCQUxDxcNMTUwOTExMTM0NzU5WjAjBgkqhkiG9w0BCQQxFgQUrkrOIqtU0/DS LuMxQWHMp4ZKK20wSwYJKwYBBAGCNxAEMT4wPDA1MQswCQYDVQQGEwJGUjENMAsGA1UEChMEQ05S UzEXMBUGA1UEAxMOQ05SUzItU3RhbmRhcmQCAwCGrTBNBgsqhkiG9w0BCRACCzE+oDwwNTELMAkG A1UEBhMCRlIxDTALBgNVBAoTBENOUlMxFzAVBgNVBAMTDkNOUlMyLVN0YW5kYXJkAgMAhq0wDQYJ KoZIhvcNAQEBBQAEggEAYxRNe0R30bea0nSpF9hrqRGkW8QpyojJO7weAi0ARJbIGDDUKOn5ApaW KnwSrjh7nC8/KM7ACgmg6dleYjouXWIHx9EDFcLAaJbjM3QOmgCtU8ORcq8x+gcbM5nZDeUxIZmp fRnEQZKaUZu71h7QG0JcJeaJBqNQoELxSY6oRhqx6h49RxEGuyDRa3w5Ecr5J302h+E6JZsbsjqd OGOqk+yFpOr2mlQrav/BGDtnVKkUH7DpVszbZRyB9G9NBkW7x/IVUwDwGJGfeaPh9Jt+ts+MjWDQ zcv1esY+z7rze1EpGrkteu86KRshlT+YjdUzL/1UMMaS/ww5okjqe/KS1wAAAAAAAA== --Apple-Mail=_047931EA-957A-42A4-ABFA-4619A791FCD5-- ========================================================================= Date: Tue, 15 Sep 2015 14:49:14 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: Qserv cluster unavailable on September 22, 2015 Comments: To: qserv-l <[log in to unmask]> Comments: cc: Yvan Calas <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="------------060704010304000608080605" Message-ID: <[log in to unmask]> This is a multi-part message in MIME format. --------------060704010304000608080605 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Hi, For maintenance reasons, Qserv cluster will be unavailable on September 22, 2015. Cheers, Fabrice -------- Forwarded Message -------- Subject: Arrêt du CC le 22/09/2015 Date: Tue, 15 Sep 2015 14:07:20 +0200 From: Yvan Calas <[log in to unmask]> To: Fabrice Jammes <[log in to unmask]> Hello Fabrice, Lors de l'arrêt du CC prévu le 22 septembre 2015, le cluster Qserv sera indisponible toute la matinée (tests électriques dans la salle machine Vill2). Pourrais-tu faire cette annonce auprès de nos collègues à SLAC notamment? Merci, Yvan --- Yvan Calas CC-IN2P3 -- Storage Group 21 Avenue Pierre de Coubertin CS70202 F-69627 Villeurbanne Cedex Tel: +33 4 72 69 41 73 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 --------------060704010304000608080605 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit Hi,

For maintenance reasons, Qserv cluster will be unavailable on September 22, 2015.

Cheers,

Fabrice


-------- Forwarded Message --------
Subject: Arrêt du CC le 22/09/2015
Date: Tue, 15 Sep 2015 14:07:20 +0200
From: Yvan Calas <[log in to unmask]>
To: Fabrice Jammes <[log in to unmask]>


Hello Fabrice,

Lors de l'arrêt du CC prévu le 22 septembre 2015, le cluster Qserv sera indisponible toute la matinée (tests électriques dans la salle machine Vill2). Pourrais-tu faire cette annonce auprès de nos collègues à SLAC notamment? 

Merci,

Yvan

---
Yvan Calas
CC-IN2P3 -- Storage Group
21 Avenue Pierre de Coubertin
CS70202
F-69627 Villeurbanne Cedex
Tel: +33 4 72 69 41 73





Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

--------------060704010304000608080605-- ========================================================================= Date: Thu, 17 Sep 2015 15:01:09 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Jacek Becla <[log in to unmask]> Organization: SLAC National Accelerator Laboratory Subject: new use case for getEngineFrom Comments: To: Andy Salnikov <[log in to unmask]>, "Van Klaveren, Brian N." <[log in to unmask]>, qserv-l <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> imgserv has a new usecase, John is reading config file (host/port/user/password), and adds database name. While we could probably tweak imgserv to avoid that (because he is only working with one database at the moment), I do think it is a generic use case: there is nothing wrong with defining host/port/credentials in a file, and connecting to different databases using the file + db name, right? Our API does not support it now, and I want to avoid disassembling / assembling URLs. We now have https://github.com/lsst/db/blob/tickets/DM-2299/python/lsst/db/engineFactory.py How about tweaking getEngineFromFile as follows (pseudo, untested code): def getEngineFromFile(fileName, urlExtras): if fileName.startswith('~'): fileName = os.path.expanduser(fileName) parser = ConfigParser() parser.readfp(open(fileName), fileName) try: options = dict(parser.items("database")) except NoSectionError: log.error("File %s does not contain section 'database'" % fileName) raise if urlExtras: url = URL.make_url(options['url']) if urlExtras.host: url.host = urlExtras.host if urlExtras.port: url.port = urlExtras.port if urlExtras.user: url.user = urlExtras.user if urlExtras.password: url.password = urlExtras.password if urlExtras.database: url.database = urlExtras.database options.url = url return sqlalchemy.create_engine(options, "") and then we could just call: getEngineFromFile( "myFile.ini", URL(drivername="mysql+mysqldb", database = "mydb")) (BTW, I don't like that we have to specify driver name here) (docs for URL: https://github.com/zzzeek/sqlalchemy/blob/master/lib/sqlalchemy/engine/url.py) Thoughts? Jacek ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 18 Sep 2015 16:47:41 +0000 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: "Salnikov, Andrei A." <[log in to unmask]> Subject: Re: new use case for getEngineFrom Comments: To: "Becla, Jacek" <[log in to unmask]>, "Van Klaveren, Brian N." <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" Message-ID: <[log in to unmask]> SGkgSmFjZWssDQoNCkknbSBub3Qgc3VyZSB0aGF0IHdlIHNob3VsZCBzdXBwb3J0IGFsbCBwb3Nz aWJsZSB1c2UgY2FzZXMuDQpUaGF0IG1ldGhvZCBpcyBhIGNvbnZlbmllbmNlIG1ldGhvZCBhbmQg aXQncyBub3QgdGhhdCBjb21wbGljYXRlZCwNCml0IHNob3VsZCBiZSBwb3NzaWJsZSB0byBpbXBs ZW1lbnQgc29tZXRoaW5nIHNpbWlsYXIgaW4gY2xpZW50DQpjb2RlIHdoaWNoIGRvZXMgc29tZXRo aW5nIG5vbi1jb252ZW50aW9uYWwuIFN0aWxsIGlmIHlvdSB3YW50IHRvIA0KZG8gaXQgSSB3b3Vs ZCBub3QgdXNlIFVSTCBpbnN0YW5jZSB0byBwYXNzIG92ZXJyaWRlcyB0byB0aGUgbWV0aG9kLA0K VVJMIGNsYXNzIGlzIG5vdCBkZXNpZ25lZCB0byBwcm92aWRlIG9ubHkgaW5kaXZpZHVhbCBwaWVj ZXMsIGl0J3MNCnN1cHBvc2VkIHRvIGJlIGNvbXBsZXRlIFVSTC4gSSdkIHByb2JhYmx5IGp1c3Qg cGFzcyBhIGRpY3Rpb25hcnkNCndpdGgga2V5d29yZHM6DQoNCmRlZiBnZXRFbmdpbmVGcm9tRmls ZShmaWxlTmFtZSwgb3ZlcnJpZGVzPXt9KToNCiAgICAuLi4uDQoNCmdldEVuZ2luZUZyb21GaWxl KCJteUZpbGUuaW5pIiwgb3ZlcnJpZGVzPWRpY3QoZGF0YWJhc2U9Im15ZGIiKSkNCg0KDQpvciBl dmVuIGJldHRlciBzcGVjaWZ5IG92ZXJyaWRlcyBhcyByZWd1bGFyIGtleXdvcmQgcGFyYW1ldGVy czoNCg0KZGVmIGdldEVuZ2luZUZyb21GaWxlKGZpbGVOYW1lLA0KICAgICAgICAgICAgICAgICAg ICAgIGRyaXZlcm5hbWU9Tm9uZSwNCiAgICAgICAgICAgICAgICAgICAgICB1c2VybmFtZT1Ob25l LA0KICAgICAgICAgICAgICAgICAgICAgIHBhc3N3b3JkPU5vbmUsDQogICAgICAgICAgICAgICAg ICAgICAgaG9zdD1Ob25lLA0KICAgICAgICAgICAgICAgICAgICAgIHBvcnQ9Tm9uZSwNCiAgICAg ICAgICAgICAgICAgICAgICBkYXRhYmFzZT1Ob25lLA0KICAgICAgICAgICAgICAgICAgICAgIHF1 ZXJ5PU5vbmUpOg0KICAgIC4uLg0KDQoNCmdldEVuZ2luZUZyb21GaWxlKCJteUZpbGUuaW5pIiwg ZGF0YWJhc2U9Im15ZGIiKQ0KDQpDaGVlcnMsDQpBbmR5DQoNCg0KQmVjbGEsIEphY2VrIHdyb3Rl IG9uIDIwMTUtMDktMTc6DQo+IGltZ3NlcnYgaGFzIGEgbmV3IHVzZWNhc2UsIEpvaG4gaXMgcmVh ZGluZyBjb25maWcgZmlsZQ0KPiAoaG9zdC9wb3J0L3VzZXIvcGFzc3dvcmQpLCBhbmQgYWRkcyBk YXRhYmFzZSBuYW1lLg0KPiBXaGlsZSB3ZSBjb3VsZCBwcm9iYWJseSB0d2VhayBpbWdzZXJ2IHRv IGF2b2lkIHRoYXQNCj4gKGJlY2F1c2UgaGUgaXMgb25seSB3b3JraW5nIHdpdGggb25lIGRhdGFi YXNlIGF0IHRoZQ0KPiBtb21lbnQpLCBJIGRvIHRoaW5rIGl0IGlzIGEgZ2VuZXJpYyB1c2UgY2Fz ZTogdGhlcmUgaXMNCj4gbm90aGluZyB3cm9uZyB3aXRoIGRlZmluaW5nIGhvc3QvcG9ydC9jcmVk ZW50aWFscyBpbg0KPiBhIGZpbGUsIGFuZCBjb25uZWN0aW5nIHRvIGRpZmZlcmVudCBkYXRhYmFz ZXMgdXNpbmcNCj4gdGhlIGZpbGUgKyBkYiBuYW1lLCByaWdodD8NCj4gDQo+IE91ciBBUEkgZG9l cyBub3Qgc3VwcG9ydCBpdCBub3csIGFuZCBJIHdhbnQgdG8gYXZvaWQNCj4gZGlzYXNzZW1ibGlu ZyAvIGFzc2VtYmxpbmcgVVJMcy4NCj4gDQo+IFdlIG5vdyBoYXZlDQo+IA0KPiBodHRwczovL2dp dGh1Yi5jb20vbHNzdC9kYi9ibG9iL3RpY2tldHMvRE0tMjI5OS9weXRob24vbHNzdC9kYi9lbmdp bmVGYWN0b3J5LnB5DQo+IA0KPiBIb3cgYWJvdXQgdHdlYWtpbmcgZ2V0RW5naW5lRnJvbUZpbGUg YXMgZm9sbG93cyAocHNldWRvLCB1bnRlc3RlZCBjb2RlKToNCj4gDQo+IGRlZiBnZXRFbmdpbmVG cm9tRmlsZShmaWxlTmFtZSwgdXJsRXh0cmFzKToNCj4gICAgICBpZiBmaWxlTmFtZS5zdGFydHN3 aXRoKCd+Jyk6CQ0KPiAgICAgICAgICBmaWxlTmFtZSA9IG9zLnBhdGguZXhwYW5kdXNlcihmaWxl TmFtZSkNCj4gICAgICBwYXJzZXIgPSBDb25maWdQYXJzZXIoKQ0KPiAgICAgIHBhcnNlci5yZWFk ZnAob3BlbihmaWxlTmFtZSksIGZpbGVOYW1lKQ0KPiAgICAgIHRyeToNCj4gICAgICAgICAgb3B0 aW9ucyA9IGRpY3QocGFyc2VyLml0ZW1zKCJkYXRhYmFzZSIpKQ0KPiAgICAgIGV4Y2VwdCBOb1Nl Y3Rpb25FcnJvcjoNCj4gICAgICAgICAgbG9nLmVycm9yKCJGaWxlICVzIGRvZXMgbm90IGNvbnRh aW4gc2VjdGlvbiAnZGF0YWJhc2UnIiAlIGZpbGVOYW1lKQ0KPiAgICAgICAgICByYWlzZQ0KPiAg ICAgIGlmIHVybEV4dHJhczoNCj4gICAgICAgICAgdXJsID0gVVJMLm1ha2VfdXJsKG9wdGlvbnNb J3VybCddKQ0KPiAgICAgICAgICBpZiB1cmxFeHRyYXMuaG9zdDoNCj4gICAgICAgICAgICAgIHVy bC5ob3N0ID0gdXJsRXh0cmFzLmhvc3QNCj4gICAgICAgICAgaWYgdXJsRXh0cmFzLnBvcnQ6DQo+ ICAgICAgICAgICAgICB1cmwucG9ydCA9IHVybEV4dHJhcy5wb3J0DQo+ICAgICAgICAgIGlmIHVy bEV4dHJhcy51c2VyOg0KPiAgICAgICAgICAgICAgdXJsLnVzZXIgPSB1cmxFeHRyYXMudXNlcg0K PiAgICAgICAgICBpZiB1cmxFeHRyYXMucGFzc3dvcmQ6DQo+ICAgICAgICAgICAgICB1cmwucGFz c3dvcmQgPSB1cmxFeHRyYXMucGFzc3dvcmQNCj4gICAgICAgICAgaWYgdXJsRXh0cmFzLmRhdGFi YXNlOg0KPiAgICAgICAgICAgICAgdXJsLmRhdGFiYXNlID0gdXJsRXh0cmFzLmRhdGFiYXNlDQo+ ICAgICAgICAgIG9wdGlvbnMudXJsID0gdXJsDQo+ICAgICAgcmV0dXJuIHNxbGFsY2hlbXkuY3Jl YXRlX2VuZ2luZShvcHRpb25zLCAiIikNCj4gYW5kIHRoZW4gd2UgY291bGQganVzdCBjYWxsOg0K PiANCj4gZ2V0RW5naW5lRnJvbUZpbGUoDQo+ICAgICAgIm15RmlsZS5pbmkiLA0KPiAgICAgIFVS TChkcml2ZXJuYW1lPSJteXNxbCtteXNxbGRiIiwgZGF0YWJhc2UgPSAibXlkYiIpKQ0KPiAoQlRX LCBJIGRvbid0IGxpa2UgdGhhdCB3ZSBoYXZlIHRvIHNwZWNpZnkgZHJpdmVyIG5hbWUgaGVyZSkN Cj4gDQo+IChkb2NzIGZvciBVUkw6DQo+IGh0dHBzOi8vZ2l0aHViLmNvbS96enplZWsvc3FsYWxj aGVteS9ibG9iL21hc3Rlci9saWIvc3FsYWxjaGVteS9lbmdpbmUvdXINCj4gbCAucHkpDQo+IA0K PiBUaG91Z2h0cz8NCj4gDQo+IEphY2VrDQrCoCANCg0KDQojIyMjIyMjIyMjIyMjIyMjIyMjIyMj IyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMNClVzZSBS RVBMWS1BTEwgdG8gcmVwbHkgdG8gbGlzdA0KDQpUbyB1bnN1YnNjcmliZSBmcm9tIHRoZSBRU0VS Vi1MIGxpc3QsIGNsaWNrIHRoZSBmb2xsb3dpbmcgbGluazoNCmh0dHBzOi8vbGlzdHNlcnYuc2xh Yy5zdGFuZm9yZC5lZHUvY2dpLWJpbi93YT9TVUJFRDE9UVNFUlYtTCZBPTENCg== ========================================================================= Date: Fri, 18 Sep 2015 09:50:22 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Jacek Becla <[log in to unmask]> Organization: SLAC National Accelerator Laboratory Subject: Re: new use case for getEngineFrom Comments: To: "Salnikov, Andrei A." <[log in to unmask]>, "Van Klaveren, Brian N." <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> Thanks Andy. I am good with this approach: On 09/18/2015 09:47 AM, Salnikov, Andrei A. wrote: > def getEngineFromFile(fileName, > drivername=None, > username=None, > password=None, > host=None, > port=None, > database=None, > query=None): ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Thu, 24 Sep 2015 10:58:44 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: John Gates <[log in to unmask]> Subject: Heavy load on cluster mysql Comments: To: qserv-l <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> Andy S., The latest code is overloading mysql when we run 60 queries simultaneously (before it worked with over 100) the error is: SessOpen: [0x5be19400924 19:40:57.563 [0x7fa65218f700] ERROR qmeta.QMetaMysql (core/modules/qmeta/QMetaMysql.cc:414) - SQL query failed: UPDATE QInfo SET completed = NOW(), status = 'COMPLETED' WHERE queryId = 21 ] Opening xroot://10.158.37.100:1094//chk/LSST/700 0924 19:40:57.563 [0x7fa64116d700] ERROR qmeta.QMetaTransaction (core/modules/qmeta/QMetaTransaction.cc:62) - Failed to abort transaction: mysql error: (2006) MySQL server has gone away Unable to execute query: ROLLBACK 0924 19:40:57.564 [0x7fa64116d700] ERROR root (core/modules/ccontrol/userQueryProxy.cc:128) - Query ID is not registered in metadata: 29 [in function completeQuery at core/modules/qmeta/QMetaMysql.cc:420] ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Thu, 24 Sep 2015 18:22:41 +0000 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: "Salnikov, Andrei A." <[log in to unmask]> Subject: Re: Heavy load on cluster mysql Comments: To: "Gates, John H" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" Message-ID: <[log in to unmask]> SGkgSm9obiwNCg0KSSBkb3VidCB0aGF0IFFNZXRhIGNhbiBvdmVybG9hZCBteXNxbCwgaXQncyBy ZWxhdGl2ZWx5IGxvdyB2b2x1bWUgDQpxdWVyaWVzIGNvbXBhcmVkIHRvIG90aGVyIHN0dWZmIHRo YXQgd2UgZG8gb24gdGhhdCBteXNxbCBpbnN0YW5jZS4NCkRvIHdlIGhhdmUgYW55dGhpbmcgaW50 ZXJlc3RpbmcgaW4gbXlzcWwgbG9ncz8gSXMgbXlzcWwgc3RpbGwgYWxpdmUgDQphZnRlciB5b3Ug c2VlIHRoYXQgZXJyb3I/DQoNCkNoZWVycywNCkFuZHkNCg0KSm9obiBHYXRlcyB3cm90ZSBvbiAy MDE1LTA5LTI0Og0KPiBBbmR5IFMuLA0KPiANCj4gVGhlIGxhdGVzdCBjb2RlIGlzIG92ZXJsb2Fk aW5nIG15c3FsIHdoZW4gd2UgcnVuIDYwIHF1ZXJpZXMNCj4gc2ltdWx0YW5lb3VzbHkgKGJlZm9y ZSBpdCB3b3JrZWQgd2l0aCBvdmVyIDEwMCkgdGhlIGVycm9yIGlzOg0KPiANCj4gU2Vzc09wZW46 IFsweDViZTE5NDAwOTI0IDE5OjQwOjU3LjU2MyBbMHg3ZmE2NTIxOGY3MDBdIEVSUk9SDQo+IHFt ZXRhLlFNZXRhTXlzcWwgKGNvcmUvbW9kdWxlcy9xbWV0YS9RTWV0YU15c3FsLmNjOjQxNCkgLSBT UUwgcXVlcnkNCj4gZmFpbGVkOiBVUERBVEUgUUluZm8gU0VUIGNvbXBsZXRlZCA9IE5PVygpLCBz dGF0dXMgPSAnQ09NUExFVEVEJyBXSEVSRQ0KPiBxdWVyeUlkID0gMjENCj4gXSBPcGVuaW5nIHhy b290Oi8vMTAuMTU4LjM3LjEwMDoxMDk0Ly9jaGsvTFNTVC83MDANCj4gMDkyNCAxOTo0MDo1Ny41 NjMgWzB4N2ZhNjQxMTZkNzAwXSBFUlJPUiBxbWV0YS5RTWV0YVRyYW5zYWN0aW9uDQo+IChjb3Jl L21vZHVsZXMvcW1ldGEvUU1ldGFUcmFuc2FjdGlvbi5jYzo2MikgLSBGYWlsZWQgdG8gYWJvcnQN Cj4gdHJhbnNhY3Rpb246IG15c3FsIGVycm9yOiAoMjAwNikgTXlTUUwgc2VydmVyIGhhcyBnb25l IGF3YXkgVW5hYmxlIHRvDQo+IGV4ZWN1dGUgcXVlcnk6IFJPTExCQUNLDQo+IA0KPiANCj4gDQo+ IDA5MjQgMTk6NDA6NTcuNTY0IFsweDdmYTY0MTE2ZDcwMF0gRVJST1Igcm9vdA0KPiAoY29yZS9t b2R1bGVzL2Njb250cm9sL3VzZXJRdWVyeVByb3h5LmNjOjEyOCkgLSBRdWVyeSBJRCBpcyBub3QN Cj4gcmVnaXN0ZXJlZCBpbiBtZXRhZGF0YTogMjkgW2luIGZ1bmN0aW9uIGNvbXBsZXRlUXVlcnkg YXQNCj4gY29yZS9tb2R1bGVzL3FtZXRhL1FNZXRhTXlzcWwuY2M6NDIwXQ0KPiANCj4gIyMjIyMj IyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMj IyMjIyMjIyMjDQo+IFVzZSBSRVBMWS1BTEwgdG8gcmVwbHkgdG8gbGlzdA0KPiANCj4gVG8gdW5z dWJzY3JpYmUgZnJvbSB0aGUgUVNFUlYtTCBsaXN0LCBjbGljayB0aGUgZm9sbG93aW5nIGxpbms6 DQo+IGh0dHBzOi8vbGlzdHNlcnYuc2xhYy5zdGFuZm9yZC5lZHUvY2dpLWJpbi93YT9TVUJFRDE9 UVNFUlYtTCZBPTENCg0KDQoNCiMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMj IyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIw0KVXNlIFJFUExZLUFMTCB0byByZXBs eSB0byBsaXN0DQoNClRvIHVuc3Vic2NyaWJlIGZyb20gdGhlIFFTRVJWLUwgbGlzdCwgY2xpY2sg dGhlIGZvbGxvd2luZyBsaW5rOg0KaHR0cHM6Ly9saXN0c2Vydi5zbGFjLnN0YW5mb3JkLmVkdS9j Z2ktYmluL3dhP1NVQkVEMT1RU0VSVi1MJkE9MQ0K ========================================================================= Date: Thu, 24 Sep 2015 13:04:58 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: John Gates <[log in to unmask]> Subject: Re: Heavy load on cluster mysql Comments: To: "Salnikov, Andrei A." <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> I commented out the _queryMetadata lines from my current branch, and the test has been running without incident for several minutes. -John On 09/24/15 11:22, Salnikov, Andrei A. wrote: > Hi John, > > I doubt that QMeta can overload mysql, it's relatively low volume > queries compared to other stuff that we do on that mysql instance. > Do we have anything interesting in mysql logs? Is mysql still alive > after you see that error? > > Cheers, > Andy > > John Gates wrote on 2015-09-24: >> Andy S., >> >> The latest code is overloading mysql when we run 60 queries >> simultaneously (before it worked with over 100) the error is: >> >> SessOpen: [0x5be19400924 19:40:57.563 [0x7fa65218f700] ERROR >> qmeta.QMetaMysql (core/modules/qmeta/QMetaMysql.cc:414) - SQL query >> failed: UPDATE QInfo SET completed = NOW(), status = 'COMPLETED' WHERE >> queryId = 21 >> ] Opening xroot://10.158.37.100:1094//chk/LSST/700 >> 0924 19:40:57.563 [0x7fa64116d700] ERROR qmeta.QMetaTransaction >> (core/modules/qmeta/QMetaTransaction.cc:62) - Failed to abort >> transaction: mysql error: (2006) MySQL server has gone away Unable to >> execute query: ROLLBACK >> >> >> >> 0924 19:40:57.564 [0x7fa64116d700] ERROR root >> (core/modules/ccontrol/userQueryProxy.cc:128) - Query ID is not >> registered in metadata: 29 [in function completeQuery at >> core/modules/qmeta/QMetaMysql.cc:420] >> >> ######################################################################## >> Use REPLY-ALL to reply to list >> >> To unsubscribe from the QSERV-L list, click the following link: >> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 > ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Thu, 24 Sep 2015 20:10:06 +0000 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: "Salnikov, Andrei A." <[log in to unmask]> Subject: Re: Heavy load on cluster mysql Comments: To: "Gates, John H" <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8" Message-ID: <[log in to unmask]> SW50ZXJlc3RpbmcuIEkgJ2xsIG5lZWQgdG8gdW5kZXJzdGFuZCB3aGF0J3MgZ29pbmcgb24uIERv IHlvdSBoYXZlIHRoZSANCmxvZ3MgZnJvbSBjemFyIHdoZW4gaXQgd2FzIGNyYXNoaW5nPyBJJ2Qg bGlrZSB0byBzZWUgYWxsIGVycm9yIG1lc3NhZ2VzIA0KdGhhdCBpdCBnZW5lcmF0ZWQuDQoNCkNo ZWVycywNCkFuZHkNCg0KR2F0ZXMsIEpvaG4gSCB3cm90ZSBvbiAyMDE1LTA5LTI0Og0KPiBJIGNv bW1lbnRlZCBvdXQgdGhlIF9xdWVyeU1ldGFkYXRhIGxpbmVzIGZyb20gbXkgY3VycmVudCBicmFu Y2gsIGFuZCB0aGUNCj4gdGVzdCBoYXMgYmVlbiBydW5uaW5nIHdpdGhvdXQgaW5jaWRlbnQgZm9y IHNldmVyYWwgbWludXRlcy4NCj4gDQo+IC1Kb2huDQo+IA0KPiBPbiAwOS8yNC8xNSAxMToyMiwg U2Fsbmlrb3YsIEFuZHJlaSBBLiB3cm90ZToNCj4+IEhpIEpvaG4sDQo+PiANCj4+IEkgZG91YnQg dGhhdCBRTWV0YSBjYW4gb3ZlcmxvYWQgbXlzcWwsIGl0J3MgcmVsYXRpdmVseSBsb3cgdm9sdW1l DQo+PiBxdWVyaWVzIGNvbXBhcmVkIHRvIG90aGVyIHN0dWZmIHRoYXQgd2UgZG8gb24gdGhhdCBt eXNxbCBpbnN0YW5jZS4NCj4+IERvIHdlIGhhdmUgYW55dGhpbmcgaW50ZXJlc3RpbmcgaW4gbXlz cWwgbG9ncz8gSXMgbXlzcWwgc3RpbGwgYWxpdmUNCj4+IGFmdGVyIHlvdSBzZWUgdGhhdCBlcnJv cj8NCj4+IA0KPj4gQ2hlZXJzLA0KPj4gQW5keQ0KPj4gDQo+PiBKb2huIEdhdGVzIHdyb3RlIG9u IDIwMTUtMDktMjQ6DQo+Pj4gQW5keSBTLiwNCj4+PiANCj4+PiBUaGUgbGF0ZXN0IGNvZGUgaXMg b3ZlcmxvYWRpbmcgbXlzcWwgd2hlbiB3ZSBydW4gNjAgcXVlcmllcw0KPj4+IHNpbXVsdGFuZW91 c2x5IChiZWZvcmUgaXQgd29ya2VkIHdpdGggb3ZlciAxMDApIHRoZSBlcnJvciBpczoNCj4+PiAN Cj4+PiBTZXNzT3BlbjogWzB4NWJlMTk0MDA5MjQgMTk6NDA6NTcuNTYzIFsweDdmYTY1MjE4Zjcw MF0gRVJST1INCj4+PiBxbWV0YS5RTWV0YU15c3FsIChjb3JlL21vZHVsZXMvcW1ldGEvUU1ldGFN eXNxbC5jYzo0MTQpIC0gU1FMIHF1ZXJ5DQo+Pj4gZmFpbGVkOiBVUERBVEUgUUluZm8gU0VUIGNv bXBsZXRlZCA9IE5PVygpLCBzdGF0dXMgPSAnQ09NUExFVEVEJyBXSEVSRQ0KPj4+IHF1ZXJ5SWQg PSAyMQ0KPj4+IF0gT3BlbmluZyB4cm9vdDovLzEwLjE1OC4zNy4xMDA6MTA5NC8vY2hrL0xTU1Qv NzAwDQo+Pj4gMDkyNCAxOTo0MDo1Ny41NjMgWzB4N2ZhNjQxMTZkNzAwXSBFUlJPUiBxbWV0YS5R TWV0YVRyYW5zYWN0aW9uDQo+Pj4gKGNvcmUvbW9kdWxlcy9xbWV0YS9RTWV0YVRyYW5zYWN0aW9u LmNjOjYyKSAtIEZhaWxlZCB0byBhYm9ydA0KPj4+IHRyYW5zYWN0aW9uOiBteXNxbCBlcnJvcjog KDIwMDYpIE15U1FMIHNlcnZlciBoYXMgZ29uZSBhd2F5IFVuYWJsZSB0bw0KPj4+IGV4ZWN1dGUg cXVlcnk6IFJPTExCQUNLDQo+Pj4gDQo+Pj4gDQo+Pj4gDQo+Pj4gMDkyNCAxOTo0MDo1Ny41NjQg WzB4N2ZhNjQxMTZkNzAwXSBFUlJPUiByb290DQo+Pj4gKGNvcmUvbW9kdWxlcy9jY29udHJvbC91 c2VyUXVlcnlQcm94eS5jYzoxMjgpIC0gUXVlcnkgSUQgaXMgbm90DQo+Pj4gcmVnaXN0ZXJlZCBp biBtZXRhZGF0YTogMjkgW2luIGZ1bmN0aW9uIGNvbXBsZXRlUXVlcnkgYXQNCj4+PiBjb3JlL21v ZHVsZXMvcW1ldGEvUU1ldGFNeXNxbC5jYzo0MjBdDQo+Pj4gDQo+Pj4gDQo+Pj4gIyMjIyMjIyMj IyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMj IyMjIyMNCj4+PiAjIFVzZSBSRVBMWS1BTEwgdG8gcmVwbHkgdG8gbGlzdA0KPj4+IA0KPj4+IFRv IHVuc3Vic2NyaWJlIGZyb20gdGhlIFFTRVJWLUwgbGlzdCwgY2xpY2sgdGhlIGZvbGxvd2luZyBs aW5rOg0KPj4+IGh0dHBzOi8vbGlzdHNlcnYuc2xhYy5zdGFuZm9yZC5lZHUvY2dpLWJpbi93YT9T VUJFRDE9UVNFUlYtTCZBPTENCj4+DQoNCg0KDQojIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMj IyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMNClVzZSBSRVBMWS1B TEwgdG8gcmVwbHkgdG8gbGlzdA0KDQpUbyB1bnN1YnNjcmliZSBmcm9tIHRoZSBRU0VSVi1MIGxp c3QsIGNsaWNrIHRoZSBmb2xsb3dpbmcgbGluazoNCmh0dHBzOi8vbGlzdHNlcnYuc2xhYy5zdGFu Zm9yZC5lZHUvY2dpLWJpbi93YT9TVUJFRDE9UVNFUlYtTCZBPTENCg== ========================================================================= Date: Thu, 24 Sep 2015 13:17:57 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: John Gates <[log in to unmask]> Subject: Re: Heavy load on cluster mysql Comments: To: "Salnikov, Andrei A." <[log in to unmask]>, qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> I deleted them but I'll make new ones before the end of the day. -John On 09/24/15 13:10, Salnikov, Andrei A. wrote: > Interesting. I 'll need to understand what's going on. Do you have the > logs from czar when it was crashing? I'd like to see all error messages > that it generated. > > Cheers, > Andy > > Gates, John H wrote on 2015-09-24: >> I commented out the _queryMetadata lines from my current branch, and the >> test has been running without incident for several minutes. >> >> -John >> >> On 09/24/15 11:22, Salnikov, Andrei A. wrote: >>> Hi John, >>> >>> I doubt that QMeta can overload mysql, it's relatively low volume >>> queries compared to other stuff that we do on that mysql instance. >>> Do we have anything interesting in mysql logs? Is mysql still alive >>> after you see that error? >>> >>> Cheers, >>> Andy >>> >>> John Gates wrote on 2015-09-24: >>>> Andy S., >>>> >>>> The latest code is overloading mysql when we run 60 queries >>>> simultaneously (before it worked with over 100) the error is: >>>> >>>> SessOpen: [0x5be19400924 19:40:57.563 [0x7fa65218f700] ERROR >>>> qmeta.QMetaMysql (core/modules/qmeta/QMetaMysql.cc:414) - SQL query >>>> failed: UPDATE QInfo SET completed = NOW(), status = 'COMPLETED' WHERE >>>> queryId = 21 >>>> ] Opening xroot://10.158.37.100:1094//chk/LSST/700 >>>> 0924 19:40:57.563 [0x7fa64116d700] ERROR qmeta.QMetaTransaction >>>> (core/modules/qmeta/QMetaTransaction.cc:62) - Failed to abort >>>> transaction: mysql error: (2006) MySQL server has gone away Unable to >>>> execute query: ROLLBACK >>>> >>>> >>>> >>>> 0924 19:40:57.564 [0x7fa64116d700] ERROR root >>>> (core/modules/ccontrol/userQueryProxy.cc:128) - Query ID is not >>>> registered in metadata: 29 [in function completeQuery at >>>> core/modules/qmeta/QMetaMysql.cc:420] >>>> >>>> >>>> ####################################################################### >>>> # Use REPLY-ALL to reply to list >>>> >>>> To unsubscribe from the QSERV-L list, click the following link: >>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 > ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Fri, 25 Sep 2015 14:57:53 +0200 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Fabrice Jammes <[log in to unmask]> Subject: New Qserv cluster on ccqserv125..149 Comments: To: qserv-l <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> FYI a Qserv cluster with latest release running on Docker is available on ccqserv125..149, feel free to use it! fjammes@ccosvms0070:~/src$ time mysql --host ccqserv125 --port 4040 --user qsmaster LSST -e "SELECT ra, decl FROM Object WHERE deepSourceId = 2322920177142607;"; +------------------+-------------------+ | ra | decl | +------------------+-------------------+ | 29.3088063472755 | -86.3088404611897 | +------------------+-------------------+ real 0m0.095s user 0m0.005s sys 0m0.005s ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Mon, 28 Sep 2015 09:34:55 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Jacek Becla <[log in to unmask]> Organization: SLAC National Accelerator Laboratory Subject: qserv - square meeting this Wed Comments: To: qserv-l <[log in to unmask]> Comments: cc: Frossie <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> I believe everyone knows that Frossie is at SLAC on Wed and we are planning to focus on topics relevant to qserv AND the square teams. We have a Kings River conference room starting at 12:00pm, it is in building 052, room #306. As always, we will be using hangout ls.st/nwb. Frossie, just come to the 3rd floor of the Computing Center if you arrive earlier and catch us in our offices. Jacek ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Mon, 28 Sep 2015 10:27:41 -0700 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: Jacek Becla <[log in to unmask]> Organization: SLAC National Accelerator Laboratory Subject: keeping all data releases on disk Comments: To: qserv-l <[log in to unmask]> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit Message-ID: <[log in to unmask]> heads up: people are talking about keeping all data releases on disk, and providing fast access (eg shared scans) for the latest one only. This means we will have more spindles (especially in later years), and it can have influence how we distribute data. No actions required for now, just keep this in the back of your mind... J. ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ========================================================================= Date: Wed, 30 Sep 2015 00:28:56 +0000 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: "Becla, Jacek" <[log in to unmask]> Subject: Re: qserv, etc Comments: To: "Ebert, Marcus" <[log in to unmask]> Comments: cc: qserv-l <[log in to unmask]> In-Reply-To: <[log in to unmask]> Content-Type: multipart/signed; boundary="Apple-Mail=_A512D99C-27F9-49A7-A97C-220D8D227146"; protocol="application/pgp-signature"; micalg=pgp-sha512 MIME-Version: 1.0 Message-ID: <[log in to unmask]> --Apple-Mail=_A512D99C-27F9-49A7-A97C-220D8D227146 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Marcus (I=E2=80=99m sending this to the qserv list) Re 1st, I am not sure (I didn=E2=80=99t research), maybe someone from = the team will know. Re 2nd, I think it is related to gcc compiler, we now require at least = 4.8.2. Installing devtoolset-3 is probably the simplest solution. (all: Should we update our docs to reflect the compiler requirement?) Thanks, Jacek > On Sep 29, 2015, at 4:36 PM, Marcus Ebert <[log in to unmask]> = wrote: >=20 > Hi Jacek, >=20 > I tried to install qserv and got 2 errors so far: >=20 > 1) mktemp is used at the beginning where the template has .XXXXX in > the end (5xX). On some Linux distributions, mine is one of it, there > is a different version of mktemp installed which requires exactly 6xX > while GNU one requires at least 3xX. When pointing the script to the > GNU one, this step worked for me then. >=20 > 2) using "eups distrib install" produces an error when it tries to > compile qana. The first error that happens is: >=20 > g++ -o build/qana/RelationGraph.os -c -g -pedantic -Wall > -Wno-long-long -Wno-variadic-macros -fPIC -D_FILE_OFFSET_BITS=3D64 = -fPIC > -std=3Dc++0x -Wno-unused-local-typedefs > -I/home/ebert/LSST/Linux64/mysql/5.1.65.lsst2/include > -I/home/ebert/LSST/Linux64/boost/1.5 > 5.0.1.lsst2+3/include > -I/home/ebert/LSST/Linux64/antlr/2.7.7.lsst1/include > -I/home/ebert/LSST/Linux64/xrootd/2015_7-1-gb516293/i > nclude/xrootd -I/home/ebert/LSST/Linux64/log/1.1.2-4-g93731d5/include > -I/home/ebert/LSST/Linux64/protobuf/2.6.1/include -I/home/ > ebert/LSST/Linux64/zookeeper/3.4.6.lsst2/c-binding/include > -I/home/ebert/LSST/Linux64/log4cxx/0.10.0.lsst4/include -Ibuild build > /qana/RelationGraph.cc > In file included from > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= bits/stl_algobase.h:65:0, > from > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= bits/stl_tree.h:63, > from > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= map:60, > from build/qana/QueryMapping.h:32, > from build/qana/QueryMapping.cc:35: > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= bits/stl_pair.h: > In instantiation of 'struct std::pair > , = lsst::qserv::qana::QueryMapping::Parameter>': > build/qana/QueryMapping.h:89:66: required from here > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= bits/stl_pair.h:93:11: > error: 'std::pair<_T1, _T2>::first' has incomplete type > In file included from > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= iosfwd:41:0, > from > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= memory:74, > from build/qana/QueryMapping.h:33, > from build/qana/QueryMapping.cc:35: > = /usr/lib64/gcc/x86_64-slackware-linux/4.7.1/../../../../include/c++/4.7.1/= bits/stringfwd.h:61:11: > error: declaration of 'const class std::basic_string' > g++ -o build/qana/ScanTablePlugin.os -c -g -pedantic -Wall > -Wno-long-long -Wno-variadic-macros -fPIC -D_FILE_OFFSET_BITS=3D64 = -fPIC > -std=3Dc++0x -Wno-unused-local-typedefs > -I/home/ebert/LSST/Linux64/mysql/5.1.65.lsst2/include > -I/home/ebert/LSST/Linux64/boost/1.55.0.1.lsst2+3/include > -I/home/ebert/LSST/Linux64/antlr/2.7.7.lsst1/include > -I/home/ebert/LSST/Linux64/xrootd/2015_7-1-gb516293/include/xrootd > -I/home/ebert/LSST/Linux64/log/1.1.2-4-g93731d5/include > -I/home/ebert/LSST/Linux64/protobuf/2.6.1/include > -I/home/ebert/LSST/Linux64/zookeeper/3.4.6.lsst2/c-binding/include > -I/home/ebert/LSST/Linux64/log4cxx/0.10.0.lsst4/include -Ibuild > build/qana/ScanTablePlugin.cc > build/qana/QueryMapping.cc: In member function 'void > lsst::qserv::qana::Mapping::_initMap(const ParameterMap&)': > build/qana/QueryMapping.cc:132:40: error: 'const struct > std::pair, > lsst::qserv::qana::QueryMapping::Parameter>' has no member named > 'first' > .... >=20 > Before looking more into details, is there a specific versions of > c++/kernel/other tools needed to build all components? >=20 >=20 > Cheers, > Marcus >=20 > On Tue, Sep 29, 2015 at 1:36 PM, Jacek Becla <[log in to unmask]> = wrote: >> https://confluence.lsstcorp.org/display/DM/Data+Access+and+Database >>=20 >>=20 >>=20 >> On 09/29/2015 01:30 PM, Jacek Becla wrote: >>>=20 >>> documentation: >>>=20 >>> http://www.slac.stanford.edu/exp/lsst/qserv/2015_08/ >>>=20 >>>=20 >>> jira agile (planning): >>>=20 >>> https://jira.lsstcorp.org/secure/RapidBoard.jspa?rapidView=3D23 >>>=20 >>>=20 >>> github: >>>=20 >>> github.com/lsst/qserv >>>=20 >>>=20 >>> Design doc: >>> http://ls.st/lpj >>>=20 >>> Mailing list: >>> https://dev.lsstcorp.org/trac/wiki/db/Qserv/MailingList >>>=20 >>>=20 >>>=20 >>>=20 >>> On 09/23/2015 08:54 PM, Becla, Jacek wrote: >>>>=20 >>>> Hi Marcus, >>>>=20 >>>> Sure! Tue 12pm is best. Can you come to my office, bldg 50 office = 338? >>>>=20 >>>> Thanks, >>>> Jacek >>>>=20 >>>>=20 >>>>> On Sep 23, 2015, at 3:06 PM, Marcus Ebert = <[log in to unmask]> >>>>> wrote: >>>>>=20 >>>>> Hi Jacek, >>>>>=20 >>>>> We have a small BaBar Collaboration Meeting ongoing right now. = Would >>>>> it work for you if we meet during the next week, any day between >>>>> Tuesday and Friday? >>>>> Except on Tuesday, it would work for me any time between >>>>> 8:30am-2:00pm, and on Tuesday between 12:00-2:00pm. >>>>>=20 >>>>> Cheers, >>>>> Marcus >>>>>=20 >>>>> On Wed, 23 Sep 2015, Jacek Becla wrote: >>>>>=20 >>>>>> Bob, >>>>>>=20 >>>>>> Sounds great! I think it's be very useful to talk to Marcus while >>>>>> he is still here at SLAC. Marcus, I'd be happy to meet, even this >>>>>> week, maybe tomorrow say 11, or Friday after 11:30? >>>>>>=20 >>>>>> Best regards, >>>>>> Jacek >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>> On 09/23/2015 02:50 AM, Bob Mann wrote: >>>>>>>=20 >>>>>>> Jacek, >>>>>>> I?m sorry that I?ve not been in touch with you for some time, = but >>>>>>> we?ve >>>>>>> been working hard on securing funding for UK involvement in = LSST. The >>>>>>> first phase of funding is now in place and we are close to = signing our >>>>>>> MoA. We have some funding in Edinburgh to prepare for a UK DAC = and >>>>>>> I?ll >>>>>>> be emailing Jeff, Mario and K-T shortly to discuss how we might = best >>>>>>> interact with the DM team over the next few years, but I have = one >>>>>>> specific question for you. >>>>>>> The aspect of LSST data management that is most beyond our = current >>>>>>> expertise is the use of xrootd in the qserv database = architecture, >>>>>>> so we >>>>>>> have hired someone with xrootd expertise ? Marcus Ebert (CC?d >>>>>>> above), a >>>>>>> colleague of yours at SLAC ? who will work 50% in my group on = LSST and >>>>>>> 50% with my colleague Pete Clarke on LHC data storage. I don?t = know >>>>>>> whether you know Marcus ? I know SLAC is a large place - but he = has >>>>>>> been >>>>>>> working on the BaBar long-term data archive and related particle >>>>>>> physics >>>>>>> storage/analysis projects that are very similar to what a DAC = will >>>>>>> have >>>>>>> to provide. >>>>>>> Marcus will be joining us on 1 November, so he has about another = month >>>>>>> left at SLAC. I was wondering whether you might be able to spare = him >>>>>>> some time during that period to help him get up to speed on the >>>>>>> technical details of qserv and how you see it developing between >>>>>>> now and >>>>>>> commissioning. The main goal for our initial four-year phase of >>>>>>> funding >>>>>>> is to prepare the UK community for involvement in commissioning, >>>>>>> and, as >>>>>>> part of that, we want to set up a prototype DAC in Edinburgh, = and I?m >>>>>>> thinking that we?d get Marcus started on the qserv aspect of = that when >>>>>>> he arrives, so it would be good to get your thoughts on that. >>>>>>> As I?ll say to Jeff et al, I would like us to find a way to make = a >>>>>>> positive contribution to the LSST DM effort over the next four >>>>>>> years. I >>>>>>> know that you?re now focused on building a production system, so = we >>>>>>> don?t want to distract you from that, but we may be able to = offer >>>>>>> additional effort and further expertise that more than = compensates for >>>>>>> the help that we will inevitably require to develop a prototype = UK DAC >>>>>>> in readiness for commissioning?and, again, it would be good to = hear >>>>>>> your >>>>>>> thoughts on how we might work to our mutual benefit. >>>>>>> Many thanks >>>>>>> Bob >>>>>>=20 >>>>>>=20 >>>>>=20 >>>>> -- >>>>> = -------------------------------------------------------------------- >>>>> Marcus Ebert >>>>> SLAC National Accelerator Laboratory >>>>> Mail Stop 34 >>>>> 2575 Sand Hill Road >>>>> Menlo Park, CA, 94025 >>>>> USA >>>>> ------ >>>>> office: ROB 129 >>>>> Tel. : +1 (650) 926-3565 >>>>> https://www.linkedin.com/profile/view?id=3D166912103 >>>>> = =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>>>> Please, don't send Word, Excel or PowerPoint attachments - >>>>> use pdf, plain text, Google Docs or HTML format instead. >>>>=20 >>>>=20 >>>=20 >>=20 >=20 >=20 >=20 > -- > --------------------------------------------------------------------- > Marcus Ebert > SLAC National Accelerator Laboratory > Mail Stop 34 > 2575 Sand Hill Road > Menlo Park, CA, 94025 > USA > ------ > office: ROB 129 > Tel. : +1 (650) 926-3565 > https://www.linkedin.com/profile/view?id=3D166912103 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > Please, don't send Word, Excel or PowerPoint attachments - > use pdf, plain text, Google Docs or HTML format instead. ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --Apple-Mail=_A512D99C-27F9-49A7-A97C-220D8D227146 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iJwEAQEKAAYFAlYLLPEACgkQKcygTlDZAwIriQP9E3XQIiEpwCth/gitj7b9SXWe ECMDUCP8db5WMs8Rhk7COjj7eHZDHzMbY3KOA3a5mlq9mZH5+hNXEX1FP9icbwyT Cmhbnoz2gQd4RWYMC5Ic6BTKSLeiuu0qzdhlboDWplS3SiAe0hvPQwqiqbVx1wtN F1ic+H0sIS9cQyExbFY= =gprK -----END PGP SIGNATURE----- --Apple-Mail=_A512D99C-27F9-49A7-A97C-220D8D227146-- ========================================================================= Date: Wed, 30 Sep 2015 03:07:53 +0000 Reply-To: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> Sender: "General discussion for qserv (LSST prototype baseline catalog)" <[log in to unmask]> From: "Becla, Jacek" <[log in to unmask]> Subject: Provenance discussion Comments: To: qserv-l <[log in to unmask]>, "[log in to unmask]" <[log in to unmask]>, "[log in to unmask]" <[log in to unmask]> Content-Type: multipart/signed; boundary="Apple-Mail=_55F8734E-AB16-4B58-8202-D5DBE2A293C3"; protocol="application/pgp-signature"; micalg=pgp-sha512 MIME-Version: 1.0 Message-ID: <[log in to unmask]> --Apple-Mail=_55F8734E-AB16-4B58-8202-D5DBE2A293C3 Content-Type: multipart/alternative; boundary="Apple-Mail=_B100BAED-215F-4076-8DD1-51903491C946" --Apple-Mail=_B100BAED-215F-4076-8DD1-51903491C946 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii We are planning a 2-h discussion about LSST Provenance. It will focus = primarily on lower level internals like schema structures etc, but I = suspect some people from DM outside of the core Data Access team might = be interested in joining, thus I am sending this to dm-devel. When: This Thursday, Oct 1, 1-3pm pacific (more like 1:05pm because we = need to set things up and there is a meeting in the conf room we will be = using at slac that might drag till 1:00) Where: google hangout ls.st/nwb For these at slac: Russian River conference room 052-308 The current design, documented here: https://dev.lsstcorp.org/trac/wiki/db/Provenance = will be our starting point. Jacek ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1 --Apple-Mail=_B100BAED-215F-4076-8DD1-51903491C946 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii We are planning a 2-h discussion about LSST Provenance. It = will focus primarily on lower level internals like schema structures = etc, but I suspect some people from DM outside of the core Data Access = team might be interested in joining, thus I am sending this to = dm-devel.

When: This = Thursday, Oct 1, 1-3pm pacific (more like 1:05pm because we need to set = things up and there is a meeting in the conf room we will be using at = slac that might drag till 1:00)

Where: google hangout = ls.st/nwb

For = these at slac: Russian River conference room 052-308

The current design, = documented here:


will be our starting = point. 

Jacek
=

Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=3DQSERV-L&A=3D1

--Apple-Mail=_B100BAED-215F-4076-8DD1-51903491C946-- --Apple-Mail=_55F8734E-AB16-4B58-8202-D5DBE2A293C3 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iJwEAQEKAAYFAlYLUjMACgkQKcygTlDZAwJrRgP/berhuZO1xVYJZP7a1rBE2Ctl Is6xKLnurMdfRDkbHT20/oYEl6eBr1LiqUjD3eMnjKwoW5nZ8N4fK1apG3may+ms +VnFDmnSCRhWzXQD5G7bzFxqyWSVh6IH0YB8ay/mfPQccu01DyZ8vn03wWf9/QXB vMNjHM1YnoE117bmpoM= =yt3p -----END PGP SIGNATURE----- --Apple-Mail=_55F8734E-AB16-4B58-8202-D5DBE2A293C3--