Hi Fabrice, Hi Douglas - The only download that gives me trouble is scisql-0.3.2.tar.bz2. Following Fabrice's advice, however, I'm able to work around this by placing a copy of the archive in my home directory and including the following within qserv-build.conf: [dependencies] scisql_url=file:///u/ki/bchick/qserv_build/scisql-0.3.2.tar.bz2 Should we maintain a copy of scisql-0.3.2.tar.bz2 on a Stanford server to avoid this problem in the future? Now, the dependencies appear to build successfully. The overall process still fails, however. On the terminal I see: /u1/bchick/sandbox2/qserv-branchtest/admin/qserv-install --install-dir="/u1/bchick/sandbox2" --log-dir="/u1/bchick/sandbox2/var/log" --mysql-data-dir="/u1/bchick/sandbox2/var/lib/mysql" --mysql-port=3306 --mysql-pass="qserv" &> /u1/bchick/sandbox2/var/log/INSTALL-2013-09-27-11:45:51.log scons: *** [perl-install-dummy-target] Error 2 scons: building terminated because of errors. Meanwhile, the tail of INSTALL-2013-09-27-11:45:51.log looks like: make[2]: Entering directory `/u1/bchick/sandbox2/build/mysql-proxy-0.8.2' make[2]: Nothing to be done for `install-exec-am'. test -z "/u1/bchick/sandbox2/lib/pkgconfig" || /bin/mkdir -p "/u1/bchick/sandbox2/lib/pkgconfig" /usr/bin/install -c -m 644 'mysql-proxy.pc' '/u1/bchick/sandbox2/lib/pkgconfig/mysql-proxy.pc' /usr/bin/install -c -m 644 'mysql-chassis.pc' '/u1/bchick/sandbox2/lib/pkgconfig/mysql-chassis.pc' make[2]: Leaving directory `/u1/bchick/sandbox2/build/mysql-proxy-0.8.2' make[1]: Leaving directory `/u1/bchick/sandbox2/build/mysql-proxy-0.8.2' Installing Qserv from source. -- Running: scons in /u1/bchick/sandbox2/qserv-branchtest/common ERROR : can't fork scons : No such file or directory at /u1/bchick/sandbox2/qserv-branchtest/admin/qserv-install line 701. 1Is this a permissions issue? Thanks, Bill On Sep 27, 2013, at 12:53 AM, "Fabrice Jammes" <[log in to unmask]> wrote: > Hello Bill, > > I've done some tests with master branch version and it works correctly. > > You can try using > > scons download > > to test only the download part of the build process. It should not > download anything twice. Log messages are verbose but quite explicit. > > You can also set up a local repository by adding next section in > qserv-build.conf : > > [dependencies] > > repository=http://www.slac.stanford.edu/exp/lsst/qserv/download/current > > zope_url=%(repository)s/zope.interface-3.8.0.tar.gz > mysql_python_url=%(repository)s/MySQL-python-1.2.3.tar.gz > twisted_url=%(repository)s/Twisted-12.0.0.tar.bz2 > expat_url=%(repository)s/expat-2.0.1.tar.gz > libevent_url=%(repository)s/libevent-2.0.16-stable.tar.gz > lua_url=%(repository)s/lua-5.1.4.tar.gz > lua_xlmrpc_url=%(repository)s/lua-xmlrpc-v1.2.1-2.tar.gz > luaexpat_url=%(repository)s/luaexpat-1.1.tar.gz > luasocket_url=%(repository)s/luasocket-2.0.2.tar.gz > mysql_url=%(repository)s/mysql-5.1.61.tar.gz > mysql_proxy_url=%(repository)s/mysql-proxy-0.8.2.tar.gz > protobuf_url=%(repository)s/protobuf-2.4.1.tar.gz > scisql_url=https://launchpad.net/scisql/trunk/0.3.2/+download/scisql-0.3.2.tar.bz2 > virtualenv_url=%(repository)s/virtualenv-1.7.tar.gz > xrootd_url=%(repository)s/xrootd-qsPatch2.tar.bz2 > > and then replace http:// by > file://path_to_the_dir_containing_qserv_deps_tar_gz (an example is > available on cc-in2p3 cluster where this technique was successfully used) > > Please let me know if you need more information. I would be pleased to > improve the build process if needed. > > Have a nice day, > > Fabrice > > On Fri, September 27, 2013 2:15 am, Bill Chickering wrote: >> I'm trying to create a new qserv environment on lsst-dev03, which cannot >> see the internet. In particular, attempts to download scisql from >> launchpad.net fail. When I manually copy scisql-0.3.2.tar.bz2 to the >> build directory, scons removes it and then attempts to download the file, >> which fails. Is the build logic limited to machines exposed to the >> internet? -- Bill >> >> >> >> On Sep 26, 2013, at 4:31 PM, Douglas Smith <[log in to unmask]> >> wrote: >> >> >>> >>> No, no, just follow my directions, you don't download anything. >>> If the computer in on the network, it should download things >>> for you. >>> >>> Douglas >>> >>> >>> >>> On 09/26/2013 04:28 PM, Bill Chickering wrote: >>> >>>> Hey Douglas - >>>> >>>> >>>> I want to create a new qserv environment from scratch. The page: >>>> http://www.slac.stanford.edu/exp/lsst/qserv/download/ >>>> providing links to the required software seems a bit dated, however. >>>> In particular, it contains xrootd patch2 (not patch 4) and the link >>>> to scisql is bad. Where can I find the up-to-date software >>>> dependencies? >>>> >>>> Thanks, >>>> Bill >>>> >>>> >>>> On Sep 26, 2013, at 11:31 AM, Douglas Smith >>>> <[log in to unmask]> wrote: >>>> >>>> >>>>> For the install now you need scons to manage everything >>>>> on the install. >>>>> >>>>> Douglas >>>>> >>>>> >>>>> >>>>> On 09/26/2013 11:09 AM, Bill Chickering wrote: >>>>> >>>>>> Sounds great. I'll give it a try this afternoon. Should I only >>>>>> use scons and not the qserv-install script? >>>>>> >>>>>> On Sep 26, 2013, at 10:38 AM, Douglas Smith >>>>>> <[log in to unmask]> wrote: >>>>>> >>>>>> >>>>>>> Hey Bill - >>>>>>> >>>>>>> >>>>>>> Can you try out ticket 3007 to get things to install for you? >>>>>>> >>>>>>> >>>>>>> 1. clone the repository, then checkout tickets/3007. >>>>>>> 2. mv the qserv dir to somewhere, with an extra version string >>>>>>> after a dash, like "qserv-branchtest". 3. cd in the dir, then >>>>>>> copy qserv-build.conf.example to qserv-build.conf. 4. Edit >>>>>>> qserv-build.conf, and change the version to "branchtest" is this >>>>>>> example, the hostname, and a mysql root password. And anything >>>>>>> else you might want to change. 5. then use scons. >>>>>>> >>>>>>> >>>>>>> That should build the whole thing to a working setup. >>>>>>> >>>>>>> >>>>>>> Let me know what else might want to get changed there. >>>>>>> >>>>>>> >>>>>>> Douglas >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>> >> >> ######################################################################## >> Use REPLY-ALL to reply to list >> >> >> To unsubscribe from the QSERV-L list, click the following link: >> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 >> >> > > ######################################################################## > Use REPLY-ALL to reply to list > > To unsubscribe from the QSERV-L list, click the following link: > https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1 ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1