Hi Fabrice, Hi Douglas -

The only download that gives me trouble is scisql-0.3.2.tar.bz2. Following Fabrice's advice, however, I'm able to work around this by placing a copy of the archive in my home directory and including the following within qserv-build.conf:
[dependencies]
scisql_url=file:///u/ki/bchick/qserv_build/scisql-0.3.2.tar.bz2

Should we maintain a copy of scisql-0.3.2.tar.bz2 on a Stanford server to avoid this problem in the future?

Now, the dependencies appear to build successfully. The overall process still fails, however. On the terminal I see:
/u1/bchick/sandbox2/qserv-branchtest/admin/qserv-install --install-dir="/u1/bchick/sandbox2" --log-dir="/u1/bchick/sandbox2/var/log" --mysql-data-dir="/u1/bchick/sandbox2/var/lib/mysql" --mysql-port=3306 --mysql-pass="qserv" &> /u1/bchick/sandbox2/var/log/INSTALL-2013-09-27-11:45:51.log
scons: *** [perl-install-dummy-target] Error 2
scons: building terminated because of errors.

Meanwhile, the tail of INSTALL-2013-09-27-11:45:51.log looks like:
make[2]: Entering directory `/u1/bchick/sandbox2/build/mysql-proxy-0.8.2'
make[2]: Nothing to be done for `install-exec-am'.
test -z "/u1/bchick/sandbox2/lib/pkgconfig" || /bin/mkdir -p "/u1/bchick/sandbox2/lib/pkgconfig"
 /usr/bin/install -c -m 644 'mysql-proxy.pc' '/u1/bchick/sandbox2/lib/pkgconfig/mysql-proxy.pc'
 /usr/bin/install -c -m 644 'mysql-chassis.pc' '/u1/bchick/sandbox2/lib/pkgconfig/mysql-chassis.pc'
make[2]: Leaving directory `/u1/bchick/sandbox2/build/mysql-proxy-0.8.2'
make[1]: Leaving directory `/u1/bchick/sandbox2/build/mysql-proxy-0.8.2'
Installing Qserv from source.
-- Running: scons in /u1/bchick/sandbox2/qserv-branchtest/common
ERROR : can't fork scons : No such file or directory at /u1/bchick/sandbox2/qserv-branchtest/admin/qserv-install line 701.

1Is this a permissions issue?

Thanks,
Bill





On Sep 27, 2013, at 12:53 AM, "Fabrice Jammes" <[log in to unmask]> wrote:

> Hello Bill,
> 
> I've done some tests with master branch version and it works correctly.
> 
> You can try using
> 
> scons download
> 
> to test only the download part of the build process. It should not
> download anything twice. Log messages are verbose but quite explicit.
> 
> You can also set up a local repository by adding next section in
> qserv-build.conf :
> 
> [dependencies]
> 
> repository=http://www.slac.stanford.edu/exp/lsst/qserv/download/current
> 
> zope_url=%(repository)s/zope.interface-3.8.0.tar.gz
> mysql_python_url=%(repository)s/MySQL-python-1.2.3.tar.gz
> twisted_url=%(repository)s/Twisted-12.0.0.tar.bz2
> expat_url=%(repository)s/expat-2.0.1.tar.gz
> libevent_url=%(repository)s/libevent-2.0.16-stable.tar.gz
> lua_url=%(repository)s/lua-5.1.4.tar.gz
> lua_xlmrpc_url=%(repository)s/lua-xmlrpc-v1.2.1-2.tar.gz
> luaexpat_url=%(repository)s/luaexpat-1.1.tar.gz
> luasocket_url=%(repository)s/luasocket-2.0.2.tar.gz
> mysql_url=%(repository)s/mysql-5.1.61.tar.gz
> mysql_proxy_url=%(repository)s/mysql-proxy-0.8.2.tar.gz
> protobuf_url=%(repository)s/protobuf-2.4.1.tar.gz
> scisql_url=https://launchpad.net/scisql/trunk/0.3.2/+download/scisql-0.3.2.tar.bz2
> virtualenv_url=%(repository)s/virtualenv-1.7.tar.gz
> xrootd_url=%(repository)s/xrootd-qsPatch2.tar.bz2
> 
> and then replace http:// by
> file://path_to_the_dir_containing_qserv_deps_tar_gz (an example is
> available on cc-in2p3 cluster where this technique was successfully used)
> 
> Please let me know if you need more information. I would be pleased to
> improve the build process if needed.
> 
> Have a nice day,
> 
> Fabrice
> 
> On Fri, September 27, 2013 2:15 am, Bill Chickering wrote:
>> I'm trying to create a new qserv environment on lsst-dev03, which cannot
>> see the internet. In particular, attempts to download scisql from
>> launchpad.net fail. When I manually copy scisql-0.3.2.tar.bz2 to the
>> build directory, scons removes it and then attempts to download the file,
>> which fails. Is the build logic limited to machines exposed to the
>> internet? -- Bill
>> 
>> 
>> 
>> On Sep 26, 2013, at 4:31 PM, Douglas Smith <[log in to unmask]>
>> wrote:
>> 
>> 
>>> 
>>> No, no, just follow my directions, you don't download anything.
>>> If the computer in on the network, it should download things
>>> for you.
>>> 
>>> Douglas
>>> 
>>> 
>>> 
>>> On 09/26/2013 04:28 PM, Bill Chickering wrote:
>>> 
>>>> Hey Douglas -
>>>> 
>>>> 
>>>> I want to create a new qserv environment from scratch. The page:
>>>> http://www.slac.stanford.edu/exp/lsst/qserv/download/
>>>> providing links to the required software seems a bit dated, however.
>>>> In particular, it contains xrootd patch2 (not patch 4) and the link
>>>> to scisql is bad. Where can I find the up-to-date software
>>>> dependencies?
>>>> 
>>>> Thanks,
>>>> Bill
>>>> 
>>>> 
>>>> On Sep 26, 2013, at 11:31 AM, Douglas Smith
>>>> <[log in to unmask]> wrote:
>>>> 
>>>> 
>>>>> For the install now you need scons to manage everything
>>>>> on the install.
>>>>> 
>>>>> Douglas
>>>>> 
>>>>> 
>>>>> 
>>>>> On 09/26/2013 11:09 AM, Bill Chickering wrote:
>>>>> 
>>>>>> Sounds great. I'll give it a try this afternoon. Should I only
>>>>>> use scons and not the qserv-install script?
>>>>>> 
>>>>>> On Sep 26, 2013, at 10:38 AM, Douglas Smith
>>>>>> <[log in to unmask]> wrote:
>>>>>> 
>>>>>> 
>>>>>>> Hey Bill -
>>>>>>> 
>>>>>>> 
>>>>>>> Can you try out ticket 3007 to get things to install for you?
>>>>>>> 
>>>>>>> 
>>>>>>> 1. clone the repository, then checkout tickets/3007.
>>>>>>> 2. mv the qserv dir to somewhere, with an extra version string
>>>>>>> after a dash, like "qserv-branchtest". 3. cd in the dir, then
>>>>>>> copy qserv-build.conf.example to qserv-build.conf. 4. Edit
>>>>>>> qserv-build.conf, and change the version to "branchtest" is this
>>>>>>> example, the hostname, and a mysql root password.  And anything
>>>>>>> else you might want to change. 5. then use scons.
>>>>>>> 
>>>>>>> 
>>>>>>> That should build the whole thing to a working setup.
>>>>>>> 
>>>>>>> 
>>>>>>> Let me know what else might want to get changed there.
>>>>>>> 
>>>>>>> 
>>>>>>> Douglas
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>> 
>> 
>> ########################################################################
>> Use REPLY-ALL to reply to list
>> 
>> 
>> To unsubscribe from the QSERV-L list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1
>> 
>> 
> 
> ########################################################################
> Use REPLY-ALL to reply to list
> 
> To unsubscribe from the QSERV-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the QSERV-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1