 |
 |
Ok, for the large scale test, the best way to get a large test set of data will be to run the duplicator over the pt12 data. I've copied the pt12 data already to in2p3, so that data is there. But the duplicator should be run on each node, so each node gets data produced for itself. And this all runs in parallel, so hopefully it won't take too long. But the basic example command for the pt12 data is: qserv/master/examples/makeChunk.py -S 100 -s 10 --dupe --node-count=120 --node=1 --chunk-prefix=Object --theta-name=ra_PS --phi-name=decl_PS --schema Object.sql Object.txt And this was for the yili test here at slac, which had 120 nodes, and I was using 100 stripes, and 10 substripes (to produce ~10k chunks). This was on the Object table. And you might have to tweak the paths for the makeChunk.py script, and a path to the schema, and a path to the cvs file: Object.txt. And each node will need the appropriate node number for the --node option. But we should copy the pt12 data to each node first. Then run the above command on each node, with the appropriate paths. Then in a few hours each node should have its data. Then on each node separately the data will get loaded. Douglas ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the QSERV-L list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=QSERV-L&A=1