Hello Rafo,
Thanks for starting this. I can't help you at all regarding the issues you are experiencing running at JLab, but I'll try to run some jobs here at SLAC to at least check out the timing issue.
By the way, I believe you might have to disable the SVT alignment constants derived from the database when running with the new geometry. To do this, add the " -DdisableSvtAlignmentConstants " argument to your command line.
Maurik, would you be able to run the profiler for both of these situations? Something might just stand out that would help us chase this down.
Norman
________________________________
From: [log in to unmask] <[log in to unmask]> on behalf of Rafayel Paremuzyan <[log in to unmask]>
Sent: Friday, May 19, 2017 12:27 PM
To: hps-software; [log in to unmask]
Subject: Test pass1 Status
Hi All,
During the testing the recon for test pass1,
I noticed the recon time is more than x2 longer wrt pass0 recon time.
To demonstrate it
I submit 3 simple jobs with 10K events to reconstruct, with new pass1 xml file (this has the new jar v051717, and the new detector HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign),
and the old pass0 xml file (pass0 jar release 3.9, and the detector HPS-PhysicsRun2016-Nominal-v4-4-fieldmap)
Below is a printout from the jobs with a new JAR, v051717<https://github.com/JeffersonLab/hps-java/releases/tag/v051717>, the average time for 1000 events is more than 7 minutes
===================== LOG from the v051717 JAR ==============================
2017-05-19 09:36:51 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10614074 with sequence 0
2017-05-19 09:43:13 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10615074 with sequence 1000
2017-05-19 09:49:18 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10616074 with sequence 2000
2017-05-19 09:55:54 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10617074 with sequence 3000
2017-05-19 10:02:55 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10618074 with sequence 4000
2017-05-19 10:09:57 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10619074 with sequence 5000
2017-05-19 10:16:13 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10620074 with sequence 6000
2017-05-19 10:25:20 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10621074 with sequence 7000
2017-05-19 10:32:56 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10622074 with sequence 8000
2017-05-19 10:36:19 [WARNING] org.hps.recon.tracking.TrackerReconDriver process :: Discarding track with bad HelicalTrackHit (correction distance 0.000000, chisq penalty 0.000000)
2017-05-19 10:42:03 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10623074 with sequence 9000
2017-05-19 10:47:44 [INFO] org.hps.evio.EvioToLcio run :: maxEvents 10000 was reached
2017-05-19 10:47:44 [INFO] org.lcsim.job.EventMarkerDriver endOfData :: 10000 events processed in job.
2017-05-19 10:47:44 [INFO] org.hps.evio.EvioToLcio run :: Job finished successfully!
And below is the Job log info from the pass0 jar. The average time for 1000 events is less than 3 minutes
===================== LOG from the 3.9 release JAR ==============================
2017-05-19 13:19:46 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10614074 with sequence 0
2017-05-19 13:23:36 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10615074 with sequence 1000
2017-05-19 13:27:03 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10616074 with sequence 2000
2017-05-19 13:30:40 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10617074 with sequence 3000
2017-05-19 13:34:20 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10618074 with sequence 4000
2017-05-19 13:38:11 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10619074 with sequence 5000
2017-05-19 13:41:43 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10620074 with sequence 6000
2017-05-19 13:45:54 [WARNING] org.hps.recon.tracking.TrackerReconDriver process :: Discarding track with bad HelicalTrackHit (correction distance 0.000000, chisq penalty 0.000000)
2017-05-19 13:46:05 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10621074 with sequence 7000
2017-05-19 13:50:08 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10622074 with sequence 8000
2017-05-19 13:55:03 [INFO] org.lcsim.job.EventMarkerDriver process :: Event 10623074 with sequence 9000
2017-05-19 13:58:27 [INFO] org.hps.evio.EvioToLcio run :: maxEvents 10000 was reached
2017-05-19 13:58:27 [INFO] org.lcsim.job.EventMarkerDriver endOfData :: 10000 events processed in job.
2017-05-19 13:58:27 [INFO] org.hps.evio.EvioToLcio run :: Job finished successfully!
I also tried to do reconstruction by myself interactively, but I am getting error below,
The command
/apps/scicomp/java/jdk1.7/bin/java -XX:+UseSerialGC -cp hps-distribution-3.9-bin.jar org.hps.evio.EvioToLcio -x /org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim -r -d HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign -R 7796 -DoutputFile=out_7796_0 hps_007796.evio.0 -n 10000
The Error traceback
017-05-19 14:58:44 [CONFIG] org.hps.evio.EvioToLcio parse :: using steering resource /org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim
2017-05-19 14:58:44 [CONFIG] org.hps.evio.EvioToLcio parse :: set max events to 10000
2017-05-19 14:58:45 [CONFIG] org.lcsim.job.JobControlManager addVariableDefinition :: outputFile = out_7796_0
2017-05-19 14:58:45 [CONFIG] org.hps.evio.EvioToLcio parse :: set steering variable: outputFile=out_7796_0
2017-05-19 14:58:45 [CONFIG] org.lcsim.job.JobControlManager initializeLoop :: initializing LCSim loop
2017-05-19 14:58:45 [CONFIG] org.lcsim.job.JobControlManager initializeLoop :: Event marker printing disabled.
2017-05-19 14:58:45 [INFO] org.hps.conditions.database.DatabaseConditionsManager resetInstance :: DatabaseConditionsManager instance is reset
Exception in thread "main" java.lang.UnsatisfiedLinkError: /u/apps/scicomp/java/jdk1.7.0_75/jre/lib/i386/xawt/libmawt.so: libXext.so.6: cannot open shared object file: No such file or directory
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1851)
at java.lang.Runtime.load0(Runtime.java:795)
at java.lang.System.load(System.java:1062)
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1872)
at java.lang.Runtime.loadLibrary0(Runtime.java:849)
at java.lang.System.loadLibrary(System.java:1088)
at sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:67)
at sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:47)
at java.security.AccessController.doPrivileged(Native Method)
at java.awt.Toolkit.loadLibraries(Toolkit.java:1653)
at java.awt.Toolkit.<clinit>(Toolkit.java:1682)
at java.awt.Component.<clinit>(Component.java:595)
at org.lcsim.util.aida.AIDA.<init>(AIDA.java:68)
at org.lcsim.util.aida.AIDA.defaultInstance(AIDA.java:53)
at org.hps.evio.RfFitterDriver.<init>(RfFitterDriver.java:31)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.Class.newInstance(Class.java:379)
at org.lcsim.job.JobControlManager.setupDrivers(JobControlManager.java:1199)
at org.hps.job.JobManager.setupDrivers(JobManager.java:82)
at org.lcsim.job.JobControlManager.setup(JobControlManager.java:1052)
at org.lcsim.job.JobControlManager.setup(JobControlManager.java:1110)
at org.hps.evio.EvioToLcio.parse(EvioToLcio.java:407)
at org.hps.evio.EvioToLcio.main(EvioToLcio.java:97)
I see this library libXext.so.6: in /usr/lib64, but not in /usr/lib,
when I put /usr/lib64 in my LD_LIBRARY_PATH, then it complaines again (see below)
Exception in thread "main" java.lang.UnsatisfiedLinkError: /u/apps/scicomp/java/jdk1.7.0_75/jre/lib/i386/xawt/libmawt.so: libXext.so.6: wrong ELF class: ELFCLASS64
I would appreciate, if I get some help on running the reconstruction interactively, then I could look more closely into logs
of the old, and new JAR files.
Rafo
________________________________
Use REPLY-ALL to reply to list
To unsubscribe from the HPS-SOFTWARE list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the HPS-SOFTWARE list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
