LISTSERV mailing list manager LISTSERV 16.5

Help for HPS-SOFTWARE Archives


HPS-SOFTWARE Archives

HPS-SOFTWARE Archives


HPS-SOFTWARE@LISTSERV.SLAC.STANFORD.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

HPS-SOFTWARE Home

HPS-SOFTWARE Home

HPS-SOFTWARE  May 2014

HPS-SOFTWARE May 2014

Subject:

Re: problem running recon on MDC data

From:

"McCormick, Jeremy I." <[log in to unmask]>

Reply-To:

Software for the Heavy Photon Search Experiment <[log in to unmask]>

Date:

Wed, 7 May 2014 22:14:54 -0700

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (410 lines)

This is looking much better now.  Thanks!

> On May 7, 2014, at 6:54 PM, "Sho Uemura" <[log in to unmask]> wrote:
>
> The steering file I'm using for MDC recon is
> HPS2014OfflineTruthRecon.lcsim. HPS2014OfflineRecon.lcsim probably won't
> give you good tracks, either.
>
> (The difference is in how hit times are referenced in ECal and SVT.)
>
>> On Wed, 7 May 2014, Omar Moreno wrote:
>>
>> Oops, yeah, you're right.  I was looking at a recon file I generated when
>> running the reconstruction not the readout file.
>>
>> Either way, when I run the reconstruction using the steering file
>> HPS2014OfflineRecon, I'm not seeing clusters in the recon file that is
>> generated.  Is anybody else having this issue??
>>
>>
>>> On Wed, May 7, 2014 at 5:56 PM, Sho Uemura <[log in to unmask]> wrote:
>>>
>>> That's the readout file, not the recon file. The readout file will
>>> naturally not contain clusters.
>>>
>>>
>>> On Wed, 7 May 2014, Omar Moreno wrote:
>>>
>>> Hi Sho and Jeremy,
>>>>
>>>> I just noticed that the readout file found here:
>>>>
>>>> http://www.slac.stanford.edu/~meeg/hps2/meeg/mock_data/tritrig-beam-tri
>>>> _1-10_readout.slcio
>>>>
>>>> the collection of Ecal clusters is absent from most events.  Looking at
>>>> the
>>>> clustering driver used in HPS2014OfflineRecon, EcalClusterICBasic, it
>>>> looks
>>>> like an empty collection is added to every event.  Maybe the readout file
>>>> was generated before this was put in?
>>>>
>>>> This is also another reason why ReconstructedParticles were not being
>>>> written to every event since  I require that the event have a collection
>>>> of
>>>> Ecal clusters before I run the driver (I was trying to save time).  With
>>>> the fix I applied it will write an empty collection regardless but it
>>>> still
>>>> won't run the ReconstructedParticle maker without clusters.  I'm just
>>>> going
>>>> to remove this condition and run the ReconstructedParticle maker
>>>> regardless.
>>>>
>>>> --Omar Moreno
>>>>
>>>>
>>>> On Wed, May 7, 2014 at 4:53 PM, Omar Moreno <[log in to unmask]> wrote:
>>>>
>>>>
>>>>>
>>>>> On Wed, May 7, 2014 at 4:32 PM, McCormick, Jeremy I. <[log in to unmask]
>>>>> stanford.edu> wrote:
>>>>>
>>>>> Hi, Omar.
>>>>>>
>>>>>> I'm just going to CC this thread to the software list from now.
>>>>>>
>>>>>> I can run the reconstruction now over all the events in this file after
>>>>>> your fix:
>>>>>>
>>>>>>
>>>>>> http://www.slac.stanford.edu/~meeg/hps2/meeg/mock_data/
>>>>>> tritrig-beam-tri_1-10_readout.slcio
>>>>>>
>>>>>> I am using the steering file HPS2014OfflineRecon.lcsim which you
>>>>>> recommended.
>>>>>>
>>>>>> But I am still seeing a lot of problems with the ReconstructedParticle
>>>>>> output...
>>>>>>
>>>>>> 1) Most of the events have no ReconstructedParticle collections in them
>>>>>> at all.
>>>>>>
>>>>>> Every event should have these collections in them, even if they are
>>>>>> empty:
>>>>>>
>>>>>> BeamspotConstrainedV0Candidates
>>>>>> FinalStateParticles
>>>>>> UnconstrainedV0Candidates
>>>>>> TargetConstrainedV0Candidates
>>>>> ?I'm aware of this. I have already fixed this locally and will commit it
>>>>> later.?
>>>>>
>>>>>
>>>>>
>>>>>> If the same set of collections are not present in every event, it
>>>>>> becomes
>>>>>> clunky to access the data, requiring a lot of unnecessary checks in the
>>>>>> Driver code to see if the collection exists.  (EventHeader throws fatal
>>>>>> exceptions if you try to access a collection that is not there!)
>>>>> ?yup ...?
>>>>>
>>>>>
>>>>>
>>>>>> 2) For the events that do have ReconstructedParticle collections in
>>>>>> them,
>>>>>> mostly they are empty, from what I can tell.  I just stepped through
>>>>>> maybe
>>>>>> the first 100 events in the sample, so I would need to confirm that
>>>>>> this is
>>>>>> true for the 12k events.  I only found one collection that had objects
>>>>>> in
>>>>>> it, and....
>>>>> ?I'll check, but I have seen otherwise.?
>>>>>
>>>>>
>>>>>
>>>>>> 3) For the few events that I did find with ReconstructedParticles in
>>>>>> them, the data is still all zeros.
>>>>> ?I'm filling the momentum, energy and charge so the only things that
>>>>> should be empty are mass, particle ID, type and reference point.  For the
>>>>> vertexed particles, I'm probably going to add the mass as well but it's
>>>>> not in there yet.  I've checked a few events and they are being filled
>>>>> accordingly. ?
>>>>>
>>>>>
>>>>>
>>>>>> Can you confirm these problems on your end?  Or did I do something wrong
>>>>>> here in my configuration?
>>>>>>
>>>>>> BTW, when running the recon, you might put this Driver into your job
>>>>> along
>>>>>
>>>>>> with the AidaSaveDriver to save the plots:
>>>>>>
>>>>>>
>>>>>> /hps-users/src/main/java/org/hps/users/jeremym/
>>>>>> MockDataChallengeDiagnosticDriver.java
>>>>>
>>>>>
>>>>> It plots basically all of the data in all the collections, so it can be
>>>>>> used for diagnostics.
>>>>>>
>>>>>> Or run its TestCase on your output data (just hand hack the TestCase for
>>>>>> now):
>>>>>>
>>>>>>
>>>>>> /hps-users/src/test/java/org/hps/users/jeremym/
>>>>>> MockDataChallengeDiagnosticDriverTest.java
>>>>>>
>>>>>> Though right now it doesn't plot the ReconstructedParticle collections
>>>>>> at
>>>>>> all due to issue #1 (I set everything up automatically based on the
>>>>>> collections in the first event but for this data set those collections
>>>>>> aren't present in the first event!).
>>>>>>
>>>>>> We can cover these issues in more detail at the software meeting.
>>>>>>
>>>>>> --Jeremy
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Omar Moreno [mailto:[log in to unmask]]
>>>>>> Sent: Wednesday, May 07, 2014 2:59 PM
>>>>>> To: Uemura, Sho
>>>>>> Cc: Graham, Mathew Thomas; McCormick, Jeremy I.; Moreno, Omar
>>>>>> Subject: Re: problem running recon on MDC data
>>>>>>
>>>>>> Ah, OK.  Thanks Sho. ?
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, May 7, 2014 at 2:58 PM, Sho Uemura <[log in to unmask]>
>>>>>> wrote:
>>>>>>
>>>>>>
>>>>>>        It's slow because the time cuts are very loose, i.e. right now
>>>>>> there is a trade-off between speed and recon efficiency, and we've
>>>>>> chosen
>>>>>> to maximize efficiency. It's still fast enough for the MDC.
>>>>>>
>>>>>>
>>>>>>        On Wed, 7 May 2014, Omar Moreno wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>                My recon is running unusually slow.  I thought this
>>>>>> issue
>>>>>> was fixed but
>>>>>>
>>>>>>                maybe I'm mistaken.  Is anyone else having this
>>>>>> problem??
>>>>>>
>>>>>>
>>>>>>
>>>>>>                On Wed, May 7, 2014 at 2:50 PM, Omar Moreno <
>>>>>> [log in to unmask]> wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>                        The recon works now.
>>>>>>
>>>>>>
>>>>>>                        On Tue, May 6, 2014 at 4:04 PM, Mathew Graham <
>>>>>> [log in to unmask]>wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>                                Right?that?s pretty unlikely.
>>>>>>
>>>>>>
>>>>>>                                On May 6, 2014, at 3:10 PM, McCormick,
>>>>>> Jeremy I. <
>>>>>>
>>>>>>                                [log in to unmask]> wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>                                        But I'm not sure that
>>>>>> explanation
>>>>>> makes sense, anyways, because it does
>>>>>>
>>>>>>
>>>>>>                                get through 173 events before crashing,
>>>>>> unless all those events had no
>>>>>>                                tracks and Billoir was not activated
>>>>>> until the crash...
>>>>>>
>>>>>>
>>>>>>                                        --Jeremy
>>>>>>
>>>>>>                                        -----Original Message-----
>>>>>>                                        From: Graham, Mathew Thomas
>>>>>>                                        Sent: Tuesday, May 06, 2014 2:44
>>>>>> PM
>>>>>>                                        To: McCormick, Jeremy I.;
>>>>>> Moreno,
>>>>>> Omar
>>>>>>                                        Cc: Uemura, Sho
>>>>>>                                        Subject: Re: problem running
>>>>>> recon on MDC data
>>>>>>
>>>>>>
>>>>>>                                        Yes...so I have no answers.
>>>>>>
>>>>>>                                        On 5/6/2014 2:43 PM, McCormick,
>>>>>> Jeremy I. wrote:
>>>>>>
>>>>>>
>>>>>>                                                Okay, I see what you
>>>>>> mean.  But I'm running the entire reconstruction
>>>>>>
>>>>>>
>>>>>>                                chain from HPS2014OfflineRecon.lcsim on
>>>>>> the simulated readout data.  So
>>>>>>                                shouldn't those classes be available?
>>>>>>
>>>>>>
>>>>>>
>>>>>>                                                -----Original
>>>>>> Message-----
>>>>>>                                                From: Graham, Mathew
>>>>>> Thomas
>>>>>>                                                Sent: Tuesday, May 06,
>>>>>> 2014 2:41 PM
>>>>>>                                                To: McCormick, Jeremy
>>>>>> I.;
>>>>>> Moreno, Omar
>>>>>>                                                Cc: Uemura, Sho
>>>>>>                                                Subject: Re: problem
>>>>>> running recon on MDC data
>>>>>>
>>>>>>
>>>>>>                                                That line is casting the
>>>>>> track as a SeedTrack and then getting a
>>>>>>
>>>>>>
>>>>>>                                SeedCandidate...however, you can only do
>>>>>> this if you run reconstructions
>>>>>>                                reconstruction since SeedCandidate isn't
>>>>>> persisted and isn't even known in
>>>>>>                                lcio.
>>>>>>
>>>>>>
>>>>>>
>>>>>>                                                On 5/6/2014 2:01 PM,
>>>>>> McCormick, Jeremy I. wrote:
>>>>>>
>>>>>>
>>>>>>                                                        Hi,
>>>>>>
>>>>>>                                                        I'm attempting
>>>>>> to
>>>>>> run the current version of the recon on this data
>>>>>>
>>>>>>
>>>>>>                                from Sho.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> http://www.slac.stanford.edu/~meeg/hps2/meeg/mock_data/tritrig-beam-tr<
>>>>>> http://www.slac.stanford.edu/~meeg/hps2/meeg/mock_data/tritrig-beam-tr>
>>>>>>
>>>>>>
>>>>>>
>>>>>> i_1-10_readout.slcio
>>>>>>
>>>>>>                                                        However, I get a
>>>>>> fatal exception some events into the job.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Event 174
>>>>>>
>>>>>>
>>>>>>
>>>>>> java.lang.NullPointerException
>>>>>>                                                                 at
>>>>>>
>>>>>>
>>>>>>
>>>>>> org.hps.recon.particle.HpsReconParticleDriver.toBilliorTrack(
>>>>>> HpsReconParticleDriver.java:100)
>>>>>>
>>>>>>
>>>>>>                                                                 at
>>>>>>
>>>>>>
>>>>>>
>>>>>> org.hps.recon.particle.HpsReconParticleDriver.vertexParticles(
>>>>>> HpsReconParticleDriver.java:62)
>>>>>>
>>>>>>
>>>>>>                                                                 at
>>>>>>
>>>>>>
>>>>>>
>>>>>> org.hps.recon.particle.ReconParticleDriver.process(
>>>>>> ReconParticleDriver.java:142)
>>>>>>
>>>>>>
>>>>>>                                                                 at
>>>>>> org.lcsim.util.Driver.doProcess(Driver.java:273)
>>>>>>                                                                 at
>>>>>> org.lcsim.util.Driver.processChildren(Driver.java:284)
>>>>>>                                                                 at
>>>>>> org.lcsim.util.Driver.process(Driver.java:198)
>>>>>>                                                                 at
>>>>>>
>>>>>>
>>>>>>
>>>>>> org.lcsim.util.DriverAdapter.recordSupplied(DriverAdapter.java:74)
>>>>>>
>>>>>>
>>>>>>                                                                 at
>>>>>>
>>>>>>
>>>>>>
>>>>>> org.freehep.record.loop.DefaultRecordLoop.consumeRecord(
>>>>>> DefaultRecordLoop.java:832)
>>>>>>
>>>>>>
>>>>>>                                                                 at
>>>>>>
>>>>>>
>>>>>>
>>>>>> org.freehep.record.loop.DefaultRecordLoop.loop(
>>>>>> DefaultRecordLoop.java:668)
>>>>>>
>>>>>>
>>>>>>                                                                 at
>>>>>>
>>>>>>
>>>>>>
>>>>>> org.freehep.record.loop.DefaultRecordLoop.execute(
>>>>>> DefaultRecordLoop.java:566)
>>>>>>
>>>>>>
>>>>>>                                                                 at
>>>>>> org.lcsim.util.loop.LCSimLoop.loop(LCSimLoop.java:152)
>>>>>>                                                                 at
>>>>>>
>>>>>> org.lcsim.job.JobControlManager.run(JobControlManager.java:416)
>>>>>>
>>>>>>                                                        Any idea on what
>>>>>> the problem could be and if it can be easily fixed?
>>>>>>
>>>>>>                                                        --Jeremy
>>>> ########################################################################
>>>> Use REPLY-ALL to reply to list
>>>>
>>>> To unsubscribe from the HPS-SOFTWARE list, click the following link:
>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
>>
>> ########################################################################
>> Use REPLY-ALL to reply to list
>>
>> To unsubscribe from the HPS-SOFTWARE list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1
>>

########################################################################
Use REPLY-ALL to reply to list

To unsubscribe from the HPS-SOFTWARE list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

April 2024
March 2024
February 2024
January 2024
December 2023
November 2023
October 2023
September 2023
August 2023
July 2023
June 2023
May 2023
April 2023
March 2023
February 2023
January 2023
December 2022
November 2022
October 2022
September 2022
August 2022
June 2022
April 2022
March 2022
February 2022
January 2022
December 2021
November 2021
October 2021
September 2021
August 2021
July 2021
June 2021
May 2021
April 2021
March 2021
February 2021
January 2021
December 2020
November 2020
October 2020
September 2020
August 2020
July 2020
June 2020
May 2020
April 2020
March 2020
February 2020
January 2020
December 2019
November 2019
October 2019
September 2019
August 2019
July 2019
June 2019
May 2019
April 2019
March 2019
February 2019
January 2019
December 2018
November 2018
October 2018
September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011

ATOM RSS1 RSS2



LISTSERV.SLAC.STANFORD.EDU

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager

Privacy Notice, Security Notice and Terms of Use