Comments (5)
twongjirad
commented on July 29, 2024
Why doesn't this happen every time?
Example of correct label:
[INFO] <test::_batch_process_::L248> Processing entry: 1783
[INFO] <testIOManager::get_data::L494> Setting event id (5498,22,1118)
[INFO] <SimpleFiller::fill_entry_data::L307> BNB PdgCode=14
Vertex (x, y, z, t) = (137.517,16.5527,204.815,3403.09)
Momentum (px, py, pz) = (-0.467529,1.17446,1243.1)
Inittial Energy = 1243.1
Deposit Energy = 1098.56
# Bounding Box = 3
Plane 0 (rows,cols) = (2160,672) ... Left Top (618,7806) ... Right Bottom (1290,5646)
Plane 1 (rows,cols) = (2160,832) ... Left Top (709,7806) ... Right Bottom (1541,5646)
Plane 2 (rows,cols) = (2160,1472) ... Left Top (670,7806) ... Right Bottom (2142,5646)
[INFO] <SimpleFiller::fill_entry_data::L320> Label to Datum: 1
What's in the ROOT file:
root [2] partroi_tpc_tree->Show(1783)
======> EVENT:1783
partroi_tpc_branch = (larcv::EventROI*)0x4e8f630
_producer = tpc
_run = 5637
_subrun = 72
_event = 3610
_part_v = (vector<larcv::ROI>*)0x4e8f680
_part_v._index = 0, 1, 2
_part_v._shape = 2, 1, 1
_part_v._type = 2, 6, 9
_part_v._mcst_index = 65535, 0, 1
_part_v._mct_index = 0, 0, 0
_part_v._energy_deposit = 271.893, 181.092, 90.801
_part_v._energy_init = 414.253, 286.751, 1029.07
_part_v._pdg = 14, 13, 2212
_part_v._parent_pdg = 0, 13, 2212
_part_v._trackid = 4294967295, 1, 2
_part_v._parent_trackid = 4294967295, 1, 2
_part_v._vtx._x = 121.65, 121.65, 121.65
from larcv.
twongjirad
commented on July 29, 2024
Oh shit! The Run,subrun,event numbers are different...
Something is not right ... I checked I am filling from same file I am checking with ROOT...
from larcv.
twongjirad
commented on July 29, 2024
some notes:
use_thread = false, non-random: seems ok. it says it is processing entry X, and the ROI dumped out matches.
use_thread = true, non-random: seems ok
use_thread = true; random: weirdness
use_thread = false; random: weirdness
i'm relying on cout with threads -- dangerous? but it is single thread filling sequentially?
from larcv.
twongjirad
commented on July 29, 2024
there a double-shuffle?
In initializer of https://github.com/LArbys/LArCV/blob/master/core/Processor/ProcessDriver.cxx
the entries are shuffled.
if(_random_access) std::random_shuffle(_access_entry_v.begin(),_access_entry_v.end());
In https://github.com/LArbys/LArCV/blob/master/app/APICaffe/ThreadDatumFiller.cxx
_batch_process
the entry to be drawn is randomized between (0,numentries in tree)
This random draw, X, is stored.
But when it goes to process driver, this X is used to get entry Y = _access_entry_v[X].
X is stored in vector passed back to analysis.
So when training, correct label for an image is sent to net. but the wrong entry number for image-ROI pair is passed back to analysis script.
from larcv.
twongjirad
commented on July 29, 2024
Fixed in #36
from larcv.
Related Issues (20)
- larcv python script crashes when larlite is configured HOT 8
- LArbys/caffe UseThread: false doesn't fill HOT 2
- Can't Open RGB Viewer HOT 1
- PyROOT issue in viewer (and proposed fix) HOT 7
- enhanced hoverrect
- segmentation image not showing up in v05 production! HOT 2
- minor: app objects rebuild when typing make, even if nothing changes HOT 2
- production tools HOT 2
- Segmentation Relabeling HOT 2
- New modules HOT 1
- Supera failure HOT 3
- [LArbys/cafef] IO optimization HOT 1
- develop branch missing DataFormat/ParticleMass.h HOT 4
- error: no class named 'CircularBufferBase' in namespace 'larcv' HOT 2
- compiler error with DBSCAN code when using GCC 4 HOT 6
- UBWireTool.cxx not build HOT 2
- [CRITICAL] <MultiROICropper::process> MultiROICropper.cxx::L50 EventImage2D size 0 <= target channel 0 HOT 6
- error running vertex code. giving <VertexAna::process> Cannot find nearest wire for (-1,-1,-1) HOT 4
- Running vertex container gives me this error HOT 2
- Lot's of warning from signed versus unsigned integer comparisons HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from larcv.