Comments (10)
- Do you properly gravity-rectify and undistort the images? Do the gravity estimates look sufficiently accurate?
- Are you sure that the ground truth poses of these datasets are sufficiently accurate for such evaluation?
from orienternet.
Thank you for your response. I appreciate your diligence in this matter. Upon my initial interpretation, I may have made a mistake.
I conducted tests on the KITTI dataset and the results aligned well with the data provided in your paper. However, when I applied the same tests to the Nuscenes dataset, I observed a significant drop in the XY position (5m), which fell to 48% recall under a maximum initial error of 32m.
I have verified the roll pitch that we used to rectify the camera (similar to the process what you used in KITTI dataset, pixel to camera, camera to vehicle, and vehicle to world). For my training, I only use the front camera data.
from orienternet.
- So you actually do retrain the model on the Nuscenes dataset? Do you initialize it with the model trained on Mapillary? How large is the dataset? Are you sure that it is not simply overfitting?
- I am not familiar with the Nuscenes dataset, but it may simply be more difficult than KITTI if it has sparser distinctive semantic elements (more data from highways, less from city & residential areas) or if OSM is of lower quality in these areas (incorrect or fewer labels).
from orienternet.
- Yes, I retrained on Nuscenes.
- No,I trained model from scratch. The nuscenes dataset containes around 30K training samples and 6k validation samples.
from orienternet.
This is likely too small. If the training and validation data are in disjoint areas, you should see a clear overfitting.
from orienternet.
Thx for your replying! It does overfit the training dataset. The recall half meters is 100% in training dataset....May I know how much data in general to train this model?
from orienternet.
The more the better. Try initializing your model with the pre-trained Mapillary model that we provide.
from orienternet.
Hi, Thx for the great work. I recently have tried to apply your work on various autonomous driving dataset and find out the performance is way lower compare to the information you gave in paper such as KITTI, under same max init error. E.g. The position XY 5m recall is only around 40% under 32 init error.
Hello, SiYlin, I've also been trying to migrate Orienternet to NuScenes recently. I wanted to ask you how you're getting GPS information. As far as I know, NuScenes only provides ground truth pose and doesn't include raw GPS information with noise. Thank you very much!
from orienternet.
Hi, Thx for the great work. I recently have tried to apply your work on various autonomous driving dataset and find out the performance is way lower compare to the information you gave in paper such as KITTI, under same max init error. E.g. The position XY 5m recall is only around 40% under 32 init error.
Hello, SiYlin, I've also been trying to migrate Orienternet to NuScenes recently. I wanted to ask you how you're getting GPS information. As far as I know, NuScenes only provides ground truth pose and doesn't include raw GPS information with noise. Thank you very much!
Hi :
You can try to add some random noise on the ground truth pose to fake the scenario in which you have noise GPS information.
from orienternet.
Hi, Thx for the great work. I recently have tried to apply your work on various autonomous driving dataset and find out the performance is way lower compare to the information you gave in paper such as KITTI, under same max init error. E.g. The position XY 5m recall is only around 40% under 32 init error.
Hello, SiYlin, I've also been trying to migrate Orienternet to NuScenes recently. I wanted to ask you how you're getting GPS information. As far as I know, NuScenes only provides ground truth pose and doesn't include raw GPS information with noise. Thank you very much!
Hi : You can try to add some random noise on the ground truth pose to fake the scenario in which you have noise GPS information.
Got it, that's exactly what I'm doing now🤣, thanks.
from orienternet.
Related Issues (20)
- About adapting the map crop size HOT 1
- About the PV branch and BEV module HOT 3
- A small bug HOT 3
- Question about scale bins HOT 4
- Error regarding ReadTimeout occured while preparing MGL dataset HOT 7
- A simple test with OrienterNet HOT 2
- Tensor with 0 values after rectification when trying demo HOT 5
- a question about the demo HOT 2
- Downloading of KITTI dataset for evaluation HOT 6
- Questions about the Good Semantics to localize experiment(Fig 10.) HOT 1
- Guidance on the training method(code) using the KITTI dataset
- Question about sample_xyz HOT 2
- Question about MGL Dataset HOT 1
- Where to find reconstruction statistics? HOT 1
- Question about prepare MGL dataset HOT 3
- Potential label leakage issue due to tile stitching in SD map HOT 4
- About roll angle rectify after image flipping HOT 3
- Running visualize_predictions_sequences.ipynb
- Inquiring about the potential issues of score and map position offsets caused by the camera position not being at the center of the BEV. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from orienternet.