Comments (3)
Sorry for the delay.
With simulated data it is always hard to say what the model is really doing, since the optimization is mostly going to try to find the easiest way to minimize the loss. So in order to check that your model did not overfit to a particular peculiarity of your simulated data (such as the remission in this case), I would suggest that you apply different levels of noise to that channel during both training and inference on the training and validation sets, and plot both results. Under significant amounts of noise in this channel, a non overfitted model should perform reasonably well, while a "lookup-table-like" one will fail completely.
I will close this issue because it is not an issue with the code, but we can keep the chat going here!
from lidar-bonnetal.
Hi,
Remission seems to be very useful for the accuracy of the classification. However, if you will be rendering from unreal engine it will be really hard to get.
It all depends on how you will be inferring from the data. Will it be using real lidar scans? If this is the case, the most important thing is to figure out how to make the distribution of the input during inference be similar to the fake training data. SqueezeSeg V1 and V2 papers are a good starting point to check what to do when using simulated data.
No matter what approach you take with the remissions, you need to make sure that you can generate the data using the real sensor data you will use later, so the approach that has different remissions per class will not work. During inference, if you knew this beforehand then your classifier would be a simple lookup table and the cnn would not be needed, so you either need to simulate the remissions or set them to a fake constant value (like 0)
from lidar-bonnetal.
Hi,
Thanks for the very clear explanation! The inference will be from simulated data as well (so trained on simulated data and tested on simulated data). I have read through both SqueezeSeg papers, which are indeed very useful. It seems that the lack of remission affects the accuracy when the model is trained on simulated data, and then tested on real data, I will do as you suggested and set the remission to a fake constant and see how well the model performs.
Another thing that was mentioned in SqueezeSegV2 is how they modelled remission using regression with L2 loss. Since remission depends on the distance, angle and material, I'll try modelling remission based on KITTI data with x, y, z, distance and class as input features. Would this method have a similar risk of essentially becoming a look up table, and if the model performs significantly better with modelled remission, would there be a way to verify that it didn't overfit?
from lidar-bonnetal.
Related Issues (20)
- Expected object of scalar type Long but got scalar type Int for argument #2 'target'
- Question about speed after tensorrt of rangenet++ HOT 2
- Possibility of rosifying the process HOT 1
- No error or no visualizations when executing the viusalization.py file
- Questions about the learning setting HOT 1
- Where are the pretrained models HOT 4
- Inference, and training not working on Semantic KITTI dataset. HOT 2
- index the unused points HOT 1
- KNN HOT 1
- Module not found error when running the infer function to get the prediction.
- RangeNet++
- tensorflow / cuda / python versions for 22.04/20.04 HOT 2
- Where is the rangenet? HOT 1
- about labels/semantic-kitti yaml
- About train my dataset result HOT 2
- IndexError: index -2147483648 is out of bounds for axis 0 with size 64 HOT 6
- About learning_map in semantic-kitti.yaml file HOT 3
- Where do the values in arch_cfg.yaml file come from, especially fov_up, fov_down, img_means, img_stds? HOT 4
- IndexError HOT 2
- Stop-gradients in skip-connections HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lidar-bonnetal.