Giter VIP home page Giter VIP logo

3d-icp-cov's Introduction

A New Approach to 3D ICP Covariance Estimation [paper]

Overview

In mobile robotics, scan matching of point clouds using Iterative Closest Point (ICP) allows estimating sensor displacements. It may prove important to assess the associated uncertainty about the obtained rigid transformation, especially for sensor fusion purposes. We propose a novel approach to 3D ICP covariance computation that accounts for all the sources of errors as listed in Censi's pioneering work, namely wrong convergence, underconstrained situations, and sensor noise. Our approach builds on two facts. First, ICP is not a standard sensor: owing to wrong convergence the concept of ICP covariance per se is actually meaningless, as the dispersion in the ICP outputs may largely depend on the accuracy of the initialization, and is thus inherently related to the prior uncertainty on the displacement. We capture this using the unscented transform, which also reflects correlations between initial and final uncertainties. Then, assuming white sensor noise leads to overoptimism: ICP is biased, owing to e.g. calibration biases, which we account for. Our solution is tested on publicly available real data ranging from structured to unstructured environments, where our algorithm predicts consistent results with actual uncertainty, and compares very favorably to previous methods. We finally demonstrate the benefits of our method for pose-graph localization, where our approach improves accuracy and robustness of the estimates.

Code

This repo contains the code for reproducing the results of this paper. The code is based on Python and has been tested under Python 3.5 on a Ubuntu 16.04 machine. ICP algorithm is called throught our modified version of the libpointmatcher library.

Installation & Prerequies

  1. Clone this repo
git clone https://github.com/CAOR-MINES-ParisTech/3d-icp-cov.git
mkdir data
mkdir results
  1. Install the following required Python packages, matplotlib, numpy, scipy, alphashape, e.g. with the pip command
pip install matplotlib numpy scipy alphashape
  1. Clone our fork of the libpointmatcher library and build them the library
cd 3d-icp-cov
git clone https://github.com/CAOR-MINES-ParisTech/libpointmatcher.git
cd libpointmatcher
mkdir build && cd build
cmake ..
make
sudo make install
cd ../..
  1. Download the Challenging data sets for point cloud registration algorithms. Extract the zip file of each sequence corresponding to the point clouds in base frame in the data folder

Get started

  1. Modify paths and parameters in the class Param at the end of python/utils.py

  2. Launch the main file

    cd python
    python3 main.py
    

    Be patient, it will reproduce the results of the paper.

Paper

The paper A New Approach to 3D ICP Covariance Estimation for Mobile Robotics, M. Brossard, S. Bonnabel and A. Barrau. 2019, relative to this repo is available at this url.

Citation

If you use this code in your research, please cite:

@article{brossard2020anew,
  author = {Martin Brossard and Silv\`ere Bonnabel and Axel Barrau},
  title = {{A New Approach to 3D ICP Covariance Estimation}},
  year = {2020},
  journal={IEEE Robotics and Automation Letters},
  publisher={IEEE},
}

If you use the original libpointmatcher library in your research, please cite the original paper:

@article{Pomerleau12comp,
	author = {Pomerleau, Fran{\c c}ois and Colas, Francis and Siegwart, Roland and Magnenat, St{\'e}phane},
	title = {{Comparing ICP Variants on Real-World Data Sets}},
	journal = {Autonomous Robots},
	year = {2013},
	volume = {34},
	number = {3},
	pages = {133--148},
	month = feb
}

Authors

Martin Brossard^, Silvère Bonnabel^ and Axel Barrau°

^MINES ParisTech, PSL Research University, Centre for Robotics, 60 Boulevard Saint-Michel, 75006 Paris, France

°Safran Tech, Groupe Safran, Rue des Jeunes Bois-Châteaufort, 78772, Magny Les Hameaux Cedex, France

3d-icp-cov's People

Contributors

mbrossar avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

3d-icp-cov's Issues

The code to calculate d2J_dZdX in PointToPlanewithCov.cpp

T tmp_scalar_read = normal(0) * reading_direction(0) + normal(1) * reading_direction(1) + normal(2) * reading_direction(2); tmp_scalar_read = 1; tmp_scalar_read *= weight;
Hi. Could you please explain how to understand this part in the code (in "PointToPlanewithCov.cpp")? I feel confused about why to make "tmp_scalar_read = weight". Thank you.

make error

Hi, @mbrossar I tried to compile libpointmatcher but it reported some errors.
/usr/bin/ld: ../libpointmatcher.so.1.3.1: undefined reference to Nabo::NearestNeighbourSearch<double, Eigen::Matrix<double, -1, -1, 0, -1, -1> >::create(Eigen::Matrix<double, -1, -1, 0, -1, -1> const&, int, Nabo::NearestNeighbourSearch<double, Eigen::Matrix<double, -1, -1, 0, -1, -1> >::SearchType, unsigned int, Nabo::Parameters const&)
However, I also tried to compile the original libpointmatcher and only succeed with the master branch libpointmatcher issue.
I installed libnabo 1.0.7 successfully. Do you have any ideas? Thanks.

About base.p error

I tried to run your code, but found an error as follows:
Traceback (most recent call last):
File "/home/XXX/PycharmProjects/ICP_cov/venv/main.py", line 49, in
icp.results(dataset, sequence, scan_ref, scan_in, Param.cov_ut)
File "/home/XXX/PycharmProjects/ICP_cov/venv/icp.py", line 93, in results
cov_base += 1/8*dataset.load(f_base)['cov_base']
File "/home/XXX/PycharmProjects/ICP_cov/venv/dataset.py", line 53, in load
with open(file_name, "rb") as file_pi:
FileNotFoundError: [Errno 2] No such file or directory: '/home/XXX/PycharmProjects/ICP_cov/venv/results/Mountain/base.p'

I've checked your code, I haven't figured out where the above file (base.p) is generated.

I'm a beginner for python, and I'm studying your work recently.
Looking forward to your reply, thanks a lot!

Missing icp_without_cov

Hi,
I've installed and managed to run your main.py but it seems to be missing an executable called icp_without_cov within the examples folder from libpointmatcher.
Have I missed something?
Thanks

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.