Giter VIP home page Giter VIP logo

stereo-3d-reconstruction's Introduction

Stereo 3D Reconstruction

This repository contains the source code for the paper Toward 3D Object Reconstruction from Stereo Images.

Important Note: The source code is in the (Stereo2Voxel/Stereo2Point) branches of the repository.

Overview

Cite this work

@article{xie2021towards,
  title={Toward 3D Object Reconstruction from Stereo Images},
  author={Xie, Haozhe and
          Tong, Xiaojun and
          Yao, Hongxun and
          Zhou, Shangchen and
          Zhang, Shengping and
          Sun, Wenxiu},
  journal={Neurocomputing},
  year={2021}
}

Datasets

We use the StereoShapeNet dataset in our experiments, which is available below:

Pretrained Models

The pretrained models on StereoShapeNet are available as follows:

Prerequisites

Clone the Code Repository

git clone https://github.com/hzxie/Stereo-3D-Reconstruction.git

Install Python Denpendencies

cd Stereo-3D-Reconstruction
pip install -r requirements.txt

Train/Test Stereo2Voxel

git checkout Stereo2Voxel

Train/Test Stereo2Point

git checkout Stereo2Point

cd extensions/chamfer_dist
python setup.py install --user

Update Settings in config.py

You need to update the file path of the datasets:

__C.DATASETS.SHAPENET.LEFT_RENDERING_PATH   = '/path/to/ShapeNetStereoRendering/%s/%s/render_%02d_l.png'
__C.DATASETS.SHAPENET.RIGHT_RENDERING_PATH  = '/path/to/ShapeNetStereoRendering/%s/%s/render_%02d_r.png'
__C.DATASETS.SHAPENET.LEFT_DISP_PATH        = '/path/to/ShapeNetStereoRendering/%s/%s/disp_%02d_l.exr'
__C.DATASETS.SHAPENET.RIGHT_DISP_PATH       = '/path/to/ShapeNetStereoRendering/%s/%s/disp_%02d_r.exr'
__C.DATASETS.SHAPENET.VOLUME_PATH           = '/path/to/ShapeNetVox32/%s/%s.mat'

Get Started

To train GRNet, you can simply use the following command:

python3 runner.py

To test GRNet, you can use the following command:

python3 runner.py --test --weights=/path/to/pretrained/model.pth

License

This project is open sourced under MIT license.

stereo-3d-reconstruction's People

Contributors

hzxie avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

stereo-3d-reconstruction's Issues

missing volume data set

__C.DATASETS.SHAPENET.PT_CLOUD_PATH = '/home/hzxie/Datasets/ShapeNet/ShapeNetVox32/%s/%s.mat'
Could you please provide a download link for this dataset?

I'm sorry my English is not good

Questions about point cloud datasets and training overfitting

Hello, Haozhe, first of all congratulations for a great job, and secondly I would like to ask two questions I encountered during the reproduction process (I used the reconstruction point cloud part):

  1. I downloaded the dataset you recommended, but there is no point cloud ground truth in it. Where should I download the relevant data?
  2. After I used my existing point cloud ground truth data, due to some data processing problems, I only trained the aircraft data set separately, but there will always be overfitting phenomenon. I would like to ask if you have encountered such a problem? ? I put the loss function curve below.
    931669784063_ pic

The dataset of ShapeNetVox32 in 'mat' format

I'm very interested in your project。But I donot have the dataset of ShapeNetVox32 in 'mat' format. could you publish the dataset of ShapeNetVox32 in 'mat' format? When I use the 'binvox' format, the final result is very different。

我对你的项目很感兴趣。但是我没有“mat”格式的ShapeNetVOX32数据集。您能以“mat”格式发布ShapeNetVOX32的数据集吗?当我使用“binvox”格式时,最终结果差距很大。谢谢

Training failure and missing data set

  1. When I trained the Stereo2Voxel,the loss continues to rise.The IoU has been maintained at around 0.04.
    image
    Then I used the trained model to test.
    Here's the result.
    image
    I don't know why,and need your help.

  2. __C.DATASETS.SHAPENET.PT_CLOUD_PATH = '/home/hzxie/Datasets/ShapeNet/ShapeNetPoints/%s/%s.npy'
    Could you please provide a download link for this dataset?

Training time

Sorry to disturb you again, I am very interested in this project. I want to retrain your code, but found that it takes a long time to run 500 epochs. About how long was your training time at that time? How many GPUs are used?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.