Comments (5)
using the https://github.com/intel-isl/Open3D/blob/master/examples/python/Basic/rgbd_image.ipynb, i visualize the depth maps.
the result for 000020.jpg with different angles is attached below.
original image
point cloud with angle 1
this is the point cloud
https://drive.google.com/file/d/13LZMxohl3a0IdkJvw5c3bUMcVne6hRY1/view?usp=sharing
the above point cloud file can be view with https://www.creators3d.com/online-viewer
from differentiable_volumetric_rendering.
Hi @tharinduk90 , I was now able to have a look at your data.
The depth you provide is very noisy / not accurate. The problem with your visualization above is that you only show the predicted points if you use a single image, and also you show it from the same view as shown in the image. Then, it will always look good! The question is rather how well does the point cloud look if you use all the views, and project them all into the world.
Here is a screenshot of the point cloud if you use all 22 views:
And here the respective ply file (zipped).
As you can see, the depth is so noisy that it does not lead to a consistent model. Hence, if you train with this depth information, it will rather worsen the results than improve them. If you want to improve your results, a good tool to obtain camera parameters as well as depth maps for multi-view images is Colmap.
Good luck with your research !
from differentiable_volumetric_rendering.
@m-niemeyer , thank you very much for the clarification, can u share the script to create the point cloud ? So i can verify my depth map?
from differentiable_volumetric_rendering.
Hi @tharinduk90 , thanks a lot for your message.
I have now created a FAQ file describing the camera matrices and also an example script of how pixels can be projected to the object-centric world space using the matrices and depth values: https://github.com/autonomousvision/differentiable_volumetric_rendering/blob/master/project_pixels_to_world_example.py
I hope this helps. Good luck!
from differentiable_volumetric_rendering.
@m-niemeyer , thank you very much !!!!!!!!!!!!!!
from differentiable_volumetric_rendering.
Related Issues (20)
- check_ray_intersection_with_unit_cube HOT 1
- How to prepare data for the model? HOT 3
- create dataset.
- Is it possible to have a scene-general model for multi-view reconstruction? HOT 1
- p_freespace in get_freespace_loss_points() and p_occupancy in get_occupancy_loss_points()?
- Why is the focal length different in your rendering and img_choy2016? HOT 4
- How to evaluate the chamfer distance for the DTU dataset? HOT 1
- Evaluation scores very low HOT 1
- Scale of point clouds in DTU datasets? HOT 1
- Test in ShapeNet with multi-view inputs
- check_ray_intersection_with_unit_cube bottlenecking CPU HOT 2
- Normalize ray_vector?
- A question about the 3.2Section of the paper HOT 1
- How to generate cameras.npz and pcl.npz for custom datasets? HOT 1
- download the data.
- Error generating mesh jpg when run demo
- Error in setup.py HOT 1
- size mismatch for decoder
- Where to download the pretrained models?
- How to get gif like your readme from a ply file? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from differentiable_volumetric_rendering.