Comments (5)
A similar follow-up question, what is the function of the scale matrix? is the K-matrix already scaled?
from differentiable_volumetric_rendering.
Hi @jay-thakur, @rodrigodzf , thanks a lot for your interest in the project! In think both questions are pointing at what the matrices are, here my explanations:
world_mat: This is the extrinsics 4x4 matrix, often referred to as "Rt". When applying this matrix to a point, you transform this point from world space to camera space.
camera_mat: This is the intrinsics 4x4 matrix, often referred to as "K". The only special thing we do is that we define the final pixel coordinates to be in the interval [-1, 1]. In contrast, the ordinary definition is to have pixel values in [0, W] and [0, H], where (H, W) are the image dimensions. (We use this special definition because we think it fits better the Pytorch framework.)
scale_mat: We introduce this additional 4x4 matrix for the case when the objects are not centred at the world origin and not in the unit cube. This matrix transforms a 3D point from the "object-centric" space where the object is centred at the origin and in the unit cube to the original world space. You can see that this matrix is just the identity for e.g. the ShapeNet datasets. We only use this matrix for the DTU dataset, where objects are not centred. Have a look at this closed issue for more information.
from differentiable_volumetric_rendering.
Thank you for the explanation! As suggested in the other closed issue, maybe would be good idea to put this information in the readme since I imagine others will have the same question in the future
from differentiable_volumetric_rendering.
Thanks for the feedback @rodrigodzf , I will try to do it soon!
from differentiable_volumetric_rendering.
Hi @m-niemeyer ,
I have my own 3D model. Below is my viewpoints for 3D model using open3d library.
{
"class_name" : "PinholeCameraParameters",
"extrinsic" :
[
1.0,
-0.0,
-0.0,
0.0,
0.0,
-1.0,
-0.0,
0.0,
0.0,
-0.0,
-1.0,
0.0,
-0.0,
-0.061849594116210938,
117.97353744733314,
1.0
],
"intrinsic" :
{
"height" : 1050,
"intrinsic_matrix" :
[
909.3266739736606,
0.0,
0.0,
0.0,
909.3266739736606,
0.0,
959.5,
524.5,
1.0
],
"width" : 1920
},
"version_major" : 1,
"version_minor" : 0
}
How to rescale camera_mat and world_mat for 64*64 size projection?
I hope you got my question.
Thanks,
Jay
from differentiable_volumetric_rendering.
Related Issues (20)
- check_ray_intersection_with_unit_cube HOT 1
- How to prepare data for the model? HOT 3
- create dataset.
- Is it possible to have a scene-general model for multi-view reconstruction? HOT 1
- p_freespace in get_freespace_loss_points() and p_occupancy in get_occupancy_loss_points()?
- Why is the focal length different in your rendering and img_choy2016? HOT 4
- How to evaluate the chamfer distance for the DTU dataset? HOT 1
- Evaluation scores very low HOT 1
- Scale of point clouds in DTU datasets? HOT 1
- Test in ShapeNet with multi-view inputs
- check_ray_intersection_with_unit_cube bottlenecking CPU HOT 2
- Normalize ray_vector?
- A question about the 3.2Section of the paper HOT 1
- How to generate cameras.npz and pcl.npz for custom datasets? HOT 1
- download the data.
- Error generating mesh jpg when run demo
- Error in setup.py HOT 1
- size mismatch for decoder
- Where to download the pretrained models?
- How to get gif like your readme from a ply file? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from differentiable_volumetric_rendering.