Comments (5)
For SPEC-SYN, I ended up computing the extrinsic camera matrix from 2D-3D joint correspondences.
This is the Perspective-n-Point (PnP) problem, and can be solved using cv2.solvePnP()
or cv2.calibrateCamera()
in OpenCV.
You can get 2D-3D correspondences by pairing up the common subset of joints from 'openpose_gt'
(to get the 2D points) and the SMPL joints in 3D. To get SMPL joints, you have to run forward kinematics on the SMPL body model using 'pose'
and 'shape'
, to get 3D joints. For solving PnP you also need the camera intrinsic matrix, that's given in 'cam_int'
.
The shared joints between the openpose skeleton and the SMPL skeleton are the neck, shoulders, elbows, wrists, pelvis, hips, knees and ankles. On these joints the two skeletons line up perfectly (I assume 'openpose_gt'
was created by projecting these SMPL joints to 2D, but the extrinsic matrix got lost in the process).
For SPEC-MTP, I haven't yet managed to get the 3D poses aligned with the image.
from spec.
Ignoring 'S', using 'pose', 'shape' (with the gender-neutral SMPL model, is that correct?) and 'cam_rotmat' and manually fiddling with the translation vector I managed to get an approximate overlap, but I can't seem to find how to determine the person-specific translation vector. 'cam_trans' is the same for each person in the same image.
from spec.
Sorry for bothering again. I've tried out the SPEC-MTP dataset's npz file as well, but this has fewer keys, for example 'cam_int' is not there. How can I build it from the 'focal_length'? It seems that the 'focal_length' field contains smaller numbers than I would expect, but the 'camcalib_f_pix' value is larger than expected to be the value to be used in the intrinsic matrix. In this file, I could also not find 'cam_trans'.
Would it be possible to extend the annotation file with these values?
from spec.
@isarandi
Hello, I am facing the same issue, so how did you solve this ? Thanks.
from spec.
@isarandi
I could solve the problem, thank you for your kind reply ... !!!
from spec.
Related Issues (17)
- Fix PARE requirement in requirement.txt HOT 1
- Colab notebook inaccesible
- feet fit accuracy
- get error horizon line by camcalib_demo.py
- Some questions about the training process
- There is no flickr_photo_ids.npy HOT 1
- How to create a dynamic 360-degree visualization?
- prepare_data.sh has inaccessible links HOT 1
- Can SPEC run MAON? HOT 1
- Error during single dataset evaluation HOT 1
- Segmentation fault (core dumped) HOT 2
- Can't download spec-github-data.zip HOT 2
- Camera parameters HOT 2
- Translation of the camera HOT 4
- video demo HOT 1
- Training instructions HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spec.