Giter VIP home page Giter VIP logo

Comments (5)

Marianoeli avatar Marianoeli commented on May 18, 2024

I also encountered this problem, is there anything need to pay attention to?

from econ.

YuliangXiu avatar YuliangXiu commented on May 18, 2024

I have discussed this failure case in ECON's paper. This issue mainly comes from off-the-shelf HPS (Human Pose & Shape Estimation), which were trained on pseudo 3D ground truth, have bias towards mean pose, or to say, the bent legs / arms.

Apart from replacing the HPS approach with one trained on synthetic data with REAL grond-truth data, another workaround is to re-posed the reconstruction with pre-defined SMPL-X T-Pose parameters as follows:

  1. change the avatarizer.py#L168

from

new_pose = smpl_out_lst[2].full_pose

to

new_pose = smpl_out_lst[0].full_pose
  1. repose the ECON's reconstruction
python -m apps.avatarizer -n {filename}

from econ.

Yuanhong200727 avatar Yuanhong200727 commented on May 18, 2024

Thank you so much,I will try it!

from econ.

Yuanhong200727 avatar Yuanhong200727 commented on May 18, 2024

@YuliangXiu For some reason,I don't want to use the visible face from SMPL-X.But when I set ["hand"] or [] in config/econ.yaml and ran python -m apps.avatarizer -n {filename} (I had changed smpl_out_lst[2] to smpl_out_lst[0]),the output file {filename}_econ_pose.obj was wrong.It was only about 400KB and I coudn't open it.But the {filename}_econ_da.obj was normal.
Is this a normal phenomenon?How can I solve the problem.Is there any way that after running avatarizer.py,my hands are from SMPL-X and my face is actually mine.Thanks!

from econ.

YuliangXiu avatar YuliangXiu commented on May 18, 2024

@YuliangXiu For some reason,I don't want to use the visible face from SMPL-X.But when I set ["hand"] or [] in config/econ.yaml and ran python -m apps.avatarizer -n {filename} (I had changed smpl_out_lst[2] to smpl_out_lst[0]),the output file {filename}_econ_pose.obj was wrong.It was only about 400KB and I coudn't open it.But the {filename}_econ_da.obj was normal. Is this a normal phenomenon?How can I solve the problem.Is there any way that after running avatarizer.py,my hands are from SMPL-X and my face is actually mine.Thanks!

I just updated the code to fix this bug.

from econ.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.