Comments (11)
Sorry guys, I'm quite occupied these days. If you are really in a hurry to test, try to rename your character like examples (including std_bvhs and mean_var), replace one of the "paired" bvh with an arbitrary bvh with the same length as the other. It should work.
Hi guys, thanks for publishing this project, I'm actually really excited about it! :)
I read the paper and had a look at the code but I've still got a few questions though:
-
Is there any followup on this particular issue "retargeting to a custom character" (a script or anything)?
-
Could you explain this to me please?
Following line in demo.py
example('Aj', 'BigVegas', 'Dancing Running Man.bvh', 'intra', './examples/intra_structure')
gives me this character [['Aj', 'BigVegas'], ['Goblin_m', 'Goblin_m']] in eval_single_pair.py.
If I understand correctly this means the Aj-skeleton is retargeted to the BigVegas-skeleton with the motion being the 'Dancing Running Man'. But what is the Goblin_m for? -
What I'm currently trying to do is retarget a random Mixamo character (skeleton and motion) from the demo dataset to a custom humanoid skeleton.
I tried the approach you mentioned above with renaming my custom character like in the examples, my character now being "Kaya":
example('Big Vegas', 'Kaya', 'Baseball Pitching.bvh', 'intra', './examples/intra_structure')
But it throws following error incombined_motion.py line 158
:
RuntimeError: Sizes of tensors must match except in dimension 0. Got 91 and 83 in dimension 1 (The offending index is 1)
I'm not sure if the problem is the length of the bvh file that you mentioned., If so, could you please explain which bvh files need to be the same length (the input and the result bvhs?) and how to actually adjust them?
Looking forward to your answer, thank you very very much!!
from deep-motion-editing.
Thanks for your response, so which script to use so as to give as an input only a bvh file and then just select the character that we want to retarget to?
from deep-motion-editing.
One more: how can we make an inference given the source(input character) .bvh file and choose only the destination character that we want to retarget to? As seen in the demo (same animation bvh file exists to both input and destination character), is it necessary to have the same animation's bvh file for the destination character as well?
from deep-motion-editing.
-
Ideally it's possible. But if there is a big difference in T-pose or animation style, as reported in our paper, it could fail. To train it, prepare your own npy file following the instructions and change the character's name in datasets/init.py
-
It's just for comparison raison. Paired bvh is not necessary.
from deep-motion-editing.
Haha, that's a good question. We doesn't have one for customized data. You can try to tweak eval_single_pair.py or I'll write a script for that, ideally tomorrow.
from deep-motion-editing.
I am really looking forward to see that script :)
from deep-motion-editing.
i also have the same question!
from deep-motion-editing.
Sorry guys, I'm quite occupied these days. If you are really in a hurry to test, try to rename your character like examples (including std_bvhs and mean_var), replace one of the "paired" bvh with an arbitrary bvh with the same length as the other. It should work.
from deep-motion-editing.
Thank you for the update Peizhuo! Will check this way and if that attempt fails, then whenever you have time and upload that script we will give it a look.
from deep-motion-editing.
@rainer7 @PeizhuoLi Didya find a solution? I'm getting the similar shape mismatch error. Following the same routine as @rainer7. Error below:
File "eval_single_pair.py", line 78, in main
model.load(epoch=20000)
File "/path/deep-motion-editing/retargeting/models/architecture.py", line 288, in load
model.load(os.path.join(self.model_save_dir, 'topology{}'.format(i)), epoch)
File "/path/Retarget-Motion/deep-motion-editing/retargeting/models/integrated.py", line 82, in load
self.auto_encoder.load_state_dict(torch.load(os.path.join(path, 'auto_encoder.pt'),
File "/path/envs/lib/python3.8/site-packages/torch/nn/modules/module.py", line 2041, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for AE:
size mismatch for enc.layers.0.0.mask: copying a param with shape torch.Size([184, 92, 15]) from checkpoint, the shape in current model is torch.Size([192, 96, 15]).
size mismatch for enc.layers.0.0.weight: copying a param with shape torch.Size([184, 92, 15]) from checkpoint, the shape in current model is torch.Size([192, 96, 15]).
from deep-motion-editing.
@npapargyr What do you mean by arbitrary length? Same quesiton as by @rainer7
from deep-motion-editing.
Related Issues (20)
- 代码与原论文有所出入 HOT 3
- How the the skining work? HOT 1
- 处理过手指的重定向吗? HOT 3
- Retargeting retraining on customized dataset HOT 3
- 非标准躯干数据集的可能性 HOT 8
- Use a new dataset in style transfer HOT 1
- 使用额外bvh文件进行retargeting HOT 6
- style transfer任务的pretrained模型和提供config不符
- BVH_mod HOT 1
- Error in forward kinematics HOT 2
- 请问作者有没有尝试过面向3d坐标的异构重定向?
- Error: No module named 'option_parser'
- Error: No module named 'datasets'
- Error: No such file or directory: './datasets/Mixamo/Malcolm_m.npy'
- 使用新骨架进行重定向后,出现模型维度不匹配的问题 HOT 1
- 您好,我现在面临在经过Preprocessing处理之后,在训练的时候数据打开verbose选项,看到数据都是Nan,请问这可能是什么原因造成的呢 HOT 1
- the src.bvh and dst.bvh must be the same Skeletal hierarchy ?
- retarget a bvh file to use it in style transfer HOT 1
- What is the equivalent for batch overfitting for such a training scheme?
- 关于其它bvh文件retargeting的几个问题?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from deep-motion-editing.