Comments (4)
Hi @wnzhyee , it's a bit weird. Could you please check if it is because the rgb format? The color should affect the results as the pose info is injected through the image. It would be better if you could keep the pose color consistent to the demo.
from disco.
@Wangt-CN I changed the rgb format and result is correct, thanks a lot!
from disco.
Hi @wnzhyee ,
- Could you please check if there is the
.json
output for the openpose pre-process? Then you may refer to this code for achieving the pose image (https://github.com/Wangt-CN/DisCo/blob/main/dataset/tiktok_controlnet_t2i_imagevar_combine_mask.py#L218). - Yes, you need to crop and resize.
BTW, current model may get inferior results if the person is too small (issue from the original SD). And we will update a new model soon if you wanna to perform body change for the full human body.
from disco.
thanks for your reply! I'm still a little confused about the pose image generation. Now i try the demo image 00035.png with pose image, and i draw the skeleton with coco2openpose
and draw_bodypose
from tiktok_controlnet_t2i_imagevar_combine_mask.py, but the skeleton colors are not exactly same. Is this ok for pose encoder if the color order changed?
MINE(create with demo_data/bg/images/00035.png):
from disco.
Related Issues (20)
- Model checkpoint for temporal module
- Question about the multi-gpu running: 'mpirun -np ...' HOT 7
- Hope for more instruction about the multiple GPU running
- Error when mpirun -np 3? HOT 2
- how to caculate fvd metrics? HOT 1
- Where can I get the 10K tiktok style test split?
- Questions about image size
- [BUG] a bug in the dataset/tiktok_video_dataset.py
- How can I get "More TikTok-Style Training Data" please? HOT 1
- the code for computing PSNR is wrong HOT 4
- None
- huggingface demo broken HOT 1
- How were these files generated? For validation and training.
- jax and jaxlib latest version problem
- None
- Jimmy HOT 1
- How to use DeepSpeed for multi-GPU training instead of using mpirun?
- Is the TikTok dataset you provide the MoreTikTok dataset?
- 能不能提供多机多卡的运行脚本
- drop_pose_ratio is not defined (temporal module finetuning)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from disco.