Comments (10)
We did not perform any post editing and preconditioning. The default settings (e.g. cfg=3.5, step=30) can yield similar results.
from moore-animateanyone.
We did not perform any post editing and preconditioning. The default settings (e.g. cfg=3.5, step=30) can yield similar results.
How about the other settings? I tried to replicate the example but it still has flickering
settings -W 512 -H 768 -L 120 (pose video is 30fps and 4 seconds long) --steps 30
I'm guessing the interpolation is off somewhere. How can I get just the end video the extra width may also be causing issues.
anyone-5_anyone-video-2_768x512_3_0903.mp4
from moore-animateanyone.
Could this be the reason for the flickering?
Some weights of the model checkpoint were not used when initializing UNet2DConditionModel:
['conv_norm_out.weight, conv_norm_out.bias, conv_out.weight, conv_out.bias']
from moore-animateanyone.
It seems the motion module not working. Can you check whether the motion module params are loaded correctly?
from moore-animateanyone.
How do I do that?
from moore-animateanyone.
Could this be the reason for the flickering?
Some weights of the model checkpoint were not used when initializing UNet2DConditionModel: ['conv_norm_out.weight, conv_norm_out.bias, conv_out.weight, conv_out.bias']
Encountered the same problem, have you solved it?
from moore-animateanyone.
Unfortunately not, have given up for now.
from moore-animateanyone.
Any update on this?
Unfortunately not, have given up for now.
from moore-animateanyone.
Any update on this?
Unfortunately not, have given up for now.
Sort of, the error message wasn't solved but the flickering was, I simply had a '.' in front of the motion module path in the json which meant it was not used. However now I get OOM because I use a t4 15gb card on colab.
from moore-animateanyone.
Yes colab gives a maximum of 12.7 GB system RAM to free users, however, to generate one video of length 2 sec, this module seems to consume an average of 13 GB system RAM and >14GB GPU RAM.
from moore-animateanyone.
Related Issues (20)
- RuntimeError: Trying to backward through the graph a second time
- 请问权重有百度网盘的下载链接吗?
- error occurs when set gradient_checking = True during stage 2 HOT 1
- OpenSeeFace onnx模型加载失败 HOT 2
- ModuleNotFoundError: No module named 'tracker' HOT 2
- (IDEA/REQUEST) Possible consistancy for Face Reenactment and better animation HOT 1
- stag2 erro!!!!!!!!!! how to sovle it? HOT 6
- Right now it's about 10k videos on Traing dataset
- stage2!!!!how to deal with this issues HOT 1
- Short time
- The issue of mse_loss_weights related to snr
- How does the InferenceNet interact with the denoising unet HOT 3
- 想学习AnimateAnyone快加学习交流群 HOT 4
- About the future works
- About Trainable parameters in ReferenceNet
- A confusion relating to the input range of VAE model HOT 1
- What is `attn_weight` for? I don't see `attn_weight` being used anywhere else
- 多节点运行训练代码
- ZeRO3 vs ZeRO2 Memory Comparison HOT 1
- inference效果
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from moore-animateanyone.