thu-ml / controlvideo Goto Github PK
View Code? Open in Web Editor NEWOfficial implementation for "ControlVideo: Adding Conditional Control for One Shot Text-to-Video Editing"
License: Apache License 2.0
Official implementation for "ControlVideo: Adding Conditional Control for One Shot Text-to-Video Editing"
License: Apache License 2.0
Hello, I would like to inquire about the hardware requirements to run this work.
My running environment is A40 48G, but the following error occurs when I run the sample:
RuntimeError: CUDA error: invalid configuration argument
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Hi, thanks for your great work on video editing!
However, when I use the model to change the shape of a video object, based on the canny or hed condition, the result shows that it only changes the texture rather than the geometry.
The below video shows the failure case of shape editing on the penguin, whose target prompt is "a panda".
The environment has - xformers=0.0.21.dev547+git.2cc77ae=py39_cu11.6.2_pyt1.12.1
This can't be resolved on my system. Is it perhaps fallen off the end of dev versions kept because i can't find it on conda either?
Thx for the wonderful work!
I'm wondering is that possible to add negative prompt when generating videos for better performance?
Considering the maxium length of generated video is limited by GPU memory, I tried splitting a long video into multiple segments. Even though I edit each segment with same prompt and parameters, I found hard to ensure the consistency between these generated segments. Could you give me some suggestions for long video generation?
Super cool project! I was curious about what the GPUs/vram requirements. Does this have similar requirements to Stable diffusion and control net or are the requirements much higher?
Hello, excellent work. Really liked the inversion idea. Can you suggest how can I increase the output video length for evaluation and increase fps?
Hi, awesome work!
In fact, I use a dancing video as input, and try to change hair by "+ with red hair".
However, I just get a different result in regard to identity and background (style).
Do you have any suggestion for this result?
I saw this point in the Todo list. Can you share something more about this?
Another controlvideo project code is released, when will this project release?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.