thu-ml / controlvideo Goto Github PK

I run "python main.py" but there is only txt files in the ./outputs/car10-a red car .Where can I find the output video?

Hello, I would like to inquire about the hardware requirements to run this work.
My running environment is A40 48G, but the following error occurs when I run the sample:

RuntimeError: CUDA error: invalid configuration argument
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1.

Hi, thanks for your great work on video editing!

However, when I use the model to change the shape of a video object, based on the canny or hed condition, the result shows that it only changes the texture rather than the geometry.

The below video shows the failure case of shape editing on the penguin, whose target prompt is "a panda".

The environment has - xformers=0.0.21.dev547+git.2cc77ae=py39_cu11.6.2_pyt1.12.1
This can't be resolved on my system. Is it perhaps fallen off the end of dev versions kept because i can't find it on conda either?

Thx for the wonderful work!

I'm wondering is that possible to add negative prompt when generating videos for better performance?

Considering the maxium length of generated video is limited by GPU memory, I tried splitting a long video into multiple segments. Even though I edit each segment with same prompt and parameters, I found hard to ensure the consistency between these generated segments. Could you give me some suggestions for long video generation?

Super cool project! I was curious about what the GPUs/vram requirements. Does this have similar requirements to Stable diffusion and control net or are the requirements much higher?

Hello, excellent work. Really liked the inversion idea. Can you suggest how can I increase the output video length for evaluation and increase fps?

Hi, awesome work!

In fact, I use a dancing video as input, and try to change hair by "+ with red hair".
However, I just get a different result in regard to identity and background (style).
Do you have any suggestion for this result?

I saw this point in the Todo list. Can you share something more about this?

Another controlvideo project code is released, when will this project release?