Comments (22)
it's seems to be a problem with the vae AUTOMATIC1111/stable-diffusion-webui#6858
from sd-cn-animation.
There's a little bit of flicker but with the davinci resolve deflicker it's fix the problem :)
from sd-cn-animation.
No. You don't need to install raft in automatic1111. It should hook up the 'RAFT' repository when you clone 'SD-CN-Animation'. If it didn't happen for some reason, go to the 'SD-CN-Animation' folder, open CLI and do 'git clone https://github.com/princeton-vl/RAFT.git' command. It should create 'RAFT' folder with all the necessary scripts and it should work fine afterwards.
from sd-cn-animation.
Thanks for raft it's works, but I have another problem when I run the script it's open a window that quickly close and I have just this message in the command : 0it [00:00, ?it/s]
from sd-cn-animation.
in the script I need to write the format like that ? :
INPUT_VIDEO = "C:\AUTOMATIC1111\INPUTVIDEO\1.mp4"
OUTPUT_VIDEO = "C:\AUTOMATIC1111\OUTPUTVIDEO\1.mp4"
from sd-cn-animation.
Yeah. The format seems fine to me. I suspect It cannot find video file for some reason. Try to move it in 'SD-CN-Animation' folder and set INPUT_VIDEO = "1.mp4". Also make sure that the video is working in any videoplayer.
from sd-cn-animation.
Ok it launched everything and after generate the first picture I have a error :
OpenCV: FFMPEG: tag 0x5634504d/'MP4V' is not supported with codec id 12 and format 'mp4 / MP4 (MPEG-4 Part 14)'
OpenCV: FFMPEG: fallback to use tag 0x7634706d/'mp4v'
1%|▋ | 1/117 [00:08<16:53, 8.74s/it]
Traceback (most recent call last):
File "C:\AUTOMATIC1111\SD-CN-Animation\script.py", line 234, in
_, alpha_mask, warped_styled = RAFT_estimate_flow_diff(prev_frame, frame, prev_frame_styled)
File "C:\AUTOMATIC1111\SD-CN-Animation\script.py", line 100, in RAFT_estimate_flow_diff
RAFT_model.load_state_dict(torch.load(args.model))
File "C:\Users\Alex\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\serialization.py", line 699, in load
with _open_file_like(f, 'rb') as opened_file:
File "C:\Users\Alex\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\serialization.py", line 230, in _open_file_like
return _open_file(name_or_buffer, mode)
File "C:\Users\Alex\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\serialization.py", line 211, in init
super(_open_file, self).init(open(name, mode))
FileNotFoundError: [Errno 2] No such file or directory: 'RAFT/models/raft-things.pth'
It's the video format not supported ?
from sd-cn-animation.
Nope, It cannot find the 'raft-things.pth' model. I forget to mention it in the instruction, you have to set up the RAFT repository as it described here: https://github.com/princeton-vl/RAFT
Basically it just comes down to running "./download_models.sh" to download the models. I would suggest not to creating a special conda environment, but choose what is more convenient for you.
from sd-cn-animation.
it's works ! but the picture become blurry and dark after few minutes here the first pictures :
from sd-cn-animation.
Also it's generate the video but I have a error message display in the cmd of automatic1111 : Error running process: C:\AUTOMATIC1111\extensions\sd-webui-controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "C:\AUTOMATIC1111\modules\scripts.py", line 417, in process
script.process(p, *script_args)
File "C:\AUTOMATIC1111\extensions\sd-webui-controlnet\scripts\controlnet.py", line 628, in process
unit = self.parse_remote_call(p, unit, idx)
from sd-cn-animation.
Do you know why it's become more and more darker after each render here another example :
from sd-cn-animation.
Im really impress by the result your script is clearly awesome I can't wait to have fixed the darker images bug
from sd-cn-animation.
Cannot say anything regarded the web-ui error, but it might be related to the darkening as I never experienced it myself while working on the script.
from sd-cn-animation.
every render it's write :
Error running process: C:\AUTOMATIC1111\extensions\sd-webui-controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "C:\AUTOMATIC1111\modules\scripts.py", line 417, in process
script.process(p, *script_args)
File "C:\AUTOMATIC1111\extensions\sd-webui-controlnet\scripts\controlnet.py", line 628, in process
unit = self.parse_remote_call(p, unit, idx)
File "C:\AUTOMATIC1111\extensions\sd-webui-controlnet\scripts\controlnet.py", line 540, in parse_remote_call
unit.enabled = selector(p, "control_net_enabled", unit.enabled, idx, strict=True)
AttributeError: 'str' object has no attribute 'enabled'
I found someone else have the same error message : AUTOMATIC1111/stable-diffusion-webui#9107
from sd-cn-animation.
Did you made ControlNet accessible through API in the settings?
from sd-cn-animation.
from sd-cn-animation.
Ok. It seems like a bug in web-ui. You can do the following: go to modules/api/api.py in web-ui and replace this string (it should be at 275 line)
script_args[alwayson_script.args_from:alwayson_script.args_to] = request.alwayson_scripts[alwayson_script_name]["args"]
with this:
for idx in range(0, min((alwayson_script.args_to - alwayson_script.args_from), len(request.alwayson_scripts[alwayson_script_name]["args"]))):
script_args[alwayson_script.args_from + idx] = request.alwayson_scripts[alwayson_script_name]["args"][idx]
Please tell me if it's helped.
from sd-cn-animation.
Thanks it's fixed the webui error message ! but I have always the picture become more and more darker there's another message in the cmd of the script :
from sd-cn-animation.
Just a warning, you can ignore it. No idea why it is darkening though.
from sd-cn-animation.
It's very frustrating your script have a awesome temporal consistency I really want to use it
from sd-cn-animation.
Im forced to add "--no-half-vae" for generate the video maybe it's because of that ?
from sd-cn-animation.
It solved the problem I have downloaded the vae for the checkpoint I use, Thanks you for the helps !
from sd-cn-animation.
Related Issues (20)
- An exception occurred while trying to process the frame: unsupported operand type(s) for +: 'int' and 'NoneType' HOT 1
- IS THERE A PLACE TO UPLOAD STRICTLY SD-CN ANIMATION? HOT 2
- ControlNet no longer working HOT 11
- Previous Image Quality severely dropped on fully processed image
- FileNotFoundError HOT 1
- An exception occurred while trying to process the frame: HTTP Error 503: Service Unavailable HOT 1
- SD-CN-Animation base_ui.py error
- No such file or directory: C:\Users\<name>\.cache\torch\hub\checkpoints\models\FloweR\... HOT 2
- [BUG]: it's "skimage" NOT "scikit-image" !!! HOT 1
- Does not work with sdxl
- A Gallery of Sorts? HOT 1
- This error keeps popping after a few renders: 2023-10-24 09:27:13 INFO [httpx] HTTP Request: POST http://localhost:7860/reset "HTTP/1.1 200 OK" HTTP Request: POST http://localhost:7860/reset "HTTP/1.1 200 OK"
- SD-CN causing "No ControlNetUnit detected in args" ERROR HOT 4
- [BUG] Error when Generating HOT 6
- Output is all messed up
- Notice: extension is incompatible with webui 1.8, pending removel form extension index HOT 5
- No module named 'basicsr' HOT 1
- No module named 'basicsr
- txt2vid doesn't work at all HOT 3
- Text to video not working for me
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sd-cn-animation.