Can I use the finetuned model on stable-diffusion-webui? about custom-diffusion HOT 4 OPEN

Hi,
I have updated our repo to allow checkpoint conversion from diffuser to stable-diffusion-webui as explained here or by running the below commands.

python src/convert.py --delta_ckpt <path-to-folder>/delta.bin --ckpt <path-to-model-v1-4.ckpt> --mode diffuser-to-webui                  
# launch UI in stable-diffusion-webui directory
bash webui.sh --embeddings-dir <path-to-folder>/webui/embeddings  --ckpt <path-to-folder>/webui/model.ckpt

Currently the code only supports the stable-diffusion-v1-4 model. Also stable-diffusion-webui doesn't support loading embedding dynamically in the UI, thus it requires launching the UI with a specific model.

from custom-diffusion.

After using the commands you provided, I successfully got a .ckpt file and a .pt file. But when I use them to generate image, I can only get images like the below.

I don't know how to solve it.

from custom-diffusion.

Sorry, I introduced a bug in the conversion code in the last commit. It should work now.
Thanks for pointing this out!!

Also, I noticed that stable-diffusion-webui loads the default model in case of name conflict and --ckpt path not being in the default directory. I have introduced --modelname argument which is used to save the .ckpt file as modelname.ckpt.

Let me know if this works for you now.

from custom-diffusion.

It works well now, thanks.

from custom-diffusion.