8bit adam does not work on Windows. about sd_dreambooth_extension HOT 12 CLOSED

There's this writeup/tutorial here to use windows binaries of these libraries without resorting to WSL:
https://gist.github.com/geocine/e51fcc8511c91e4e3b257a0ebee938d0
maybe something similar can be done for this extension?

from sd_dreambooth_extension.

There's this writeup/tutorial here to use windows binaries of these libraries without resorting to WSL: https://gist.github.com/geocine/e51fcc8511c91e4e3b257a0ebee938d0 maybe something similar can be done for this extension?

Yes, theoretically, this wouldn't be too hard to schlep into the install.py script with a check for the OS. I'll see what time I have to tinker with this today. I don't particularly need 8bit adam, but happy to include it for those that want it.

from sd_dreambooth_extension.

I've now added a bit to the installer that checks if running on windows, and if so, checks for the .dll file specified in the gist. If they're not found, they will be copied to venv, similar to the other script.

159a336

from sd_dreambooth_extension.

ok. I'll test this. Last time I did this manually and it couldn't import cudasetup in the cextensions py though.
I'll have to test tomorrow though since it's 2am here

from sd_dreambooth_extension.

I think the dlls only work for pytorch+cu116, and by default you will get pytorch+cu113 when installing webui. Manual upgrading might be required.
I am looking for a way to compile these dlls, but I know nothing about Windows, or marchine learning pipelines or tools in the first place. Can we check if these dlls are safe?

from sd_dreambooth_extension.

I think the dlls only work for pytorch+cu116, and by default you will get pytorch+cu113 when installing webui. Manual upgrading might be required. I am looking for a way to compile these dlls, but I know nothing about Windows, or marchine learning pipelines or tools in the first place. Can we check if these dlls are safe?

I can force it to install specific version of pytorch with the extension - we just need to confirm that updating to cu116 won't break anything else.

from sd_dreambooth_extension.

I think the dlls only work for pytorch+cu116, and by default you will get pytorch+cu113 when installing webui. Manual upgrading might be required. I am looking for a way to compile these dlls, but I know nothing about Windows, or marchine learning pipelines or tools in the first place. Can we check if these dlls are safe?

I can force it to install specific version of pytorch with the extension - we just need to confirm that updating to cu116 won't break anything else.

I did the upgrade and haven't notice anything broken. Further tests needed.

from sd_dreambooth_extension.

But it is still better if we can let the users compile their own versions of these dlls, for any cuda version they have installed.

from sd_dreambooth_extension.

But it is still better if we can let the users compile their own versions of these dlls, for any cuda version they have installed.

Well, the one used natively by SD is cu113, so I think I'd rather precompile and distribute as many versions as possible, then select based on the right CUDA toolkit. Building is probably going to take some backflips, which is why I'm not leaning that way.

from sd_dreambooth_extension.

I'm going to close this and link it up with #7, as they're the same issue.

from sd_dreambooth_extension.

Bitsandbytes was not supported windows before, but my method can support windows.（yuhuang）
1 open folder J:\StableDiffusion\sdwebui，Click the address bar of the folder and enter CMD
or WIN+R, CMD 。enter，cd /d J:\StableDiffusion\sdwebui
2 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes

3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows

4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl

Replace your SD venv directory file（python.exe Folder） here（J:\StableDiffusion\sdwebui\py310）

from sd_dreambooth_extension.

OR you are Linux distribution (Ubuntu, MacOS, etc.)system ,AND CUDA Version: 11.X.

Bitsandbytes can support ubuntu.（yuhuang）
1 open folder J:\StableDiffusion\sdwebui，Click the address bar of the folder and enter CMD
or WIN+R, CMD 。enter，cd /d J:\StableDiffusion\sdwebui
2 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes

3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows

4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https://github.com/TimDettmers/bitsandbytes/releases/download/0.41.0/bitsandbytes-0.41.0-py3-none-any.whl

Replace your SD venv directory file（python.exe Folder） here（J:\StableDiffusion\sdwebui\py310）

from sd_dreambooth_extension.