Giter VIP home page Giter VIP logo

Comments (8)

MoonRide303 avatar MoonRide303 commented on June 20, 2024 2

@xy185 Fooocus was designed as UI exclusively for SDXL, so I think it just refused to load non-SDXL model you've selected, and image was probably generated using last SDXL model you've picked. You can check the log file (log.html in output folder) to see what model was used to generate particular image.

from fooocus-mre.

MoonRide303 avatar MoonRide303 commented on June 20, 2024 2

Theoretically it could be possible to support SD (comfy backend used by Fooocus supports SD models), but it would complicate the UI - older SD models works best using 512x512 (1.5) or 768x768 (2.1) as base resolutions, for example. So... while I still enjoy and sometime use older SD models, for now I'd rather focus on main purpose of Fooocus, that is being solid UI for the SDXL.

And as for anime fairies in Fooocus - you can try sai-anime style, and SDXL variants trained on anime, like CounterfeitXL :).
image

from fooocus-mre.

getofferhelp avatar getofferhelp commented on June 20, 2024 1

Theoretically it could be possible to support SD (comfy backend used by Fooocus supports SD models), but it would complicate the UI - older SD models works best using 512x512 (1.5) or 768x768 (2.1) as base resolutions, for example. So... while I still enjoy and sometime use older SD models, for now I'd rather focus on main purpose of Fooocus, that is being solid UI for the SDXL.

And as for anime fairies in Fooocus - you can try sai-anime style, and SDXL variants trained on anime, like CounterfeitXL :). image

@MoonRide303 Thanks so much for your reply!
I was not so familiar with XL, thanks for your kindly guide, and I would try the style and new model,

Finallly, thanks for your great work: Fooocus-MRE, it's perfect!

from fooocus-mre.

MoonRide303 avatar MoonRide303 commented on June 20, 2024 1

Limited support for SD models added in v2.0.78.3 (commit 6d47547).

Test image generated using DreamShaper 8:
image

Not supported functions: refiner, Control-LoRAs, Revision, inpainting, outpainting. You need to manually pick compatible resolution and LoRAs, too.

from fooocus-mre.

MoonRide303 avatar MoonRide303 commented on June 20, 2024 1

@Aamir3d Yup. Inpainting in Fooocus is based on supplementary model designed for SDXL (custom type of LoRA) - there is no easy way to make it work with non-SDXL models. Inpainting with SD in general is doable (using dedicated inpainting models), but I would need to change current workflow quite a bit to make it work. Image-2-Image should work fine.

from fooocus-mre.

Aamir3d avatar Aamir3d commented on June 20, 2024

One of the reasons to have a 1.5 model support is the speed of generation and resource consumption. SDXL doesn't play very well with systems that have 4/6GB VRAM and 16GB RAM.

For example, I can generate an image at 768 x something in A1111 in less than 10 seconds using only 4 GB of VRAM in a laptop GPU.
For SDXL, the same generation (1024+ res) in my laptop GPU takes over 2 minutes because of memory requirements with Fooocus-MRE (tried this just now).

It's a different matter on my desktop, where I've got a 12GB GPU and 32 GB RAM, SDXL is much better in that scenario.

from fooocus-mre.

MoonRide303 avatar MoonRide303 commented on June 20, 2024

@Aamir3d Yeah, that's true - SDXL isn't really usable on GPUs below 8 GB VRAM.

from fooocus-mre.

Aamir3d avatar Aamir3d commented on June 20, 2024

Thank you @MoonRide303 ! So, image2image will still work, but not inpaint?

from fooocus-mre.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.