Giter VIP home page Giter VIP logo

lora-inference's Introduction

LoRA Replicate inference model

Run inference on Replicate:

Replicate

Training models:

  • Easy-to-use model pre-configured for faces, objects, and styles: Replicate
  • Advanced model with all the parameters: Replicate

If you have questions or ideas, please join the #lora channel in the Replicate Discord.

Deployments

You can deploy any models at huggingface or ones you trained yourself. You can add LoRA with these models

1. Manual deployment

We have a default SD1.5 deployed at replicate, so you can run your own in a scalable manner. If you would like to launch your own model, run

cog run script/download-weights.py

to download the weights and place them in the cache directory. This will save base model that will get mounted to the cog container.

Either push the model to replicate (follow these instructions for pushing model to replicate) or run

cog predict -i prompt="monkey scuba diving"

to run locally.

2. Deploy & Push to replicate with bash script

First, make a model at replicate.com. Create one here

Specify the following parameter file at deploy_others.sh file.

export MODEL_ID="lambdalabs/dreambooth-avatar" # change this to model at huggingface or your local repository.
export SAFETY_MODEL_ID="CompVis/stable-diffusion-safety-checker"
export IS_FP16=1
export USERNAME="cloneofsimo" # change this to your replicate ID.
export REPLICATE_MODEL_ID="avatar" #replciate model ID,

Run it with

bash deploy_others.sh

lora-inference's People

Contributors

andreasjansson avatar cloneofsimo avatar pskl avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.