Comments (1)
Hi @AmgadHasan,
Mistral-7B is a relatively small model that can be run on most consumer GPUs if you load it in 4-bit or 8-bit, so we think it doesn't make sense to add it to Petals (it'll work slower than if you run it locally).
Let us know if you have any other questions.
from petals.
Related Issues (20)
- Incentive system based on Lightning HOT 1
- More powerful session API HOT 1
- Issue with beam search decoding HOT 2
- Extend ServerInfo with (start_block, end_block) HOT 1
- No target modules when attempting LoRA (peft) training HOT 1
- Petals server Network ports remain open after python process shutdown HOT 1
- [might be bug?] Failed to connect to bootstrap peers when using docker image on truenas scale HOT 4
- Add YaLM-100B HOT 1
- Can petals run a quantized (use GPTQ) llama model ? HOT 3
- Unable to acquire fcntl.LOCK_SH lock when cache directory is mounted on NFS
- AttributeError: module 'numpy' has no attribute 'ndarray' HOT 5
- Support stable diffusion model HOT 2
- Available Models? HOT 1
- Add pre-commit hook
- support quivr or privateGPT? HOT 2
- whether past_key_values can be obtained HOT 1
- Pyinstaller packaged Petals binary fails to load/download on`AutoDistributedModelForCausalLM.from_pretrained`
- text to video generation models ? HOT 2
- IndexError: tuple index out of range HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from petals.