Comments (1)
Hi, the axolotl support matrix suggests partial support for the phi
family and they have an example config file for phi-2
. We don't know of any reasons why you couldn't use that example to do some finetuning on modal using the code here, but let us know if you run into problems (we're usually a bit faster to respond on slack).
from llm-finetuning.
Related Issues (19)
- Loop attempt failed and parallelism errors HOT 1
- Why add special tokens manually in sql_dataset.py HOT 1
- [issue] train.py HOT 1
- Quickstart errors following README with sample data HOT 1
- volume.commit() dosen't work HOT 1
- how to download the finetuned model of the moda networkfilesystem to local? HOT 2
- [bug] inference.py mkdir HOT 1
- Can I use train.py on CodeLlama-13b or CodeLlama-34b HOT 4
- getting TypeError while launching the training job HOT 1
- TODO: hamel to explore GUIs HOT 1
- Proposal: Get Rid of Gradio Interface HOT 1
- Weights & Bias integration HOT 1
- Do not hardcode LORA merging
- Audience For This Repo HOT 3
- Help Needed: Fine-tuning codellama-7b-Instruct Model for pinescript Programming language HOT 1
- Red lines for `download_and_unload_peft` HOT 2
- Can the code in this repository be used with my own local GPUs? HOT 1
- error downloading Mistral 7B Instruct when running in inference HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llm-finetuning.