Giter VIP home page Giter VIP logo

terry / chatgpt-fine-tuning Goto Github PK

View Code? Open in Web Editor NEW

This project forked from yuyou-dev/chatgpt-fine-tuning

0.0 1.0 0.0 1.31 MB

Quick-start guide to fine-tuning ChatGPT using Python. Includes scripts for data preprocessing, model training, and evaluation. 快速入门指南: 使用Python微调ChatGPT。包含数据预处理、模型训练和评估脚本。

License: MIT License

Python 3.87% Jupyter Notebook 96.13%

chatgpt-fine-tuning's Introduction

ChatGPT-Fine-tuning / ChatGPT微调指南

Quick-start guide to fine-tuning ChatGPT using Python. Includes scripts for data preprocessing, model training, and evaluation.

快速入门指南: 使用Python微调ChatGPT。包含数据预处理、模型训练和评估脚本。

Project Structure / 项目结构

chatgpt-finetuning/
│
├── data/
│   ├── raw/
│   │   ├── training_data.txt
│   │   └── validation_data.txt
│   └── processed/
│       └── ...
│
├── scripts/
│   ├── preprocess_data.py
│   ├── upload_data.py
│   └── finetuning.py
│
├── notebooks/
│   ├── fine-tuning.ipynb
│   ├── fine-tuning-format.ipynb
│   ├── fine-tuning-format-comparison.ipynb
│   └── 视频解说.ipynb
│
├── README.md
└── requirements.txt

Getting Started / 开始

  1. Clone the Repository / 克隆仓库:
git clone https://github.com/yuyou-dev/chatgpt-fine-tuning.git
cd chatgpt-fine-tuning
  1. Install Dependencies / 安装依赖:
pip install -r requirements.txt
  1. Fine-tuning the Model / 微调模型:

Navigate to the scripts/ directory and run the script to preprocess data:

Preprocess Data / 预处理数据

python3 preprocess_data.py

Upload Data / 上传数据

Run the upload script:

python3 upload_data.py

Fine-tuning / 微调训练

Run the fine-tuning script:

python3 finetuning.py

Running Tests / 验证和测试

Run API test on PlayGround

Colab 微调

其他GPT技术

Contributing / 贡献

We welcome contributions! Please open an issue or submit a pull request on GitHub. 我们欢迎各种贡献!请在GitHub上开启一个问题(issue)或提交一个拉取请求(pull request)。

License / 许可

MIT License

chatgpt-fine-tuning's People

Contributors

yuyou-dev avatar teresa1228 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.