woosuk288 / gpt-fine-tuning-with-nodejs Goto Github PK

This project show how to easily fine-tune a GPT data model. This codebase goes along with the tutorial located here.

To follow along with this tutorial, you’ll need to have the following installed on your machine:

• Python
• Node.js

You’ll also need an OpenAI API Key. You can get one at https://openai.com.

First, clone the repo and install the dependencies:

git clone https://github.com/dabit3/gpt-fine-tuning-with-nodejs.git

cd gpt-fine-tuning-with-nodejs

npm install # or yarn

Next, set the environment variable for your OpenAI API Key

export OPENAI_KEY="your-api-key"

First, upload the file with the example or custom data set to OpenAI:

node uploadFile.js

Next, use the File ID that is logged out to create a new fine tune based on davinci by updating the training_file in createFineTune.js.

Finally, create the fine tune:

node createFineTune.js

Once the fine tune is created, it will take some time to process. We can get the status of the fine tune, as well as the model ID, by calling the listFineTunes API method.

node listFineTunes.js

Now that the fine tune has processed and our. new model is ready, we can try it out.

Open createCompletion.js. Here, update the fine_tuned_model value with your model name.

Next, run the script:

node createCompletion.js