This project is part of the Udacity Generative AI course, Generative AI Fundamentals module. To pass the project, my code needs to do the following:
- Load a pre-trained model and evaluate its performance
- Perform parameter-efficient fine-tuning using the pre-trained model
- Perform inference using the fine-tuned model and compare its performance to the original model
Model: GPT-2
Evaluation approach: 'evaluate' method with a Hugging Face Trainer
Fine-tuning dataset: fka/awesome-chatgpt-prompts