- Set up conda environment by running
conda env create --file environment_gpu.yaml
- Download dataset:
./prepare-wikitext-103.sh
- Preprocess dataset by converting it to binary format:
./preprocess.sh
- Train Neural Process language model:
./train.sh
- Install Anaconda
wget https://repo.anaconda.com/archive/Anaconda3-2022.05-Linux-x86_64.sh
chmod +x Anaconda3-2022.05-Linux-x86_64.sh
srun -t 60 ./Anaconda3-2022.05-Linux-x86_64.sh
- Install conda environment
srun -t 60 conda env create -f environment_gpu.yml
- Download dataset
./prepare-wikitext-103.sh
- Activate environment
conda activate anp4nlg_gpu
- Preprocess dataset by converting it to binary format:
./preprocess.sh