zdevito / single_controller Goto Github PK

Install the package:

pip install -e .

Run the example_train application, which simulates training. There is some stuff commented out which can be enabled to inject failures.

python example_train/launch.py

The other files in the folder are the different parts of the job (health_check, train, supervisor script).

Run the tests (kinda noisy at this point)

python test/simple.py

Prepare data for nanoGPT example:

cd nanoGPT
python data/shakespeare_char/prepare.py

Run the nanoGPT example:

cd nanoGPT
python train.py config/train_shakespeare_char.py

See flags in single_controller/config.py for changing behaviors.