billu98 / spectrain-seminar-project Goto Github PK
View Code? Open in Web Editor NEWTo implement the idea of Spectrain using single GPU's cuda streams. In order to divide the model to implement model parallelism I divided the model upon 2 CUDA Streams and then performed training using Spectrain algorithm.