As the name suggests, everything from scratch.
An extension of my other side project, picograd. But here I will be a little more extensive.
MLP visualization is under assets/
These examples in the notebook can be played around with according to your choice. Right now, my plans are to build:
- RNN and LSTM
- More optimizers
- Multi-Head Attention
- Tokenizers