The code builds an RNN to generate sentences using only numpy. Watch this video by Ajay Halthor to see a live demo and understand the intuition behind Recurrent Neural Networks.
- python=3.6.0
- numpy=1.14.0
- nltk=3.2.3
- notebook: All the code for generating the RNN
- npz file: saved model. You can use it to continur training
Open this project directory in terminal and type
$ jupyter notebook
Recommend install jupyter through anaconda here.
- [1] A cool implementation with Theano + Numpy: https://github.com/dennybritz/rnn-tutorial-rnnlm
- [2] Deep Learning book Ch.10 on Sequence modelling: https://www.deeplearningbook.org/contents/rnn.html