Code base to learn rnn
I will be adding the rnn practice code developed from scratch to understand the working of RNN. This is the perfect way to learn it.
https://github.com/dennybritz/rnn-tutorial-rnnlm/blob/master/train-theano.py
https://www.tensorflow.org/api_docs/python/tf/random_uniform
http://suriyadeepan.github.io/2017-02-13-unfolding-rnn-2/
https://github.com/suriyadeepan/rnn-from-scratch/blob/master/vanilla.py
https://www.tensorflow.org/tutorials/recurrent
http://www.wildml.com/2015/09/speeding-up-your-neural-network-with-theano-and-the-gpu/
https://github.com/dennybritz/rnn-tutorial-rnnlm/blob/master/rnn_theano.py
- use tensorflow to speedup the training
- validation split and use to check the progress of the training
- implement CWRNN
- start implementing the new idea for embedding