These are implementations of Gradient Descent and their variants, stochastic gradient descent (mini-batch algorithm), dropout
The code is structure to enable ease of experimentation with different activation functions and optimization criteria.
- Autoencoder algorithm
Andrew Ng, "CS294A Lecture Notes -- Sparse Autoencoder"
=---------------------------------