Source code for tensor recurrent neural network (TRNN)
improving vanilla RNN w.r.t
-
high-order Markov process
-
high-order interactions in hidden states
-
dimension reduction with tensor network model
files
-
reader.py read the data into train/valid/test datasets, normalize the data if needed
-
model.py seq2seq model for sequence prediction
-
trnn.py tensor-train lstm cell and corresponding tensor train contraction
-
trnn_imply.py forward step in tensor-train rnn, feed previous predictions as input