How to keep the best performance model about lstm-human-activity-recognition HOT 3 OPEN

Hi JunqiZhao ! In keras you can just use the callback named ModelCheckpoint to checkpoint the model and saving the weights while monitoring a quantity eg-val_loss, val_acc, etc. Later you can load the weights saved in .hdf5 format using function load_weights and sending in the path of the weights as an argument for it.

from lstm-human-activity-recognition.

Hi @deadskull7 ,
Thanks for your reply and suggestion, I will give it a try!
By the way, through recording the best performance obtained each time I train the model, the best performance varies from time to time, e,g, accuracy=[0.91, 0.92, 0.89....]. Right now, I am using the average of these accuracy values to evaluate different Network Architectures, I was wondering how would you suggest to quantify the model performance under such a situation?
Best,
Junqi

from lstm-human-activity-recognition.

I usually have a habit of evaluating the model performance by first plotting the learning graph and each time I plot the graph I try to see one of the following matching to the plot

1. Underfitting – Validation and training error high
2. Overfitting – Validation error is high, training error low
   3. Good fit – Validation error low, slightly higher than the training error
3. Unknown fit - Validation error low, training error 'high'

The 4th one is quite different which says that your model is more good at testing the data which your model hasn't even seen which is quite suspicious. So this takes you to re-evaluate your data splitting method earlier. I hope I answered you.

from lstm-human-activity-recognition.