Negative Visit Forward Cross-Entropy on MIMIC-III about med2vec HOT 1 OPEN

Hi Brian,

Thanks for taking interest in our work.
I think the negative values coming from the loss is caused by the small value (logEps 1e-8) I added to the cross-entropy to prevent negative infinity.
I haven't run any experiments on MIMIC-III with med2vec, so I can't give you any concrete numbers.
The balance between emb cost and the visit cost is actually an interesting issue. I haven't done the hyperparameter search on that aspect, but the balance between the two depends on many factors including number of input codes and number of output codes.
We can talk more on email or Skype as you suggested, and maybe take a look at your code.

Thanks,
Ed

from med2vec.