about the hyperparameters about identifiable-transformers HOT 4 OPEN

Hi! Thank you for your interest in our work! This repository mostly aims to provide a simple identifiable variant of transformers and easy comparison between identifiable and standard transformer variants (for the same set of hyperparameters). In the paper, our aim was not to achieve SOTA but to provide an identifiable variant. There, we might have used a slightly different set of hyperparameters as compared to this repository (which still requires hyperparameter search).

I will be happy to share the exact set of hyperparameters we used in the paper :).
please contact me at [email protected]

from identifiable-transformers.

Thanks a lot! I have sent you an email. Looking forward to your reply.

from identifiable-transformers.

Sorry, I found a typo in the email I provided (just corrected). Could you please email me again?

from identifiable-transformers.

sorry for replying late, I sent you an email again :)

from identifiable-transformers.