The code for loss computation of itc is not corresponding to the original paper about albef HOT 2 OPEN

I also could not find the KL-divergence loss in the code. Do you have any idea?

from albef.

Add the Negative Entropy of sim_i2t_m to the total loss by multiplying the coefficient $\alpha$. You will get the KL divergence of $q$ and $p$. Some equations for reference:

$$ KL(q||p) = E_q \log \frac{q}{p} = -E_q \log p + (- E_q \log q) =CE(q|p) - H(p) $$

from albef.