learning rate for embedding layer (last_linear) about deep-metric-learning-baselines HOT 2 CLOSED

I see both options in the literature: Using one single learning rate for all (e.g. Distance Sampling/Marginloss paper: https://arxiv.org/abs/1706.07567, Semihard Sampling: https://arxiv.org/pdf/1704.01285.pdf) or different learning rates (Hardness Aware DML https://arxiv.org/pdf/1903.05503.pdf). In addition, I examined both options and found it to make little to no difference, as I could replicate most baselines results regardless.

However, for those that require this option, I have just added it in the latest update. Simply set the flag --fc_lr_mul to the value you want to multiply the embedding layer with, and you are good to go :). Thanks for the suggestion!

from deep-metric-learning-baselines.

Awesome, thanks!

from deep-metric-learning-baselines.