Can't achieve the given performance: ResNet-50 + SSP+CE(Uniform) for imageNet-LT about imbalanced-semi-self HOT 3 CLOSED

Hi, I double checked the config, which seems fine to me. So currently I'm not sure what exactly causes the difference.

I would suggest that you could first run the baseline model (without SSP), and compare the model performance w/ & w/o SSP. If that gives you reasonable gains, then you might want to check whether the baseline model matches the number reported in our paper. If the performance of the baseline model is also lower than the number reported, then it might be due to the hyperparameters and the training settings.

Otherwise, you may want to check whether the pre-trained weights are loaded correctly, or the exact training setting such as PyTorch version (1.4 for this repo), etc.

from imbalanced-semi-self.

The baseline result is

my running environment is

And I think the model is loaded correctly because I've tested the given model provided by you and got the correct result.
Does the following output mean the weight for resnet50 loaded?

Thanks for your answer.

from imbalanced-semi-self.

Yes, I think that indicates your loading process is correct. Seems there's a reasonable gap though, but I'm not sure what causes the difference. I would suggest that you could tune the hyper-parameters a bit; I took a quick pass on the original OLTR config, and seems they use 0.1 as initial LR. Also, it is observed that training for longer epochs could lead to better results, so you might want to increase the epoch numbers to see what you can get. Hope this helps!

from imbalanced-semi-self.