`warmup_lr` is computed incorrectly in `step_ReduceLROnPlateau` about pytorch-gradual-warmup-lr HOT 8 OPEN

#18

from pytorch-gradual-warmup-lr.

Hi,how do you use ReduceLROnPlateau as the after_scheduler,when I use this as after_scheduler,the warm up in the first epoch is not change.

from pytorch-gradual-warmup-lr.

Hi,how do you use ReduceLROnPlateau as the after_scheduler,when I use this as after_scheduler,the warm up in the first epoch is not change.

https://github.com/LvJC/pytorch-gradual-warmup-lr

from pytorch-gradual-warmup-lr.

Hi,how do you use ReduceLROnPlateau as the after_scheduler,when I use this as after_scheduler,the warm up in the first epoch is not change.

https://github.com/LvJC/pytorch-gradual-warmup-lr

Hi,I had replace this line

• warmup_lr = self.get_lr()

• warmup_lr = [base_lr * ((self.multiplier - 1.) * self.last_epoch / self.total_epoch + 1.) for base_lr in self.base_lrs]
  I use the warm_up lr is 5e-5 and 1epoch, and the after_scheduler init lr is 5e-4.But When I running,I find the first epoch lr is also 5e-4,so,I think there have other error?Thanks!

from pytorch-gradual-warmup-lr.

Hi,how do you use ReduceLROnPlateau as the after_scheduler,when I use this as after_scheduler,the warm up in the first epoch is not change.

https://github.com/LvJC/pytorch-gradual-warmup-lr

Hi,I had replace this line

• warmup_lr = self.get_lr()

• warmup_lr = [base_lr * ((self.multiplier - 1.) * self.last_epoch / self.total_epoch + 1.) for base_lr in self.base_lrs]
  I use the warm_up lr is 5e-5 and 1epoch, and the after_scheduler init lr is 5e-4.But When I running,I find the first epoch lr is also 5e-4,so,I think there have other error?Thanks!

You can re-refer it, I updated it just now. I think the main cause is the get_last_lr function.

from pytorch-gradual-warmup-lr.

Hi,how do you use ReduceLROnPlateau as the after_scheduler,when I use this as after_scheduler,the warm up in the first epoch is not change.

https://github.com/LvJC/pytorch-gradual-warmup-lr

Hi,I had replace this line

• warmup_lr = self.get_lr()
• warmup_lr = [base_lr * ((self.multiplier - 1.) * self.last_epoch / self.total_epoch + 1.) for base_lr in self.base_lrs]
  I use the warm_up lr is 5e-5 and 1epoch, and the after_scheduler init lr is 5e-4.But When I running,I find the first epoch lr is also 5e-4,so,I think there have other error?Thanks!

You can re-refer it, I updated it just now. I think the main cause is the get_last_lr function.

Thanks!I will test it.

from pytorch-gradual-warmup-lr.

Hi,how do you use ReduceLROnPlateau as the after_scheduler,when I use this as after_scheduler,the warm up in the first epoch is not change.

https://github.com/LvJC/pytorch-gradual-warmup-lr

Hi,I had replace this line

• warmup_lr = self.get_lr()
• warmup_lr = [base_lr * ((self.multiplier - 1.) * self.last_epoch / self.total_epoch + 1.) for base_lr in self.base_lrs]
  I use the warm_up lr is 5e-5 and 1epoch, and the after_scheduler init lr is 5e-4.But When I running,I find the first epoch lr is also 5e-4,so,I think there have other error?Thanks!

You can re-refer it, I updated it just now. I think the main cause is the get_last_lr function.

Hi,I test this methods,but this has same problem,the first epochs lr is also 5e-4.But,when I change the after_scheduler to cosin_scheduler,the running is right.

from pytorch-gradual-warmup-lr.

Hi there! Still do not work with ReduceLROnPlateau

from pytorch-gradual-warmup-lr.