Comparison with IPT about swinir HOT 9 CLOSED

Yes, there are some difference. We notice that IPT reported Y-channel PSNR for color image denoising. Since papers in the literature often report RGB PSNR, we re-test IPT and report its RGB PSNR as well.

from swinir.

But their competitors reported in their Table 2 is RGB PSNR (such as DnCNN and RDN). Shouldn't that be an unfair comparion?

from swinir.

https://github.com/cszn/DPIR#denoising-results-on-bsd68-and-urban100-datasets

Denoising results on BSD68 and Urban100 datasets

from swinir.

@cszn Thanks for your response! I think your table provide a reasonable number. My only concern is whether IPT report RGB results or Y results. In there Table. 2 (attached below), FFDNet achieves 27.96 db on CBSD68-sigma50, which is consistent with RGB results on your table. Based on these results, I think their table. 2 (attached) reports RGB results, unless their results are incorrect.

from swinir.

Any new updates? @JingyunLiang @cszn , I believe the comparison with IPT could be important in this work. And many followers will use the reported number in their work.

from swinir.

You can run the testing codes of both methods.

from swinir.

I think the answer is very clear. In Table 2 of IPT, the compared methods are measured by color PSNR, while IPT is measured by Y-channel PSNR (always much higher than color PSNR). I recommend following papers cite the color PSNR (the correct one) reported in our paper.

Yes, there are some difference. We notice that IPT reported Y-channel PSNR for color image denoising. Since papers in the literature often report RGB PSNR, we re-test IPT and report its RGB PSNR as well.

from swinir.

Thanks for further clarifying. I will contact the author of IPT for further details. If that is reported on Y-channel, I think it will confuse the followers.

from swinir.

After I contact the original author of IPT. I think they misunderstand the results from RDN and DnCNN and give an unfair evaluation on their Table. 2. Thanks again for clear clarification and patient discussion here. Hope to see more interesting work from you in the future!

from swinir.