Giter VIP home page Giter VIP logo

omni-sr's Introduction

Omni Aggregation Networks for Lightweight Image Super-Resolution (OmniSR)

Accepted by CVPR2023

The official repository with Pytorch

Our paper can be downloaded from [Arxiv].

Installation

Clone this repo:

git clone https://github.com/Francis0625/OmniSR.git
cd OmniSR

Dependencies:

  • PyTorch>1.10
  • OpenCV
  • Matplotlib 3.3.4
  • opencv-python
  • pyyaml
  • tqdm
  • numpy
  • torchvision

Preparation

  • Download pretrained models, and copy them to ./train_logs/:
Settings CKPT name CKPT url
DIV2K $\times 2$ OmniSR_X2_DIV2K.zip baidu cloud (passwd: sjtu) , Google driver
DF2K $\times 2$ OmniSR_X2_DF2K.zip baidu cloud (passwd: sjtu) , Google driver
DIV2K $\times 3$ OmniSR_X3_DIV2K.zip baidu cloud (passwd: sjtu) , Google driver
DF2K $\times 3$ OmniSR_X3_DF2K.zip baidu cloud (passwd: sjtu) , Google driver
DIV2K $\times 4$ OmniSR_X4_DIV2K.zip baidu cloud (passwd: sjtu) , Google driver
DF2K $\times 4$ OmniSR_X4_DF2K.zip baidu cloud (passwd: sjtu) , Google driver
  • Download benchmark (baidu cloud (passwd: sjtu) , Google driver), and copy them to ./benchmark/. If you want to generate the benchmark by yourself, please refer to the official repository of RCAN.

Evaluate Pretrained Models

Example: evaluate the model trained with DF2K@X4:

  • Step 1, the following cmd will report a performance evaluated with python script, and generated images are placed in ./SR
python test.py -v "OmniSR_X4_DF2K" -s 994 -t tester_Matlab --test_dataset_name "Urban100"
  • Step2, please execute the Evaluate_PSNR_SSIM.m script in the root directory to obtain the results reported in the paper. Please modify Line 8 (Evaluate_PSNR_SSIM.m): methods = {'OmniSR_X4_DF2K'}; and Line 10 (Evaluate_PSNR_SSIM.m): dataset = {'Urban100'}; to match the model/dataset name evaluated above.

Training

  • Step1, please download training dataset from DIV2K (Train Data Track 1 bicubic downscaling x? (LR images) and Train Data (HR images)), then set the dataset root path in ./env/env.json: Line 8: "DIV2K":"TO YOUR DIV2K ROOT PATH"

  • Step2, please download benchmark (baidu cloud (passwd: sjtu) , Google driver), and copy them to ./benchmark/. If you want to generate the benchmark by yourself, please refer to the official repository of RCAN.

  • Step3, training with DIV2K $\times 4$ dataset:

python train.py -v "OmniSR_X4_DIV2K" -p train --train_yaml "train_OmniSR_X4_DIV2K.yaml"

Visualization

performance

Results

performance result.tex is the corresponding tex code for result comparison.

Related Projects

License

This project is released under the Apache 2.0 license.

To cite our paper

If this work helps your research, please cite the following paper:

@inproceedings{omni_sr,
  title      = {Omni Aggregation Networks for Lightweight Image Super-Resolution},
  author     = {Wang, Hang and Chen, Xuanhong and Ni, Bingbing and Liu, Yutian and Liu jinfan},
  booktitle  = {Conference on Computer Vision and Pattern Recognition},
  year       = {2023}
}

omni-sr's People

Contributors

francis0625 avatar neuralchen avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.