Giter VIP home page Giter VIP logo

funie-gan's Introduction

Resources

  • Implementations of FUnIE-GAN for underwater image enhancement
  • Simplified implementations of UGAN and its variants (original repo)
  • Modules for quantifying image quality base on UIQM, SSIM, and PSNR
  • Implementation: TensorFlow >= 1.11.0, Keras >= 2.2, and Python 2.7
Perceptual enhancement Color and sharpness Hue and contrast
det-1a det-1b det-1c
Enhanced underwater imagery Improved detection and pose estimation
det-enh det-gif

FUnIE-GAN Features

  • Provides competitive performance for underwater image enhancement
  • Offers real-time inference on single-board computers
    • 48+ FPS on Jetson AGX Xavier, 25+ FPS on Jetson TX2
    • 148+ FPS on Nvidia GTX 1080
  • Suitable for underwater robotic deployments for enhanced vision

FUnIE-GAN Pointers

Usage

  • Download the data, setup data-paths in the training-scripts
  • Use paired training for FUnIE-GAN or UGAN, and unpaired training for FUnIE-GAN-up
    • Checkpoints: checkpoints/model-name/dataset-name
    • Samples: data/samples/model-name/dataset-name
  • Use the test-scripts for evaluating different models
    • A few test images: data/test/A (ground-truth: GTr_A), data/test/random (unpaired)
    • Output: data/output
  • Use the measure.py for quantitative analysis based on UIQM, SSIM, and PSNR
  • A few saved models are provided in saved_models/

Constraints and Challenges

  • Issues with unpaired training (as discussed in the paper)
    • Inconsistent coloring, inaccurate modeling of sunlight
    • Often poor hue rectification (dominant blue/green hue)
    • Hard to achieve training stability

Underwater Image Enhancement: Recent Research and Resources

2019

Paper Theme Code Data
Multiscale Dense-GAN Residual multiscale dense block as generator
Fusion-GAN FGAN-based model, loss function formulation U45
UDAE U-Net denoising autoencoder
VDSR ResNet-based model, loss function formulation
JWCDN Joint wavelength compensation and dehazing
AWMD-Cycle-GAN Adaptive weighting for multi-discriminator training
WAug Encoder-Decoder Encoder-decoder module with wavelet pooling and unpooling GitHub
Water-Net Dataset and benchmark GitHub UIEBD

2017-18

Paper Theme Code Data
UGAN Several GAN-based models, dataset formulation GitHub Uw-imagenet
Underwater-GAN Loss function formulation, cGAN-based model
LAB-MSR Multi-scale Retinex-based framework
Water-GAN Data generation from in-air image and depth pairings GitHub MHL, Field data
UIE-Net CNN-based model for color correction and haze removal

Non-deep Models

Reviews, Metrics, and Benchmarks

Acknowledgements

funie-gan's People

Contributors

xahidbuffon avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.