Giter VIP home page Giter VIP logo

fined's Introduction

Fast Inference Network for Edge Detection (FINED)

This repository contains the implementation details of our paper:

"FINED: Fast Inference Network for Edge Detection"
by Jan Kristanto Wibisono , Hsueh-Ming Hang

In this paper, we address the design of lightweight deep learning-based edge detection. The deep learning technology offers a significant improvement on the edge detection accuracy. However, typical neural network designs have very high model complexity, which prevents it from practical usage. In contrast, we propose a Fast Inference Network for Edge Detection (FINED), which is a lightweight neural net dedicated to edge detection. By carefully choosing proper components for edge detection purpose, we can achieve the state-of-the-art accuracy in edge detection while significantly reducing its complexity. Another key contribution in increasing the inferencing speed is introducing the training helper concept. The extra subnetworks (training helper) are employed in training but not used in inferencing. It can further reduce the model complexity and yet maintain the same level of accuracy. Our experiments show that our systems outperform all the current edge detectors at about the same model (parameter) size.

Architecture

image TIN has successfully demonstrated that a lightweight neural network can have a good performance on image edge detection. Furthermore, we extend the TIN architecture to strengthen its detection accuracy. TIN consists of Feature Extractor blocks together with Feature Enrichment and Summarizer operation. We modify the Feature Enrichment module, and combine it with the Residual Relu operator. We also modify the Summarizer using the Residual Pooling. Then, we match all the stage outputs to the ground-truth. After extensive study, we found that the multi-stage outputs can serve as a training helper that guides the training process to produce a higher performance system. In the inferencing phase, we remove the training helper to reduce the system complexity.

Evaluation

image Comparison of complexity and accuracy performance among various edge detection schemes. Our proposed methods (Green). BDCN family (Red). Other methods (Blue). ODS (Transparent label). Number of Parameter (Orange label)

image The PR curves of various systems on BSDS500

FINED-API

Simple API to try FINED.

  • End Point : http://lab1.jankristanto.com:8000/image/predict
  • Method : POST
'Content-Type: multipart/form-data'
{
    'file': binary
}
  • response :
    Response headers content-type: image/png
  • Sample response : image

Example: demo

Citing

Thanks for your interest in our work, please consider citing:

```
@INPROCEEDINGS{
    9428230,
	author={Wibisono, Jan Kristanto and Hang, Hsueh-Ming},
	booktitle={2021 IEEE International Conference on Multimedia and Expo (ICME)}, 
	title={Fined: Fast Inference Network for Edge Detection}, 
	year={2021},
	volume={},
	number={},
	pages={1-6},
	doi={10.1109/ICME51207.2021.9428230}
}
```

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.