Giter VIP home page Giter VIP logo

cv-in-adas-pytorch's Introduction

CV-in-ADAS

ADAS is short for Advanced Driver Assistance System. And it has the following features night vision assistance, anti-collision alert, collision resolution, lane departure warning, lane keeping, lane change assist, corner obstacle detection, driver status monitoring, driver reminder, parking assistance, traffic sign recognition, and high beam Auxiliary and so on.

From the system function, the ADAS system has a significant number of tasks related to computer vision (CV) which are as follows:

  1. Detection: vehicle detection, pedestrian detection, non-motor vehicle detection, traffic sign recognition;
  2. Segmentation: lane detection.

In order to realize the above functions, it is necessary to separately establish a model for each function. However, parameters for these models are so many that the performance of the vehicle real-time system may be influenced.

0. Environment

Python version: 3.5
Deep learning framework: pytorch

package list:

  1. scikit-image (0.12.3)
  2. numpy (1.16.2)
  3. torch (1.0.1)
  4. torchvision (0.2.2.post3)
  5. visdom (0.1.8.8)
  6. matplotlib (1.5.3)
  7. pandas (0.18.1)
  8. opencv-python (3.4.3.18)
  9. tqdm (4.26.0)

1. Semantic Segmentation

Task Purpose
Lane segmentation Lane departure warning

2. Detection

Task Purpose
Vehicle detection Vehicle approach warning
Pedestrain detection Pedestrian approach warning

3. Datasets

Lane Segmentation: https://xingangpan.github.io/projects/CULane.html

4. Performance

4.1 Semantic segmentation

Model BCE Loss IOU ACC FPS
Unet-2D 0.0620 \ \ \
VPGNet \ \ \ \
S-CNN 0.0371 \ \ \
Least Square Fitting \ \ \ \

4.2 Result display

unet2d-seg scnn2d-seg

unet2d-loss scnn2d-loss

4.2 Detection

5. To do list

  • Segmentation
    • Traditional segmentation method
    • 2D U-Net Seg
    • VPGNet
    • S-CNN
    • Least Square Fitting
  • Detection
    • YOLO
    • Faster-RCNN
    • Stereo-RCNN
  • Combining the above

6. Reference paper

6.1 Segmentation part

  1. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C]//International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 2015: 234-241.
  2. Pan X, Shi J, Luo P, et al. Spatial as deep: Spatial cnn for traffic scene understanding[C]//Thirty-Second AAAI Conference on Artificial Intelligence. 2018.
  3. Lee S, Kim J, Shin Yoon J, et al. Vpgnet: Vanishing point guided network for lane and road marking detection and recognition[C]//Proceedings of the IEEE International Conference on Computer Vision. 2017: 1947-1955.
  4. De Brabandere B , Van Gansbeke W , Neven D , et al. End-to-end Lane Detection through Differentiable Least-Squares Fitting[J]. 2019.

6.2 Detection part

  1. Ren S, He K, Girshick R, et al. Faster r-cnn: Towards real-time object detection with region proposal networks[C]//Advances in neural information processing systems. 2015: 91-99.
  2. Li P, Chen X, Shen S. Stereo R-CNN based 3D Object Detection for Autonomous Driving[J]. arXiv preprint arXiv:1902.09738, 2019.
  3. Redmon J, Farhadi A. Yolov3: An incremental improvement[J]. arXiv preprint arXiv:1804.02767, 2018.

cv-in-adas-pytorch's People

Contributors

mjdelta avatar sparrowx avatar xiaozhang8tuo avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.