Giter VIP home page Giter VIP logo

face_segmentation's Introduction

Face segmentation with CNN and CRF

We try different methods to complete face segmentation:

Before using all three methods we detect landmarks and crop the image. Instead of using landmarks detection network in A CNN Cascade for Landmark Guided Semantic Part Segmentation we use 2D-FAN to detect landmarks which works very well on large pose images. We also try different methods to crop the image.

Codes

  • face_segment_part.py: A CNN Cascade for Landmark Guided Semantic Part Segmentation.
  • face_segment_yuval.py: On Face Segmentation, Face Swapping, and Face Perception.
  • face_segment_contour.py: Detected landmarks and get convex hull.

Dependencies

Please download caffe(minimum version: 1.0) for face_segment_yuval.py, download caffe-future for face_segment_part.py

Then run the following command in a terminal:

pip install -r requirements.txt

Results

  • face_segment_part:

No crf:

Add crf:

No crf:

Add crf:

  • face_segment_yuval:

Model face_seg_fcn8s(size:500x500):


Model face_seg_fcn8s_300_no_aug(size:300x300):


Add crf to second model:

  • face_segment_contour:

Add crf:

TODO

  • Modify probability computation in face_segment_yuval.py
  • Add speed test
  • Add landmark detection
  • Add image cropping
  • Contour -> segment
  • Unify code style
  • Improve CRF results
  • Add example images to README
  • Compare results of all methods

face_segmentation's People

Contributors

criminalking avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

face_segmentation's Issues

Is it necessary to use caffe-future?

  • Background:

I use face_segment_part.py to get parts of a face. But the result[1] seems wrong when I run this file. I notice the Caffe-future is needed if I run this file. Then I go to the link of Caffe-future in Readmd.md. And I download the "caffe-future.tar.gz".

  • Question1:

However in its github home page, I found this, "This was a pre-release Caffe branch for fully convolutional networks (FCNs); however, the needed FCN features are now included in the Caffe master branch. Note however there are differences in the master edition, so refer to the documentation there. ". Is it necessary to use caffe-future now? If the answer is yes, how can I install this version of caffe? I don't find any instructions.

  • Qusetion2:

What causes my problem here? Is this related to the version of caffe?

Thanks for your patience!

  • [1] The wrong result

2019-08-27

code in tensorflow

hi. Thank you very much for providing code. Currently you are using coffe. I don't have gpu to execute it. Can u pride code in tensorflow so that i can implement it to my project. Thanks in advance

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.