Giter VIP home page Giter VIP logo

gone-still / live-video-magnification Goto Github PK

View Code? Open in Web Editor NEW

This project forked from tschnz/live-video-magnification

0.0 0.0 0.0 7.22 MB

An OpenCV/Qt based realtime application for Eulerian Video Magnification / Motion Magnification. Works with multiple videos and cameras at the same time and let's you export the magnified videos.

License: GNU General Public License v3.0

C++ 96.11% C 2.33% QMake 1.56%

live-video-magnification's Introduction

Live Motion Magnification

An OpenCV/Qt based realtime application for Eulerian Video Magnification. Works with multiple videos and cameras at the same time and let's you export the magnified videos.

Examples

Color Magnified Video

Image shows the color magnified output for a video. In the pictures you can see the effects of the cardiac cycle on the skins color. The upper image shows the skin of the face during a diastole, the lower one during a ventricular systole of the cycle.

Motion Magnified Camerastream

(Un-)Wanted artifacts from a realtime motion magnified camerastream. The strong b/w areas around torso and head are resulting from a fast backwards movement and excessive amplification. The white points (the ones bigger than the noise) on the left side are awhirled dust particles, not visible in the original camera source.

Dependencies

  • Qt >= 5.0
  • OpenCV >= 2.0 (< 3.0 ? -> not tested yet)

License

This application is licensed under GPLv3, read the LICENSE.

Credits

Thanks to Nick D'Ademo whose qt-opencv-multithreaded application served as basis and to Joseph Pan whose algorithms in the QtEVM application were adapted for this project.

Also take a look at the MITs webpage for Eulerian Video Magnification. They provide demo videos on their page and the team did a fantastic job in researching and developing this field of science.

How do I use it?

Connect

  • Camera
    • Device Number: Type in the device number of your camera connected to your computer. Indexing starts with 0 which is usually your built-in webcam.
    • (Ubuntu/Linux) PointGrey Device on USB: Having a DC1394 Camera connected to your computer, OpenCV redirects the camera over the v4l-API to device number 0. If you wish to also connect to your built-in camera, enable this option to set built-in to 0, DC1394 to 1
    • Image Buffer: Select the length of an image buffer before processing those images. If dropping frames if buffer is full is disabled, your capture rate will be same the same as your processing rate.
  • Video
    • Choose a video. Compatibility is given if your computer supports the codec. Valid file endings are .avi .mp4 .m4v .mkv .mov .wmv
  • Resolution: This does not work for videos on Ubuntu/Linux yet (Windows not tested). For cameras check the supported modes from camera manufacturer and type in the resolution specified for a mode.
  • Frames per Second: Some cameras support multiple modes with different resolution/fps/etc. . Setting the framerate will change into a mode with a framerate near the one you typed in. For videos, some mp4-files have a bad header where OpenCV can't read out the framerate, which will normally be set to 30FPS. Anyway here you can set it manually.

Connect Dialog

Main Window

When succesfully connected to a camera or opened a window, you can draw a box in the video, to scale and only amplify this Region Of Interest in a video source. Setting the video back to normal can be done via menu that opens with a right click in the video. There is also the option to show the unmagnified image besides the processed one.

Right-click Menu in Frame Label

Magnify

Try experimenting with different option values. Furthermore tooltips are provided when hovering the cursor above a text label in the options tab. If you're using an older machine and processing is too slow, try enabling the Grayscale checkbox.

Low Level value High Level value
Color Magnification Slower and more accurate. Too low = no signal detection Faster magnification, inaccurate spatial resolution
Motion Magnification More noise, less movements by big objects Less noise, less movements by little objects

Color Magnification

Note that in the scene, absolutely NO MOVEMENTS are required to process the video correctly.

  • Amplification: The higher the value, the more colorful and noisy the output.
  • Frequency Range: The freq. range of periodically appearing color changes that shall be amplified.

Panel for Color Magnification Options

Motion Magnification

  • Amplification: The higher the value, the more movements and noise are amplified.
  • Cutoff Wavelength: Reduces fast movements and noise.
  • Frequency Range: Reducing the handler values leads to magnifying slow movements more than fast movements and vice versa.
  • Chrom Attenuation: The higher the value, the more the chromaticity channels are getting amplified too, e.g. the more colorful the movements are.

Panel for Motion Magnification Options

Save

For saving videos or recording from camera you have to specify the file extension by your own. .avi is well supported. If you should encounter problems, please try a differenct saving codec in the toolbar under File->Set Saving Codec.

MainWindow with saving codec menu

How does it work?

The image below provides you the class structure and the dataflow (blue = images, red = options) throughout the application.

Class structure

Algorithm

The algorithms are using a combination of spatial filters (e.g. image pyramids) and temporal filters to determine motions of different spatial wavelength in videos. These can be amplified separately before collapsing the image pyramid and adding the motion image back to the original.

Idea of the Video Magnification Algorithm

Color Magnification

For further informations look at the comments in the .h/.cpp files in /main/magnification/*

Color Magnification UML

Motion Magnification

For further informations look at the comments in the .h/.cpp files in /main/magnification/*

Laplace Magnification UML

live-video-magnification's People

Contributors

tschnz avatar zefrenchy avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.