Giter VIP home page Giter VIP logo

facialmotioncapture_v2's Introduction

FacialMotionCapture_v2

Download trained model (lbfmodel.yaml)

https://github.com/kurnianggoro/GSOC2017/tree/master/data

Install prerequisites:

Linux:

(may vary between distro's and installation methods)
This is for manjaro with Blender installed from the package manager

  • python3 -m ensurepip
  • python3 -m pip install --upgrade pip --user
  • python3 -m pip install opencv-contrib-python numpy --user

MacOS

open the Terminal

  • cd /Applications/Blender.app/Contents/Resources/2.81/python/bin
  • ./python3.7m -m ensurepip
  • ./python3.7m -m pip install --upgrade pip --user
  • ./python3.7m -m pip install opencv-contrib-python numpy --user

Windows:

Open Command Prompt as Administrator

  • cd "C:\Program Files\Blender Foundation\Blender 2.81\2.81\python\bin"
  • python -m pip install --upgrade pip
  • python -m pip install opencv-contrib-python numpy

Test Facial Capture

You can use the Test.py script to test facial motion capture.
Open the script and change the folder for lbfmodel.yaml to the folder that you downloaded it to.

Then run "python3 Test.py"

facialmotioncapture_v2's People

Contributors

jkirsons avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar avatar avatar avatar avatar

Forkers

matteoilceco nguyenphuhung2002 oqtanecms ferozkhanabbasi henryb1966 dellis1972 josesuero fisis simonfloris indextbag limitmhw agdolla lalamax3d viliusmat alan-azvd dennypool druidtin bjsongzhen samho718 molouh swipswaps banetese khlorghaal daviterri alexstux piii866 1165048017 adimpression pandinosaurus porzellan ericsjtuer zhangfutao-123 joeboy sadernalwis palanisamy1169 zorrock asklinux darkkoll sagiashok objectoriented-dev fakhruddin90 ruanjiyang piratedragon seanasimpson xibaoxuan shreysangwan13 arnaldojr okinter11 pater8715 pran20 dfqytcom zhangpengk mymess ruchirasachinthana rmss86 takeyamayuki

facialmotioncapture_v2's Issues

Overload resolution failed

Please help me with this

cd "C:\Program Files\Blender Foundation\Blender 2.83\2.83\python\bin"

Traceback (most recent call last):
File "C:\Users\Admin\Downloads\Vincent (3).blend\OpenCVAnimOperator.py", line 196, in modal
cv2.error: OpenCV(4.5.2) 👎 error: (-5:Bad argument) in function 'circle'

Screenshot 2021-05-14 173727:

Can't parse 'center'. Sequence item with index 0 has a wrong type
Can't parse 'center'. Sequence item with index 0 has a wrong type
location: :-1

719: error: (-49:Unknown error code -49) 'cv::FileStorage::Impl::open'

ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_R"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[1]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[2]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_low_4_bbone_easeout_L"].rotation_quaternion[3]
ERROR (bke.anim_sys): c:\b\win64_cmake_vs2017\win64_cmake_vs2017\blender.git\source\blender\blenkernel\intern\anim_sys.c:4160 BKE_animsys_eval_driver: invalid driver - pose.bones["lip_up_4_bbone_easeout_L"].rotation_quaternion[3]
loading data from : C:\Users\afiqm\Downloads\lbfmodel.yaml
Traceback (most recent call last):
File "D:\Downloads\Vincent.blend\OpenCVAnimOperator.py ", line 30, in
File "D:\Downloads\Vincent.blend\OpenCVAnimOperator.py ", line 43, in OpenCVAnimOperator
cv2.error: OpenCV(4.2.0) C:\projects\opencv-python\opencv\modules\core\src\persistence.cpp:719: error: (-49:Unknown error code -49) Input file is invalid in function 'cv::FileStorage::Impl::open'

Blender 2.82a Crash on Mac

Have attempted to run capture both with and without DLIB, and pip install the packages without issue in the bundled python version (3.7), also installed the facial dat and the updated facial model yaml for the attempt without the Dlib. Also Test.py Works without issue as well.

w Dlib
"python3 -m pip install opencv-python opencv-contrib-python imutils numpy dlib --user"

without Dlib
"./python3.7m -m pip install opencv-contrib-python numpy --user"

But in both cases resulted in the same blender crash, then green light for a second or two, and finally the blender app crashes with the apple report crash log from the blender app. (see attached)

Is this hardware related? MacbookPro 3.1 ghz 16GB or Blender 2.82a version related?
Also re-installed blender 2.80rc3 and same behavior happened.

Are those specs supported, or is this only for Blender 2.79 version?

Crash.log

How to use with a different rig?

Hi, thanks for the cool project.

It works like the charm with the Vincent character and I would like to use it with a different character, with a rig based on Rigify meta-human, not BlenRig.

Could you share how you get to know which rig bones to use in here and how you adjusted the constants, so that I could adapt it for my rig?

Thank you!

OpenCV issue windows X64

I hope you could help me with a Python error message I didn't manage to resolve.

I followed your steps and had the following error message:

File "C:\Users\yrfri\Documents\Blender\vincent facial mocap\Vincent(1).blend\OpenCVAnimOperator.py", line 30, in
File "C:\Users\yrfri\Documents\Blender\vincent facial mocap\Vincent(1).blend\OpenCVAnimOperator.py", line 43, in OpenCVAnimOperator
cv2.error: OpenCV(4.5.1) C:\Users\appveyor\AppData\Local\Temp\1\pip-req-build-r2ue8w6k\opencv_contrib\modules\face\src\facemarkLBF.cpp:487: error: (-5:Bad argument) No valid input file was given, please check the given filename. in function 'cv::face::FacemarkLBFImpl::loadModel'

I'm using Blender 2.91, Python 3.9 on my computer and Python 3.77 for Blender. I tried the Blender Python version to run promlt as administrator.

Here is what I tried to do in order to resolve the issue:

  • Updated or re-installed all applications (python, Blender...)

  • followed the exchange on your Youtube:

  • tried path name with \, /, "", '',

  • tried to modify: self._cap = cv2.VideoCapture(0) into (1) and back to the original script.

  • verified that the file size is 55.5MP

The error message is the same.
Any input would be highly appreciated, I',m really wish to experience this facial mocap.

Traceback (most recent call last):

Traceback (most recent call last):
File "C:\Users\Shoxrux\Downloads\Vincent.blend\OpenCVAnimOperator.py", line 196, in modal
cv2.error: OpenCV(4.5.3) 👎 error: (-5:Bad argument) in function 'circle'

Overload resolution failed:

  • Can't parse 'center'. Sequence item with index 0 has a wrong type
  • Can't parse 'center'. Sequence item with index 0 has a wrong type

location: :-1

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.