Giter VIP home page Giter VIP logo

hechzh / mediapipe Goto Github PK

View Code? Open in Web Editor NEW

This project forked from google-ai-edge/mediapipe

2.0 0.0 1.0 648.83 MB

MediaPipe with Onnx Runtime support.

License: Apache License 2.0

Shell 0.11% JavaScript 0.04% C++ 70.62% Python 8.21% C 0.54% Objective-C 1.56% Java 7.32% TypeScript 1.91% Objective-C++ 1.23% Swift 0.07% Makefile 0.01% HTML 0.02% CMake 0.01% Batchfile 0.01% Dockerfile 0.02% Starlark 8.32%

mediapipe's Introduction

MediaPipe

English

C++调用MediaPipe(CPU)

MediaPipe使用TFLite进行推理,在移动设备上有着优秀的性能。

尽管MediaPipe在PC中使用CPU也能达到较好的效果,但是在部分Solutions中的表现不尽如人意(比如Holistic)。

目前,MediaPipe只支持Linux的GPU加速,Windows下无法使用GPU进行推理加速。

本项目使用ONNX Runtime,为MediaPipe增加了CUDA和TensorRT支持,使Windows也能进行GPU加速。

如何使用

  1. 为了在Windows下使用GPU加速,首先需要安装英伟达相关依赖:

  2. 下载ONNX Runtime

    libinclude文件夹复制到mediapipe/calculators/tensor/onnxruntime目录下

  3. 将CUDA、cuDNN的bin和TensorRT的lib目录添加到环境变量

    我的运行环境:

    • CUDA 11.7.1_516.94
    • cuDNN 8.5.0.96_cuda11
    • TensorRT 8.4.3.1

    64位Windows环境下cuDNN依赖zlib,下载解压后将dll_x64目录下的zlibwapi.dll复制到cuDNNbin目录下

  4. 编译Windows样例

支持CUDA和TensorRT的Solutions

  • Face Detection
  • Hand Tracking
  • Pose Tracking
  • Holistic Tracking

TODO

  • face_landmark_with_attention模型无法使用

BUG

  1. 编译使用CPU的样例,也依赖onnxruntime.dll(如果有人知道如何解决,欢迎PR)。

开源许可

其他

如果LOGO或开源许可侵犯了您的权益,请立即联系我,谢谢。

mediapipe's People

Contributors

priankakariatyml avatar schmidt-sebastian avatar kinarr avatar kuaashish avatar liuyulvv avatar camillol avatar ziyeqinghan avatar nikolaychirkov avatar markmcd avatar khanhlvg avatar acozzette avatar lucifertrj avatar ktonthat avatar alankelly avatar cmcclanahan avatar joefernandez avatar cushon avatar agrue avatar ayushgdev avatar fergushenderson avatar fredrec avatar impjdi avatar lu-wang-g avatar mhays-google avatar mkruskal-google avatar qlzh727 avatar chuoling avatar vrabaud avatar

Stargazers

王正道 zhengdao.wang avatar 陈粤雄 avatar

Forkers

areshhh

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.