Giter VIP home page Giter VIP logo

terryky / tfjs_webgl_app Goto Github PK

View Code? Open in Web Editor NEW
382.0 17.0 94.0 377.13 MB

Realtime TensorFlow.js + WebGL visualization apps. 3D Hand pose estimation, 3D Human pose estimation, Face swap, Depth estimation, Higher accuracy face detection.

Home Page: https://terryky.github.io/tfjs_webgl_app/

JavaScript 92.86% HTML 4.83% CSS 2.30%
tfjs-webgl handpose blazepose facemesh tensorflowjs

tfjs_webgl_app's Introduction

tfjs_webgl_app

WebGL visualization apps using TensorFlow.js

Handpose

Live demo is here.

3D Pose estimation

Live demo is here.

FaceSwap (face-landmarks-detection)

Live demo is here.

U^2-Net portrait drawing

Live demo is here.(not stable)

Blazepose (upper_body)

Live demo is here.

Blazepose (full_body)

Live demo is here.

Face Segmentation (BiseNetv2)

Live demo is here.

Depth Estimation (DenseDepth)

Live demo is here.

Higher Accuracy Face Detection (DBFace)

Live demo is here.

Age and Gender estimation

Live demo is here.

Classification

Live demo is here.

Acknowledgements

tfjs_webgl_app's People

Contributors

terryky avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

tfjs_webgl_app's Issues

Blazepose full body

Hey, I've checked the demos you implemented, impressive work! Thanks for sharing.

I'd like to ask, where did you get the weights in blazepoze full body ?

I have checked this repo but it appears to me that there are only weights for the upper_body model and the pose detector over there.

Thanks in advance!

respect face mask png transparency

i added an option to use png face mask with transparency for the faceswap demo. this is useful when the mask contour exceeds the actual face and includes some of the background. in this case, allowing a transparent background in the mask allows a much cleaner effect. i changed in https://github.com/eyaler/tfjs_webgl_app/blob/master/face_landmark/render_facemesh.js#L32

void main(void)
{
    vec4 color;
    color = vec4(texture2D(u_sampler, v_texcoord));
    color[0] *= u_color[0];
    color[1] *= u_color[1];
    color[2] *= u_color[2];
    color[3] *= v_vtxalpha * u_alpha;
    gl_FragColor = color;
}

you can see it in work in my fork for offline videos: https://eyaler.github.io/tfjs_webgl_app/face_landmark
thanks for your awesome work! i learnt a lot from you!

I am running an error.

I have reported an error after I run your project. I look up this question online, saying that my element is not set to high. But I have seen the DOM, how to solve this problem.This is an error message
Requested texture size [0x0] is invalid

Question: BlazePose fullbody z coordinates

Hey!

First of all, thank you very much for sharing your work, it has helped guide my project more than you can know.

I have a question about full body joint estimation.

If I'm not wrong, the landmark model provides (x,y,z) triplets as outputs. However you only seem to be using the (x,y) coordinates in post processing and drawing of joint key points. Why is that? Shouldn't one be computing a 2D projection using the z dimension as well?

Thanks in advance!

failed to load model

I click on the home page of handpose and display failed to load model after loading for a period of time

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.