Giter VIP home page Giter VIP logo

sysmocap's Introduction

banner

SysMocap

GitHub Actions release forks stars

English Version | 中文版本

A cross-platform real-time video-driven motion capture and 3D virtual character rendering system for VTuber/Live/AR/VR.

Available for Windows, macOS (including Apple Silicon & Intel) & Linux (source code only)

Download Now

(This is a multi-language software, including English and Chinese. )

Highlights

🌟 Beautiful GUI with Material Design 3 Color System, with Dark Mode supported.

UI UI-dark

🌟 Easy to used. You can import 3D models just with drags.

add-model-drag.mp4

🌟 Support WebXR API on Mocap Forwarding (HTTPS only)

webxr-ar-demo.mp4

🌟 Model viewer with bones & dressing controller

Model viewer

🌟 Support OBS live-streaming

OBS

🌟 Support full-body motion capture

Full-body

Full-body-animotion

🌟 Support Auto Skeleton Detection for All VRM files (including VRM 0.x and VRM 1.0) and Mixamo Format FBX files

fbx-mixamo-animotion

🌟 Support Any Skeleton Structure with Manual Mapping

bdd-animotion

🌟 You can use VRoid Studio to create your avatar very easily. Supporting VRM 0.x & 1.0!

vroid

More Effect Demonstration

🌟 Facial

Facial-animotion

🌟 Half-body

Half-body-animotion

🌟 Half-body with Hands

Half-body with Hands animotion

🌟 Full-body

Full-body-animotion

System architecture

System architecture

How to Download prebuilt package (Windows & macOS):

Download Now

1. Windows Portable Version: Simply extract the archive and run SysMocap.exe.

  • SysMocap-Windows-x64-<version>.7z: Windows 64-bit version, suitable for x86_64 processors (AMD, Intel, etc.) running 64-bit Windows 10 & 11.

  • SysMocap-Windows-arm64-<version>.7z: Windows ARM 64-bit version, suitable for ARM64 processors (such as Qualcomm Snapdragon) running 64-bit Windows 10 & 11.

2. Windows Installer: Double-click to install.

Snipaste_2024-07-07_20-56-11
  • SysMocap-Windows-x64-installer-<version>.msi: Windows 64-bit version, suitable for x86_64 processors (AMD, Intel, etc.) running 64-bit Windows 10 & 11.

  • SysMocap-Windows-arm64-installer-<version>.msi: Windows ARM 64-bit version, suitable for ARM64 processors (such as Qualcomm Snapdragon) running 64-bit Windows 10 & 11.

3. macOS DMG Image: Drag SysMocap.app to the Applications folder.

Snipaste_2024-07-07_20-56-11
  • SysMocap-macOS-x64-<version>.dmg: Suitable for Apple computers with Intel chips and Hackintosh devices, running macOS 10.15 or later.

  • SysMocap-macOS-arm64-<version>.dmg: Suitable for Apple computers with M series chips (Apple Silicon).

Note for user on macOS:

  • You need set Gatekeeper to Anywhere in System Settings (using sudo spctl --master-disable) image

  • If you got “SysMocap” is damaged and can’t be opened. You should move it to the Trash. Please run sudo xattr -r -d com.apple.quarantine /Applications/SysMocap.app in your terminal

How to run from source code (need lastest Node.js):

git clone https://github.com/xianfei/SysMocap.git
cd SysMocap
npm i
npm start

Notice

  1. HTTP & HTTPS will use same port in Mocap Data Forward.

Required Skeleton Node in glTF/glb/FBX Model File for Macap:

(If not same as above, you need rebind them manually.)

  • Hips (Main Node, both Position and Rotation. Ratation only for other nodes)

  • Neck

  • Chest

  • Spine

  • RightUpperArm

  • RightLowerArm

  • LeftUpperArm

  • LeftLowerArm

  • LeftUpperLeg

  • LeftLowerLeg

  • RightUpperLeg

  • RightLowerLeg

Star History

Star History Chart

Thanks

You can see all dependencies in package.json

Cite

@INPROCEEDINGS{9974484,
  author={Song, Wenfeng and Wang, Xianfei and Gao, Yang and Hao, Aimin and Hou, Xia},
  booktitle={2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)}, 
  title={Real-time Expressive Avatar Animation Generation based on Monocular Videos}, 
  year={2022},
  volume={},
  number={},
  pages={429-434},
  doi={10.1109/ISMAR-Adjunct57072.2022.00092}}

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.