English Version | 中文版本
A cross-platform real-time video-driven motion capture and 3D virtual character rendering system for VTuber/Live/AR/VR.
Available for Windows, macOS (including Apple Silicon & Intel) & Linux (source code only)
(This is a multi-language software, including English and Chinese. )
🌟 Beautiful GUI with Material Design 3 Color System, with Dark Mode supported.
🌟 Easy to used. You can import 3D models just with drags.
add-model-drag.mp4
🌟 Support WebXR API on Mocap Forwarding (HTTPS only)
webxr-ar-demo.mp4
🌟 Model viewer with bones & dressing controller
🌟 Support OBS live-streaming
🌟 Support full-body motion capture
🌟 Support Auto Skeleton Detection for All VRM files (including VRM 0.x and VRM 1.0) and Mixamo Format FBX files
🌟 Support Any Skeleton Structure with Manual Mapping
🌟 You can use VRoid Studio to create your avatar very easily. Supporting VRM 0.x & 1.0!
![vroid](https://private-user-images.githubusercontent.com/8101613/346336657-8847e960-3145-4ee5-b512-53ae8ec74901.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ0NDkwMTUsIm5iZiI6MTcyNDQ0ODcxNSwicGF0aCI6Ii84MTAxNjEzLzM0NjMzNjY1Ny04ODQ3ZTk2MC0zMTQ1LTRlZTUtYjUxMi01M2FlOGVjNzQ5MDEucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgyMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MjNUMjEzMTU1WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NjE2OWFmYmFjNGEwNmM1M2E0MTY2NmI0NDI0YmMxMGQ5NDYzODYzNDRlODUyZWIzYWJkMThlNmU0ZDQ3ODBjOSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.6Sljlnd1Gq01rWhBAL50oXI1O7s3FEgxJmHzx77C4U8)
🌟 Facial
🌟 Half-body
🌟 Half-body with Hands
🌟 Full-body
1. Windows Portable Version: Simply extract the archive and run SysMocap.exe
.
-
SysMocap-Windows-x64-<version>.7z
: Windows 64-bit version, suitable for x86_64 processors (AMD, Intel, etc.) running 64-bit Windows 10 & 11. -
SysMocap-Windows-arm64-<version>.7z
: Windows ARM 64-bit version, suitable for ARM64 processors (such as Qualcomm Snapdragon) running 64-bit Windows 10 & 11.
2. Windows Installer: Double-click to install.
![Snipaste_2024-07-07_20-56-11](https://private-user-images.githubusercontent.com/8101613/346336680-8aa6fda0-5963-41dc-bad9-e28b6a2d7619.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ0NDkwMTUsIm5iZiI6MTcyNDQ0ODcxNSwicGF0aCI6Ii84MTAxNjEzLzM0NjMzNjY4MC04YWE2ZmRhMC01OTYzLTQxZGMtYmFkOS1lMjhiNmEyZDc2MTkucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgyMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MjNUMjEzMTU1WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NmE3YWM4ZmM3MWZjM2I0YzY1YjQ3MzJiZjFkZDcyNjkyZmY5ZDRiNzViYWI3YWMxYWU0MDg4YjllZmVkZmNlMSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.cPXuS2ho6ehh6rgCdewvnJJPtr0Ux4RtHCOr_V3bXGg)
-
SysMocap-Windows-x64-installer-<version>.msi
: Windows 64-bit version, suitable for x86_64 processors (AMD, Intel, etc.) running 64-bit Windows 10 & 11. -
SysMocap-Windows-arm64-installer-<version>.msi
: Windows ARM 64-bit version, suitable for ARM64 processors (such as Qualcomm Snapdragon) running 64-bit Windows 10 & 11.
3. macOS DMG Image: Drag SysMocap.app
to the Applications folder.
![Snipaste_2024-07-07_20-56-11](https://private-user-images.githubusercontent.com/8101613/346336709-7a47820d-5d7c-421f-822e-d02bad2d6f29.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ0NDkwMTUsIm5iZiI6MTcyNDQ0ODcxNSwicGF0aCI6Ii84MTAxNjEzLzM0NjMzNjcwOS03YTQ3ODIwZC01ZDdjLTQyMWYtODIyZS1kMDJiYWQyZDZmMjkuanBnP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgyMyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MjNUMjEzMTU1WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NjAzYmI4YTUzZmZiZTM2ODJmOWJkMWIwYzNhODU1NWJlNTM2OWVkMGU4ZGUzYjY3YWFjMjc2NmVlZTc3NGNhYSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.M4sIJRYFGDH2sgn87UYCQvrTolr0uyU1zIq_DNjptIE)
-
SysMocap-macOS-x64-<version>.dmg
: Suitable for Apple computers with Intel chips and Hackintosh devices, running macOS 10.15 or later. -
SysMocap-macOS-arm64-<version>.dmg
: Suitable for Apple computers with M series chips (Apple Silicon).
Note for user on macOS:
-
You need set Gatekeeper to Anywhere in System Settings (using
sudo spctl --master-disable
) -
If you got
“SysMocap” is damaged and can’t be opened. You should move it to the Trash.
Please runsudo xattr -r -d com.apple.quarantine /Applications/SysMocap.app
in your terminal
git clone https://github.com/xianfei/SysMocap.git
cd SysMocap
npm i
npm start
- HTTP & HTTPS will use same port in Mocap Data Forward.
(If not same as above, you need rebind them manually.)
-
Hips (Main Node, both Position and Rotation. Ratation only for other nodes)
-
Neck
-
Chest
-
Spine
-
RightUpperArm
-
RightLowerArm
-
LeftUpperArm
-
LeftLowerArm
-
LeftUpperLeg
-
LeftLowerLeg
-
RightUpperLeg
-
RightLowerLeg
You can see all dependencies
in package.json
-
google/mediapipe/Holistic for Mocap
-
kalidokit for Calulate Mocap Data
-
electron and Vue.js for GUI Framework
-
Material color utilities for Color Picking
@INPROCEEDINGS{9974484,
author={Song, Wenfeng and Wang, Xianfei and Gao, Yang and Hao, Aimin and Hou, Xia},
booktitle={2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
title={Real-time Expressive Avatar Animation Generation based on Monocular Videos},
year={2022},
volume={},
number={},
pages={429-434},
doi={10.1109/ISMAR-Adjunct57072.2022.00092}}