Giter VIP home page Giter VIP logo

basilisk's Introduction

Basilisk

Basilisk is a plugin to help orchestrate simultaneous motion capture for Live Link and Rokoko, and help automate the importing process.

Setup

This is NOT a plug-and-play plugin, and some manual setup is required. Knowledge of C++, blueprints, python and conda environments helps a lot. We can't really offer support on this plugin, since we are heads-down focused on our own project.

Metahuman Identity Setup

  1. You will need to set up your own metahuman identity. You should put this in Basilisk Content/Capture/Actors. See https://www.youtube.com/watch?v=qPhn28Jk3Mo for a setup tutorial.
  2. Afterwards, edit Basilisk Content/Capture/MH_Performance_Importer and set the metahuman identity to your new identity.

Retargeting Setup

  1. Set up Basilisk Content/MocapImporter/BP_MocapImporter with all of the necessary UE4, UE5, and metahuman retargeters and skeletons
  2. Edit the ExampleMetahumanEntry in the same BP to reference your target metahuman skeleton. In addition, set up the Respeecher name (based on the character in Respeecher), or set the ElevenLabs name (based on what you named it in your library). Be sure to go into C++ and make sure the correct retargeter is active, currently its defaulting to Respeecher.

Conda Setup

The python scripts in this library are expected to run under the PantomimeVoice conda environment. There is a yml file to set this up, so just follow standard Conda tutorials.

Importer Setup

  1. Right Click Basilisk Content/BP_BasiliskUtilityWidget and run the editor utility widget. Press the yellow icons to set the folders for: a) Your face mocap import path (this will be created once you start importing iPhone data from your phone) b) Your body mocap path (ie Rokoko export folder) c) Your conda root path. Generally this is C:/Users/zacha/anaconda3/envs

Phone Shortcuts Setup

Refer to the video for shortcut setup https://youtu.be/rPDjWxF4Qyg

Phone Voice Commands Setup

Refer to the video for voice command setup https://youtu.be/rPDjWxF4Qyg

Live Link / iPhone Importing Setup

Refer to the video for OSC server setup https://youtu.be/rPDjWxF4Qyg Set up Basilisk Content/Capture/Devices/CS_iPhoneCapture0 to point to your iPhone IP. I suggest making a bunch of these to cover the entire local IP range that your phone may be.

basilisk's People

Contributors

zcanann avatar

Stargazers

Matthew Bucci avatar Jarod Castillo avatar

Watchers

Nathan Lewis avatar Matthew Bucci avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.