Giter VIP home page Giter VIP logo

lifecast_public's Introduction

Open soure immersive volumetric media by lifecast.ai

Lifecast is dedicated to pushing the limits of immersive volumetric media. We created a new format for volumetric photos and videos called 'ldi3' which enables real-time 6DOF photorealistic rendering on a wide variety of platforms.

Visit https://lifecast.ai for some demos of what can be done with ldi3 and NeRF, which work on Vision Pro and Quest!

There are a lot of ways to create and edit ldi3. In the /nerf directory, we provide an open source nerf video engine that compresses into ldi3 for web streaming of volumetric/holographic video. We also offer some commercial software for working with ldi3:

  • Volurama - a Windows/Mac GUI for the NeRF engine here, for reconstructing static scenes from iPhone video input.
  • Volumetric Video Editor - Windows/Mac tool for converting VR180 to ldi3 (not NeRF-based, uses fisheye stereo depth estimation).
  • holovolo.tv - text-to-ldi3 with Stable Diffusion

Volumetric Video Player for WebGL / WebXR / Javascript

Here is a minimal example of embedding Lifecast ldi3 player in a div. For more examples, check out the /web directory.

<html>
  <head>
  <script src="https://cdn.jsdelivr.net/gh/fbriggs/lifecast_public/lifecast.min.js"></script>
  </head>
  <body>
  <div id="player_div" style="width: 600px; height: 500px;"></div>
  <script>
  LifecastVideoPlayer.init({
    _media_urls: ["https://lifecast.ai/media/orrery_transp_ldi3.jpg"],
    _embed_in_div: "player_div",
  });
  </script>
  </body>
</html>

For more examples, see the web/ directory of this repo.

Notable forks:

Volumetric Video Player for Unreal Engine

Download project files: https://github.com/fbriggs/lifecast_public/raw/main/UnrealEngine5/Lifecast_LDI3_Player_UE5.1.zip

Tutorial: https://www.youtube.com/watch?v=ekEXxo1neVo

Volumetric Video Player for Unity

Download sample project: https://drive.google.com/file/d/197Ea3MHUKMsS4BUy86iVwGukmClV0V_9/view?usp=share_link

lifecast_public's People

Contributors

fbriggs avatar lwneal avatar remmel avatar cogwheel avatar

Stargazers

DapengFeng avatar Florian avatar JUJU avatar Valerio avatar FangXianze avatar Steve Phillips avatar  avatar Xiang Zhang avatar Arvin Tehrani avatar HwanHeo avatar Ganesh Gopalkrishna Hegde avatar Lin avatar ernest avatar Hblee avatar  avatar Ankur Roy Chowdhury avatar  avatar Blessing Agyei Kyem avatar  avatar Anton Marini avatar usmanov Khabibullo o'gli avatar arpu avatar Burkersroda, Ronny avatar Xiaoyuan Wang avatar  avatar Marcelo Moyano avatar lizhan avatar  avatar  avatar  avatar Ari avatar MoniGarr avatar  avatar Enclavia Labs avatar Bruno ✌️ avatar Airlamb avatar  avatar Tao Xie avatar Draxi avatar fanjing8 avatar 爱可可-爱生活 avatar StemCloud Media avatar Alexander Kristoffersen avatar lenville avatar Alireza avatar minamik avatar Boris avatar Thomas Rosen avatar K avatar James Mitchell avatar zoooooooooo avatar Ben Emma avatar Akbar S. avatar John Bowditch avatar Peter Baylies avatar Chen Yuan avatar Chadi Salmi avatar Jürgen R. Plasser / ThetaPhiPsi avatar Jean-Philippe Deblonde avatar Ruofei Du avatar  avatar Steve Van Loon avatar Tony Morales avatar netop://ウエハ avatar Jonathan Chemla avatar  avatar  avatar  avatar  avatar  avatar YiChenCityU avatar  avatar  avatar  avatar  avatar Renaud Bouckenooghe avatar Rahman Ramsi avatar  avatar Hakeem Demi avatar Lingzhe Zhao avatar EddieJeong avatar maturk avatar  avatar Leonard avatar Alexandre Morgand avatar Godzilla avatar Patricio Gonzalez Vivo avatar Yunsheng Luo avatar yuzy avatar william avatar Li Jie avatar Ben Hazan avatar Josep Alemany avatar Ahmet Şahin Yener avatar William avatar Quan avatar Austin avatar Paul Fidika avatar Sam Whitford avatar EmanuelRC avatar

Watchers

Mark Domino avatar  avatar Ben avatar  avatar Jiaming Sun avatar Arvin Tehrani avatar Rahul Y Gupta avatar Ajwad avatar maturk avatar Hervé Le Meur avatar

lifecast_public's Issues

Be able to use import lifecast in existing project

Currently, this is difficult to use lifecast in existing THREE js project because :

  • depend (commited) to THREE.js and specific version (If you use it in existing project, THREE js will be loaded multiple time)
  • cannot access to LifecastVideoPlayer or HTMLVideoElement
  • code related with player interaction is in same class than the one creating the Mesh / Object3D

I'll push some PR in order to make it easy to be imported

A-Frame Component and Simplified Three.js Example...

Hi! First of all thank you for such a wonderful open-source repository with volumetric video and photo examples. I wanted to let you know that based on the web examples provided I was able to develop basic component for A-Frame and a simplified version of the player for Three.js. A-Frame component is work in progress but feel free to share link to it in your repo.

See here: https://github.com/akbartus/A-Frame-LifeCast-Volumetric-Player-Component

Thank you.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.