Giter VIP home page Giter VIP logo

fruit-nerf's Introduction

fruit-NeRF

This project implements a custom NeRF (Neural Radiance Fields) model for creating a 3d model using the input images of frruit images taken in my bedroom. The NeRF model taken a bunch of images and its camera poses information to create a 3d model of the scene. COLMAP was used to generate the pose information from the fruit images.

Results

  • results as the training progress, (gif)

  • final 360-degree scene, (gif)

Extracting camera poses from COLMAP and implementing NERF:

  • Download and install the COLMAP using the pre-built binaries or from source.
  • Download the colmap2nerf.py script from NVlab’s instant-ngp github.
  • Make sure you have the colmap2nerf.py script and your custom images folder in the same directory.
  • From your terminal run your colmap2nerf.py script with required arguments including the path to the folder containing your input images for which you want to get the camera poses. Example command- python colmap2nerf.py --colmap_matcher exhaustive --run_colmap --aabb_scale 16 --images imagesfoldername
  • This should result in a bunch of files in the same directory. The camera poses can be found in transform.json file that has info about each image frame like its path and computed pose matrix.
  • Useful documentation
  • Once you successfully have the transform.json file with all the pose matrices for each image frame. You can use the same nerf code to train your nerf model. You may have to change a bit of the code as now you are reading images from an image folder and camera poses, focal length from transform.json file.
  • You actually need to compute the focal length as the transform.json file only has the camera_angle_x(beta) and camera_angle_y(alpha) values.
image

fruit-nerf's People

Contributors

tusharparimi avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.