Giter VIP home page Giter VIP logo

multizoomgaze's Introduction

360-Degree Gaze Estimation in the Wild Using Multiple Zoom Scales

About

This code is for the paper 360-Degree Gaze Estimation in the Wild Using Multiple Zoom Scales. By using this code you agree to terms of the LICENSE.

Setting up the environment.

Use the conda to create a new environment using the given .yml file. In case conda is not installed on your system, you can install it from here. Once conda is installed, use the following code to create an environment with all dependencies installed.

conda env create -f multizoomgaze_env.yml

Downloading the pre-trained checkpoint files.

Download the checkpoint files from here.

Predicting the gaze on a random image.

Use this notebook to predict gaze direction in a random image.

Setting up the Gaze360 database.

Register here which will then give you access to the database.

Evaluating the model performance on Gaze360 dataset.

MSA+Seq

python run.py --model_type=NonLstmSinCosModel  --enable_time --checkpoints_path=CKECKPOINT_DIRECTORY/ --source_path=/data/GAZE360/imgs/ --evaluate

MSA

python run.py --model_type=NonLstmSinCosModel --checkpoints_path=CKECKPOINT_DIRECTORY/ --source_path=/data/GAZE360/imgs/ --evaluate

MSA+raw

python run.py --model_type=NonLstmMultiCropModel --checkpoints_path=CKECKPOINT_DIRECTORY/ --source_path=/data/GAZE360/imgs/ --evaluate

Pinball Static

python run.py --model_type=StaticModel --checkpoints_path=/home/ashesh/gaze_final_checkpoints/ --evaluate

Here, checkpoints_path is the directory where you've saved the trained checkpoint files. source_path is the directory which contains gaze360 data.

Training the model

Just remove the --evaluate token from the command for evaluating the model performance which is given in the previous section. In this case, checkpoints_path will be the path where your checkpoints will get saved.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.