Giter VIP home page Giter VIP logo

omni's Introduction

OMNI: Open-endedness via Models of human Notions of Interestingness [Arxiv] [Website] [Tweet]

omni.mp4

This is the source code repository for the OMNI: Open-endedness via Models of human Notions of Interestingness paper. OMNI utilizes large (language) models as a model of interestingness, because they already internalize human concepts of interestingness from training on vast amounts of human-generated data. This repository implements OMNI on a procedurally generated 2D gridworld gomain Crafter.

Code Layout

  • crafter/ folder contains Crafter environment code
  • envs/ folder contains different environment settings presented in the paper
    • env_<tasks in env>_<method>.py scripts
    • tasks in env can be: tr (repetitive), trc (repetitive and compounds), trs (repetitive and synonyms)
    • methods can be: uni (uniform sampling), lp (learning progress), omni (OMNI), omoi (oracle)
  • moi_saved/ folder contains the processed data from cached GPT-3 predictions
  • evaluate.py script is used for visualizations and evaluations of a trained agent
  • generate_plots.py script is used to generate the plots presented in the paper
  • model.py specifies the model architecture
  • train.py script is used to train the reinforcement learning agent

Setup

Clone the repository with git clone <repo_url> && cd omni_code.
Create python virtual environment python3 -m venv venv.
Activate python virtual environment source venv/bin/activate.
Install dependencies pip install -r requirements.txt.

Training

Run train.py script with the necessary args:

python train.py --model <model_name> --env <env_name>

For example, in the repetitive task setting
Uniform: python train.py --model tr_uni-1 --env tr_uni --seed 1
LP: python train.py --model tr_lp-1 --env tr_lp --seed 1
OMNI: python train.py --model tr_omni-1 --env tr_omni --seed 1

Evaluation

Run evaluate.py script with the necessary args:

python evaluate.py --model <model_name> --env <env_name>

Crafter GUI

Run crafter/run_gui.py script with the necessary args:

python crafter/run_gui.py --env <env_name>

Acknowledgements

This codebase draws inspiration from the following codebases:

Citation

@article{zhang2023omni,
  title={OMNI: Open-endedness via Models of human Notions of Interestingness},
  author={Jenny Zhang and Joel Lehman and Kenneth Stanley and Jeff Clune},
  year={2023},
  journal={arXiv preprint arXiv:2306.01711},
}

omni's People

Contributors

jennyzzt avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.