Giter VIP home page Giter VIP logo

pytorch-on-phx's Introduction

Running DL project with pyenv+pytorch+tensorboardX on Phoenix HPC

Table of Contents

Phoenix Login

Register for an account by submitting a form on this page.

After your account is activated, login clone this project and copy phx/.bashrc into your home folder.

$ git clone https://github.com/stanstarks/pytorch-on-phx
$ cd pytorch-on-phx; cp phx/.bashrc ~
$ source ~/.bashrc

Install pyenv

Pyenv is an easy to use Python version management tool integrating virtualenv and Anaconda. To install it, simply use pyenv installer.

Since there is limited space under home folder on phx. It is recommended to install pyenv under /fast partition. To so do, set PYENV_ROOT environment variable to be your fast folder:

$ echo 'export PYENV_ROOT=/fast/users/a17XXXXX/.pyenv' >> ~/.bashrc
$ source ~/.bashrc

Now you can install pyenv from Git:

$ curl -L https://github.com/pyenv/pyenv-installer/raw/master/bin/pyenv-installer | bash

Remember to make pyenv take effect by modifying .bashrc again:

$ echo 'export PATH="$PYENV_ROOT/bin:$PATH"\neval "$(pyenv init -)"\n eval "$(pyenv virtualenv-init -)"
source ~/.bashrc

How we can install desired Python version. The best behaviour is to use conda mostly because of off the shelf mkl support. However, latest conda-3 uses Python 3.7 which is not officially supported by TensorFlow. So just install 3.6.6 for now.

pyenv install 3.6.6

Use this python globally:

pyenv global 3.6.6

Install PyTorch

We will use PyTorch in this demo. Install it with conda:

pip install torch torchvision

We will use tensorboardX for visualization:

pip install git+https://github.com/lanpa/tensorboardX

Run pytorch on Phoenix

Please refer to word_language_model folder for further instructions.

pytorch-on-phx's People

Contributors

stan-haochen avatar stanstarks avatar

Watchers

 avatar  avatar

Forkers

qingpingzheng

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.