Giter VIP home page Giter VIP logo

icos-ai-dataclay's Introduction

dataClay and PyTorch --an opinionated and probably inaccurate quickstart

Let's start with a disclaimer: I am not really a PyTorch expert (or a ML expert or anything like that). So if there are things that do not make sense, probably I am wrong. However, I did my best by following the example on Vision Transformer.

Start

Preparing the environment

I recommend to work in a virtual environment. Note that the requirements.txt is intended to be used both by the Docker image build and the Jupyter Notebook. Simply prepare a virtual environment, e.g.:

$ python3 -m venv venv
$ source venv/bin/activate
$ pip install -r requirements.txt

Starting dataClay

A docker-compose.yml is provided for convenience (it is a overly simplified deployment):

$ docker compose up

Feel free to use docker-compose instead of docker compose, or add -d flag to have it on the background, or use whatever flow suits your tastes.

Training a sample model

Assuming that you have activated the virtual environment, just open Jupyter Notebook and open the Train.ipynb. It shows the steps to connect to dataClay (the port is the default and opened by docker-compose) and prepare a sample torch Neural Network.

Development cycle

Typically, you will change stuff on the model folder. This means that you need to restart the Jupyter Notebook kernel (to force re-import of modules). dataClay backend also needs to be restarted, and you can do that with Docker as follows:

$ docker compose restart dataclay-backend

icos-ai-dataclay's People

Contributors

alexbarcelo avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.