Giter VIP home page Giter VIP logo

ml_for_trading's Introduction

Work in progress. This documentation being improved

Index

Main idea

This is a software that handles the next scenarios

  • Download and preprocess historical data for stock markets
  • Create Machine learning model for prediction future price movement
  • Tune hyperparameters of the model and data preprocessing
  • Use UI to manage training/tuning jobs
  • Save results of every execution for future analysis
  • Pick best runs and deploy for productive trading

All together this solution covers end-to-end process.

Installation

So far there is no pip package published so the only way now is to clone this repo

In order to launch optimization jobs you would need to

Prepare data

  • download orderlog files for needed tickers from here
  • convert it from qsh to bin format via this tool

Store data

Either local filesystem (fast, not scalable) or S3 storage

Place to store experiments and results

Create a Mongo instance and to add credentials to ./py/config.py. Some hosting options with free tiers

Structure of the repo

  • ./py folder has python scripts with main logic
  • ./flask_ui scripts that do start a server with UI for scheduling experiments and tracking their results
  • ./docker has Dockerfiles for lua tests (bot) and for running tuning jobs

Start using

The easiest way is to add experiments via UI on locally hosted Flask server and locally launch a Docker container that will start worker. And worker will pick the next job that is ready for processing

Useful links

Data

Useful libraries

Parameters tuning

Trade history

Bot creation

LUA

Engineering and infrastructure

DB

Flask admin

VPS

Deployment

ml_for_trading's People

Contributors

evgenyarn avatar evgeny7777 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.