Giter VIP home page Giter VIP logo

apirepl's Introduction

ApiRepl

What it is

If you want API data copied to your database, the workers should fetch for you elastically.

Setup

Database Requirement

use schema.sql to create a database, and load it with the types of information you need

Subclass BaseWorker

see samples/usage.py for an example. Create an api method and save method for your workflow by subclassing BaseWorker.

Functionality (requirements)

  • Splits update task into pieces
  • Prioritizes pieces
  • Can be paused and resumed
  • Can scale across hosts easily using DB
  • Good test coverage (soon :) )

Usage

See Sample folder

apirepl's People

Contributors

birm avatar

Watchers

 avatar  avatar  avatar

apirepl's Issues

decouple and generalize

i.e. all state records and specifics should be generalized and moved from where it'd be in the app schema to here

Launch Work Manager

cronable (or jenkins, ansible, whatever you distribute with) should use schema to determine which to run, then launch it

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.