Giter VIP home page Giter VIP logo

multi_worker's Introduction

MultiWorker

Build Status Code Climate Dependency Status

MultiWorker provides a common interface to the (many) Ruby queueing/worker libraries. They are all very similar, but provide slightly different interfaces. This makes it difficult to switch from one library to another, or to use multiple libraries at the same time.

Similar to MultiJSON or ExecJS, MultiWorker automatically detects installed queuing libaries and the correct adapter is loaded up by default. Changing queueing libraries does not require any change to worker code, as long as the standard interface is used.

Installation

Add this line to your application's Gemfile:

gem 'multi_worker'

And then execute:

$ bundle

Or install it yourself as:

$ gem install multi_worker

Basic Usage

Define worker

require 'sidekiq'
require 'multi_worker'

class ExampleWorker
  worker

  def perform(foo, bar)
    # long running code
  end
end

Queue jobs

ExampleWorker.perform_async(1, 2)
# Equivalent:
MultiWorker.enqueue(ExampleWorker, 1, 2)

Work jobs

Add to Rakefile:

require 'resque'
require 'multi_worker/tasks'

# If not using Rails, define your own :environment task that will require dependencies
task :environment do
  require 'resque'
end

Run:

QUEUE=default rake multi_worker:work

Advanced Configuration

MultiWorker.configure do
  default_queue :processing
  default_adapter :resque
  default_options :retry => true
end

class AdvancedWorker
  worker :queue => :background, :unique => true, :adapter => :sidekiq

  def perform(foo)
    ...
  end
end

Feature Comparison

Library Backends Status Retry Lock Unique Scheduling Priority Async Method Proxy Rake Task Inline
Resque Redis Gem Gem Gem Gem Gem Gem
Sidekiq Redis Gem Gem Gem
Delayed Job Active Record, Mongo
Qu Redis, Mongo, SQS
Queue Classic PostgreSQL
Que PostgreSQL
Toro PostgreSQL
Sneakers RabbitMQ
TorqueBox Backgroundable HornetQ
Backburner Beanstalkd
Threaded in Memory Queue In-Memory N/A
Sucker Punch In-Memory N/A
Inline N/A N/A

Contributing

  1. Fork it ( http://github.com/dwbutler/multi_worker/fork )
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

multi_worker's People

Contributors

dwbutler avatar

Watchers

brucexlin avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.