Giter VIP home page Giter VIP logo

onyx's Introduction

Logo Onyx

Join the chat at https://gitter.im/onyx-platform/onyx

What is it?

  • a masterless, cloud scale, fault tolerant, high performance distributed computation system
  • batch and stream hybrid processing model
  • exposes an information model for the description and construction of distributed workflows
  • Competes against Storm, Cascading, Cascalog, Spark, Map/Reduce, Sqoop, etc
  • written in pure Clojure

What would I use this for?

  • Realtime event stream processing
  • Continuous computation
  • Extract, transform, load
  • Data transformation à la map-reduce
  • Data ingestion and storage medium transfer
  • Data cleaning

Installation

Available on Clojars:

[org.onyxplatform/onyx "0.9.1"]

Build Status

Component release unstable compatibility
onyx core Circle CI Circle CI -
onyx-kafka Circle CI Circle CI Circle CI
onyx-datomic Circle CI Circle CI Circle CI
onyx-redis Circle CI Circle CI Circle CI
onyx-sql Circle CI Circle CI Circle CI
onyx-bookkeeper Circle CI Circle CI Circle CI
onyx-seq Circle CI Circle CI Circle CI
onyx-durable-queue Circle CI Circle CI Circle CI
onyx-elasticsearch Circle CI Circle CI Circle CI
onyx-amazon-sqs Circle CI Circle CI Circle CI
onyx-http Circle CI Circle CI Circle CI
learn-onyx Circle CI - Circle CI
onyx-examples Circle CI Circle CI Circle CI
onyx-dashboard Circle CI Circle CI Circle CI
  • release: stable, released content
  • unstable: unreleased content
  • compatibility: edge, unstable, unreleased content depending on core master

Companies Running Onyx in Production

<img src="doc/images/cognician.png" height"30%" width="30%">                    <img src="doc/images/indaba.png" height"40%" width="40%">                   

Quick Start Guide

Feeling impatient? Hit the ground running ASAP with the onyx-starter repo and walkthrough. You can also boot into preloaded a Leiningen application template.

User Guide 0.9.1

Developer's Guide 0.9.1

API Docs 0.9.1

Code level API documentation can be found here.

Official plugin listing

Official plugins are vetted by Michael Drogalis. Ensure in your project that plugin versions directly correspond to the same Onyx version (e.g. onyx-core-async version 0.9.1 goes with onyx version 0.9.1). Fixes to plugins can be applied using a 4th versioning identifier (e.g. 0.9.1.1).

Generate plugin templates through Leiningen with onyx-plugin.

3rd Party plugin listing

Unofficial plugins have not been vetted.

Offical Dashboard and Metrics

You can run a dashboard to monitor Onyx cluster activity, found here. Further, you can collect metrics and send them to the dashboard, or anywhere, by using the onyx-metrics plugin.

Need help?

Check out the Onyx Google Group.

Want the logo?

Feel free to use it anywhere. You can find a few different versions here.

Running the tests

A simple lein test will run the full suite for Onyx core.

Contributor list

Acknowledgements

Some code has been incorporated from the following projects:

License

Copyright © 2015 Michael Drogalis

Distributed under the Eclipse Public License, the same as Clojure.

Profiler

YourKit

YourKit supports open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of YourKit Java Profiler and YourKit .NET Profiler, innovative and intelligent tools for profiling Java and .NET applications.

onyx's People

Contributors

lbradstreet avatar michaeldrogalis avatar gardnervickers avatar davidrupp avatar bridgethillyer avatar metasoarous avatar oleschoenburg avatar danielcompton avatar mushketyk avatar nathants avatar tvanhens avatar leathekd avatar vijaykiran avatar mccraigmccraig avatar gigafone avatar tiensonqin avatar gitter-badger avatar reaperhulk avatar owengalenjones avatar malcolmsparks avatar noisesmith avatar rosejn avatar iperdomo avatar otfrom avatar kendru avatar

Watchers

lemonhall avatar James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.