Giter VIP home page Giter VIP logo

kimbyungsang / pipeline Goto Github PK

View Code? Open in Web Editor NEW

This project forked from pipelineai/pipeline

0.0 2.0 0.0 3.21 GB

PipelineAI: End-to-End ML and AI Platform for Real-time Spark and Tensorflow Data Pipelines

Home Page: http://pipeline.ai

License: Apache License 2.0

Scala 0.23% Shell 0.14% Java 0.07% Python 0.19% Groovy 0.03% PLpgSQL 0.01% PLSQL 0.01% CSS 0.11% JavaScript 0.12% HTML 98.31% Batchfile 0.04% XSLT 0.05% ApacheConf 0.01% Jupyter Notebook 0.25% Cuda 0.01% Protocol Buffer 0.42% Makefile 0.01% Go 0.01%

pipeline's Introduction

PipelineIO

Built with Love and Scale by ex-Netflix, Databricks, and Tensorflow Engineers

Tensorflow Databricks Netflix

Videos

Resources

Documentation

Workshops

Sign Up Now!

Workshop Architecture

Workshop Tools

Quick Start

Local Laptop

Kubernetes Mini + PipelineIO Cluster for your Laptop

  • PipelineIO Local (Local Laptop)

Kubernetes Docker

Kubernetes + PipelineIO Cluster on any Cloud or Data Center

  • Pipeline on AWS

AWS

Google Cloud Platform

Azure

Global 24x7 Support for Everyone!

Reference Architecture

Reference Architecture

Other Features

100% Open Source

Jupyter ZeppelinZeppelin Spark Tensorflow

100% Open Source using Kubernetes + Docker

PipelineIO Kubernetes Kubernetes Docker

PMML + Native C++/Java Code Generation for Optimized CPU/GPU Performance

Generate and Optimize Spark ML Model Nvidia GPU Intel CPU

Deploy directly from Jupyter Notebook to Hybrid-Cloud Microservices

Deploy Spark ML Model to Production

NetflixOSS-based Microservices for High Scalability and Availability

NetflixOSS-based Microservices

Continuous Train/Deploy Spark ML and Tensorflow AI Pipelines to Production

Kafka Kinesis KINESIS

Community

Global Advanced Spark and Tensorflow Meetup

Meetup

Slideshare Slides

Slideshare

YouTube Videos

YouTube

Docker Images

Docker

pipeline's People

Contributors

cfregly avatar uover82 avatar retroryan avatar velvia avatar mistobaan avatar andyzeli avatar ras44 avatar adrinjalali avatar andypetrella avatar drathm-resly avatar

Watchers

James Cloos avatar Sam avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.