rangadi Goto Github PK

armeria

Asynchronous RPC/REST library built on top of Java 8, Netty, HTTP/2, Thrift and gRPC

beam

Mirror of Apache Beam

cascading

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing workflows on a Hadoop cluster.

dataflowjavasdk

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

dataflowpythonsdk

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

dataproc-initialization-actions

Run in all nodes of your cluster before the cluster starts - let's you customize your cluster

delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

elephant-bird

Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

flink-dataflow

Google Dataflow Runner for Apache Flink

hadoop-common

Mirror of Apache Hadoop common

hadoop-lzo

Patched, refactored version of code.google.com/hadoop-gpl-compression for hadoop 0.20

hive

Mirror of Apache Hive

kafka

Mirror of Apache Kafka

lzo-split

misc

modeldb

A system to manage machine learning models

presto

Distributed SQL query engine for running interactive analytic queries against big data sources.

scio

A Scala API for Google Cloud Dataflow

scribe

Scribe is a server for aggregating log data streamed in real time from a large number of servers. It is designed to be scalable, extensible without client-side modification, and robust to failure of the network or any specific machine.

shaded-protobuf-classes

A tiny project to create shaded Protobuf Java classes suitable for Spark's Protobuf connector

snakebite

A pure python HDFS client

spark

Apache Spark

summingbird

Streaming MapReduce with Scalding and Storm

trevni

a column file format

zkclient

a zookeeper client, that makes life a little easier.

zookeeper

Mirror of Apache Hadoop ZooKeeper