venkath Goto Github PK

30problems

awesome-machine-learning

A curated list of awesome Machine Learning frameworks, libraries and software.

connectors

Connectors for Delta Lake

daft

Distributed DataFrames for Python designed for the cloud, powered by Rust

databrickscontent

Examples surrounding Databricks.

dataframe-rules-engine

Extensible Rules Engine for custom Dataframe / Dataset validation

dbx

CLI tool for advanced Databricks jobs management.

delta

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

deltaray

Delta reader for the Ray open-source toolkit for building ML applications

docker-spark

Apache Spark docker image

hibench

HiBench is a big data benchmark suite.

kafka-delta-ingest

A highly efficient daemon for streaming data from Kafka into Delta Lake

lakescum

A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.

machine-learning-notebook-series

Jupyter notebook series for machine learning and deep learning.

oap

Optimized Analytics Package for Spark* Platform

papers-literature-ml-dl-rl-ai

Highly cited and useful papers related to machine learning, deep learning, AI, game theory, reinforcement learning

phoenix

Mirror of Apache Phoenix

phoenix-connectors

Apache Phoenix Connectors

pstl

Parallel Streaming Transformation Loader

python-and-rust-tools

Introduction to Command-line tools with Python and Rust

rust-mlops-template

A work in progress to build out solutions in Rust for MLOPs

spark-adaptive

spark-expectations

A Python Library to support running data quality rules while the spark job is running⚡

spark-kafka-vertica

A template for connecting Vertica and Kafka using Spark (Batch mode and Structured Streaming)

spark-notes

spark-perf

Performance tests for Apache Spark

streamingbench

A streaming benchmark supporting Flink and Spark

sumac

Argument parsing in Scala