afranzi Goto Github PK

airbyte

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

airflow-aws-shared-secrets

SecretsManagerBackend with cross-account access

awesome-spark

A curated list of awesome Apache Spark packages and resources.

aws-glue-data-catalog-client-for-apache-hive-metastore

The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog as a central repository to store structural and operational metadata for their data. AWS Glue provides out-of-box integration with Amazon EMR that enables customers to use the AWS Glue Data Catalog as an external Hive Metastore. This is an open-source implementation of the Apache Hive Metastore client on Amazon EMR clusters that uses the AWS Glue Data Catalog as an external Hive Metastore. It serves as a reference implementation for building a Hive Metastore-compatible client that connects to the AWS Glue Data Catalog. It may be ported to other Hive Metastore-compatible platforms such as other Hadoop and Apache Spark distributions

data-access-layer

Library to facilitate accessing Data from Databricks

data-platform-tutorial

Data Platform Tutorial

datahub

A Generalized Metadata Search & Discovery Tool

datahub-helm

Repository of helm charts for deploying DataHub on a Kubernetes cluster

dbt-common

dbt-core

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

elasticsearch-tableau-connector

Tableau Web Data Connector for Elasticsearch

elementary

Open-source data observability for analytics engineers.

helm-charts

Lightdash Community helm charts

json-schema

JSON Schema validator for java, based on the org.json API

kafdrop

Kafka Web UI

kafka-connect-field-and-time-partitioner

Kafka Connect Store Partitioner by a custom field and time

mini-data-platform

Mini Data Platform

mlflow-workshop

First steps to interact with MLflow (mlflow.org)

prefect

The easiest way to automate your data

prefect-poc

Prefect Flow Evaluation

presto

Distributed SQL query engine for big data

pytest-dbt-postgres

Unittest DBT Postgres projects

quinn

pyspark methods to enhance developer productivity 📣 👯 🎉

rabbitmq-poc

Notification System PoC with Delayed/Expired queues.

redis-poc

Notification System PoC with ZSETs using the time to send as Scores

rudderstack-helm

Open-source, warehouse-first Customer Data Pipeline and Segment-alternative. Collects and routes clickstream data and builds your customer data lake on your data warehouse.

rust-efimer

PoC to try & learn Rust

scala-skeleton

Scala Skeleton

spark-daria

Essential Spark extensions and helper methods ✨😲

spark-json-schemas

Create Spark schemas using JSON-schemas