nishu9999 Goto Github PK

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

aws-etl-orchestrator

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

aws-lambda-cheatsheet

AWS Lambda cheatsheet.

bonobo-sqlalchemy

PREVIEW - SQL databases in Bonobo, using sqlalchemy

butterfree

A tool for building feature stores.

content-aws-database-specialty

For AWS Database Specialty Course

datalake-etl-pipeline

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

etl

simple ETL example

etl-pyspark

ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)

etlalchemy

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

goodreads_etl_pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

jupyter-python-nbk

learn-spark

Examples To Help You Learn Apache Spark

metl

mito ETL tool

pyetl

python ETL framework

pyetl-1

Python multiprocessing configurable library to perform synchronized tasks

pyetllib

Common tools for ETL scripting

pyspark-etl

PySpark-ETL

pyspark-etl-analytics

This repo contains code examples of processing and analysing data with Apache Spark and Python

pyspark-examples

Code examples on Apache Spark using python

pyspark-tutorial

PySpark Code for Hands-on Learners

pyspark-tutorial-1

pyspark-tutorial-2

Jupyter notebooks for pyspark tutorials given at the university

scala-kaggle

Scala Spark code for Kaggle competitions

snowflake-connector-python

Snowflake Connector for Python

snowflake-data-consortium

A test project for managing a peer-to-peer data sharing network in Snowflake

snowplow

Cloud-native web, mobile and event analytics, running on AWS and GCP

spark

Apache Spark - A unified analytics engine for large-scale data processing

spark-csv

CSV Data Source for Apache Spark 1.x

spark-example-project

A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR