san089 Goto Github PK

airflow-training

Introduction to the data pipeline management with Airflow. Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse.

analytics_vidya

awesome-apache-airflow

Curated list of resources about Apache Airflow

beamer-themes

big_data_project

Fake News Detection - Feature Extraction using Vectorization such as Count Vectorizer, TFIDF Vectorizer, Hash Vectorizer,. Then used an Ensemble model to classify whether the news is fake or not.

black-friday-sales-analysis

This Project gives an insight into few statistics related to black Friday Sale.

cloudera_material

Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

data-engineer-roadmap

Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups

data-engineering-nanodegree

Projects done in the Data Engineering Nanodegree by Udacity.com

data-science-question-answer

A repo for data science related questions and answers

dbt_common_utils

dbt_common_utils

dbt_test_project

goodreads

:snake: Python wrapper for Goodreads API :books:

goodreads_etl_pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

hadoop-books

This is my personal collection of free Hadoop books, please feel free to share and learn.

ipl-analysis-with-python-pandas

This project provides an analysis on IPL(Indian premier League) stats from Year 2008 to 2017.

learning_machine_learning

Machine learning demo projects

live-twitter-sentiment-analysis

Sentiment analysis on live twitter stream and plotting the sentiment values using Matplotlib

motivate

:zap: motivate :zap: - A simple script to print random motivational quotes. Highly influenced by linux command fortune.

optimizing-public-transportation

A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.

pyspark-example-project

Example project and best practices for Python-based Spark ETL jobs and applications.

rdatasets

An archive of datasets distributed with R

scala-spark-4

sf-crime-statistics

A Kafka and Spark Streaming Integration project : SF Crime Statistics with Spark Streaming

smelldetectioncaller

Bare minimum code needed to detect occurrences of code and design smells

soen-6011

This Repository is for course SOEN 6011.

soen6611-project

soen_6441

A multiplayer board Risk Game.

spark-practice

Apache Spark (PySpark) Practice on Real Data

spark_packaged_project

This project contains pyspark jobs to create data pipelines and shows how to distribute the project package on Cluster.