sagarlakshmipathy Goto Github PK

airflow-tweet-loader

This repo contains a data pipeline code written in python and scheduled in Apache Airflow. It monitors, fetches and cleans tweets and stores in HDFS. And finally, loads it to a hive database.

amazon-sagemaker-safe-deployment-pipeline

Safe blue/green deployment of Amazon SageMaker endpoints using AWS CodePipeline, CodeBuild and CodeDeploy.

collaborative-authoring

This project lets users merge two analyses together and create a new analysis or even update the target analysis in place.

complete-python-3-bootcamp

Course Files for Complete Python 3 Bootcamp Course on Udemy

content-aws-csa2019

Adrian's AWS CSA Assoc Course Refresh 2019

content-python-for-sys-admins

custom-docusaurus

customize-quicksight-dashboard-blog

data-engineer-handbook

This is a repo with links to everything you'd ever want to learn about data engineering

data-engineering-zoomcamp

Free Data Engineering course!

dbt-repo

deploying-machine-learning-models

wip

emr-studio-notebook-examples

This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.

finnhub-data-pipeline

googledataengineer

hudi

Upserts, Deletes And Incremental Processing on Big Data.

hudi-on-databricks

This repository serves as a guide to work with Hudi tables on Databricks environment

hudi-pyspark

incubator-xtable

OneTable is an omni-directional converter for table formats that facilitates interoperability across data processing systems and query engines.

lex-prediction-pyspark

Performed Regression Analysis using PySpark to predict Life Expectancy based on World Population data.

ml-api

Guide on creating an API for serving your ML model

ml-pyspark-customer-churn

The code was written for Big Data Infrastructure final capstone project to predict the customer churn for a telecom company. Data was sourced from Kaggle but can run on databricks independent of supporting documents/datasets. It includes techniques like hyperparameter tuning for feature engineering and model evaluation. Random Forest Classifier model served us with the best accuracy at 71%.

mnist-dimensionalityreduction-imagerecognition

Dimensionality reduction and image recognition on MNIST data set using PCA & T-SNE and SVM.

movie-analysis-pig-latin

The code below was written in Pig Latin which finds the best movies sorted by time and worst of the movies sorted by the times it was rated. Repository includes, code for the analysis and datasets 1. "u.data" file (contains rating info) and 2. "u.item" file (metadata).

onetable-getting-started

This repository is to help getting people started with OneTable

onetable-utils

py4j

A Simple Py4J implementation

pyspark-starter-repo

python-for-algorithms--data-structures--and-interviews

Files for Udemy Course on Algorithms and Data Structures

python-refresher

A Python refresher section for all our courses