danielbeach Goto Github PK
Name: Daniel B
Type: User
Bio: Data Engineer. Data lover. Data warehouse expert. Python, Rust, SQL, Databricks, Delta Lake is all I need in life.
Location: Iowa
Name: Daniel B
Type: User
Bio: Data Engineer. Data lover. Data warehouse expert. Python, Rust, SQL, Databricks, Delta Lake is all I need in life.
Location: Iowa
Running Airflow inside Kubernetes
Comparing Apache Airflow to Dagster
Using Chuck Norris to show how slow Async Python is.
learning how to download, unpack, and read CSV files in Rust.
use Python and Scala to convert csv to parquet
Data Engineering Practice Problems
Some example projects for Data Engineers to build, end-to-end.
Template for Data Engineering and Data Pipeline projects
Trying to use Fortran to write a data pipeline
Polars vs Spark vs Pandas vs DataFusion. Guess who wins?
Playing around and making ETL tools with Datafusion's CLI SQL tool.
Add Foreign Keys in SQL Server to Hundreds+ Data Warehouse tables with Dynamic SQL
an example DBT project to learn the tool.
Trying out the Rust delta-rs Delta Table writer.
doomsday engine
WebScrapping, Asyncio, Spark Streaming, Pyspark, PostgreSQL
Put a file in Dropbox
Introduction to DSA (Data Structures and Algorithms) with Rust.
Learning how to query remote s3 Delta Lake with DuckDB.
Comparing the performance of DuckDB to Polars
This repo shows how to fine tune openLLaMA (7b) model on a GPU.
playing with DataFrames in Golang, compare it to Python.
Writing Word Counter with both Golang and Rust
Building a Network/Graph from scratch, and understanding it with Rust.
Getting Great Expectations setup to run on DataBricks with Spark Dataframes.
Learning to setup a Great Expectations project using Apache Spark
Introduction to gRPC with Python.
Iowa Corn Yields using Python, Pandas vs RDBMS
Understanding HTTP API calls and JSON parsing with Golang.
create a 3 node Kafka cluster, interact with Python client.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.