bytemedirk Goto Github PK

followers: 3.0 following: 1.0 repos: 28.0 gists: 0.0

Name: Dirk Steynberg

Type: User

Bio: 🚀 Data Engineer | 🐍 Python Dev | 📊 Tech Lead | Open Source Enthusiast

Blog: https://bytemedirk.carrd.co/

🚀 Data Engineer | 🐍 Python Dev | 📊 Tech Lead | Open Source Enthusiast

Mastodon | LinkedIn

Hello, I'm Dirk 👋

Senior Data Engineer & Tech Lead

I'm a passionate Data Engineering Leader with a proven track record in building innovative solutions and leading high-performing teams to deliver complex data solutions. With over 6 years of experience in data engineering, cloud computing, and transformative projects, I specialize in driving innovation and data-driven strategies to solve business challenges.

🚀 What I do

Design and implement scalable data solutions
Lead and mentor high-performing engineering teams
Develop cloud-based data warehousing and ETL solutions
Champion best practices in cloud data architecture and operations

🛠️ Technologies & Tools

📈 GitHub Stats

Note: Most of my professional work is not on GitHub, so this is not as active as it could be.

💼 Work Experience

Senior Data Engineer, Tech Lead at Equal Experts (2024 - Present)
Data Engineer, Tech Lead at Teraflow.ai (2022 - 2023)
Data Engineer, Data Lead at Ringier South Africa (2020 - 2022)
Founder, Data Specialist at Perceptech (2015 - 2020)
Data Guru, Data Specialist at Howler (2019 - 2020)
Data Engineer, Software Developer at Ovations Technologies (Pty) Ltd (2017 - 2019)

🎓 Education

BSc Honours in Computing & IT, University of Derby (2024 - 2025)
BS Undergrad in Computing & IT, Online Business School (2022 - 2023)
TQUK Level 4, Business & Innovation, ADL Online (2020 - 2022)

⭐️ From ByteMeDirk

Dirk Steynberg's Projects

anapy

ANApy is a universal data manipulation tool for handling all major forms of data on the fly

apache-airflow-data-engineer

Apache Airflow For Data Engineers Tutorial

apache-airflow-dev-server

A Dockerised Apache Airflow Webserver

apache-pyspark-dev-server

A Dockerised Apache service for local testing and development

apollo_script_master

ApolloScriptMaster is an ORM solution designed for seamless management of SQL scripts within a CiCd deployment strategy.

boto3

AWS SDK for Python

bytemedirk

My Bio and more about what I do!

cfn-python-lint

CloudFormation Linter

collaborate

A Federated Knowledge Sharing Platform

dbt-airflow-etl-project

A showcase using DBT core with Airflow in a local container

dbtos3

A database to AWS S3 loader & replication tool

examples

THIS REPOSITORY IS NOT UP TO DATE. Different docker-based examples for ORY's services (Hydra, Keto, Oathkeeper).

gan-2024

A simple set of GANs

github.py

An asynchronous Python wrapper for the GitHub API, v4.

hadoop-docker

Developer Hadoop Environment with Docker

image_compressor

A PyQt5 widget that allows the user to select an image, compress it and save it to a file.

jupter-lab-dev-server

A developers environment using Jupyter Labs

k8s-data-engineer

Kubernetes For Data Engineers Tutorial

metabase-aws-server

Traditional Metabase server on AWS using Terraform.

metabase-dev-server

A Dockerized Metabase Server for development.

pandas

Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more