Giter VIP home page Giter VIP logo

Yohann Zapart - Python Developer | Data Engineer/Analyst

🇬🇧 Certified mathematics teacher for 8 years, trained as a scientific instrumentation engineer and holder of a Master's degree in microelectronics, I am now deciding to professionalize my passion for programming, which has been a significant part of my personal, academic, and professional life since the age of 10.

🇫🇷 Professeur de mathématiques certifié pendant 8 ans, ingénieur en instrumentation scientifique de formation et titulaire d'un master 2 en microélectronique, je décide aujourd'hui de professionnaliser ma passion pour la programmation qui rythme ma vie personnelle, universitaire et professionnelle depuis l'âge de 10 ans.


linkedin.com/in/yohann-zapart/


Stack :

python sql metabase GCP docker git spark Airflow kafka

Python POO, DSA (top 1% codingame.com), pip/conda, Jupyter, Venv, Flask, Numpy, Pandas, Matplotlib, Seaborn, Scrapy, Requests, Selenium, BeautifulSoup et d'autres.
SQL JOINs, CTEs, Temporary functions, Window functions, Subqueries, Indexes, LAG, RANK, manipulation des dates
Linux & Bash Automatisation, Terminal, navigation/gestion de fichiers, droits admins/chmod, SSH, oh-my-zsh.
GCP gcloud CLI, BigQuery, Storage, Dataproc, Composer, Dataflow, GCE, Functions, Scheduler, Pub/Sub, IAM, Artifact Registry, Cloud Run, Logging.
Docker Dockerfile, docker-compose, DockerHub
Spark Implementation en local, Docker & GCP Dataproc, pySpark, SparkSQL, Dataframes, Spark Streaming, Jupyter, Spark connectors w/ Maven dependecies.
Airflow Local, Docker & GCP Composer, DAGs, GCP Operators (BigQuery & Storage).
Kafka Local, Docker & GCP Pub/Sub, Producer/Consumer shell/python client, Authentifications, Autorisations ACL.
En cours Scikit-Learn, Looker

📖


Practiced Technologies :

  • Java, PHP, Javascript, React, Node, HTML/CSS
  • MatLab, LabView
  • Arduino/ESP, Raspberry Pi
  • BASIC / ASM

Portfolio :

V'lille GCP

🔗 github.com/yzpt/vlille_gcp

Exploring GCP services through the implementation of an ETL of data from the V'lille API 🔗

Cloud Functions, Pub/Sub, Scheduler, Storage, Dataproc & BigQuery.

Deployment of a dashboard on Cloud Run with Flask, Docker, Google Maps JS, ChartJS.

img/diagram_svg.svg

Flask Dashboard

https://dashboard-service-dxpal7wuuq-od.a.run.app/


Streaming cluster with Docker, Kafka, Spark & Cassandra

🔗 https://github.com/yzpt/docker_cluster_streaming

A project where I discovered and learned: *Docker and the deployment of a VM cluster with docker-compose *Kafka: shell and python client, SASL/PLAIN authentications, and ACL authorizations *Spark: shell and python client, Dataframes, Spark Streaming, Kafka and Cassandra connectors *Maven: dependencies, repositories, Spark operators for Kafka and Cassandra. I faced several compatibility issues between the versions of Spark, Scala & Kafka used in Docker images.

I enjoyed the Ops aspect of the job, which led me to strongly focus on Kubernetes, which I have begun to get to grips with. img/diagram_svg.svg

Implementation of SASL/PLAIN authentication and ACL authorizations on Kafka.

🔗 https://github.com/yzpt/upw_test_kafka_spark_docker


Docker + Airflow + PostgreSQL
GCP Composer + BigQuery

🔗 https://github.com/yzpt/airflow_carburants

ETL of fuel prices with Airflow in three versions:

  • Local
  • Docker + Airflow + PostgreSQL
  • GCP Composer + BigQuery

img/diagram_carburants_airflow.png

img/dag_screen.png


Zapmaths: web application for practicing calculation skills

🔗 https://github.com/yzpt/zapmathss

Application developed and used during my career as a certified mathematics teacher in a vocational high school.

Developed during lockdown with a foundation in Php/mySQL on a LAMP server. It reignited my interest in coding and led me to use Python.

img/diagram_zapmaths_svg.svg

It was an effective learning tool, well-received and heavily used by students who each processed thousands of questions per academic year.

  • Detailed tracking of student activities
  • Questions with semi-random numerical data, the statements, diagrams, charts, and corrections are dynamically generated based on the generated values.
  • Web application in Php/mySQL on a LAMP server.

Screenshot Screenshot Screenshot Screenshot Screenshot Screenshot Screenshot Screenshot

Démo :

A version is accessible at https://zapart.ovh

Login information:

login password
demo01 demo01
demo02 demo02
... ...
demo99 demo99

Others & in progress

Yohann Zapart's Projects

airflow_carburants icon airflow_carburants

--- work in progress --- Airflow and PostgreSQL in three approaches: Local setup, Docker cluster environment and GCP implementation with Composer & BigQuery.

timemap_vlille icon timemap_vlille

Temporal insights visualization: Plotply bubble map of vlille_gcp project dataset

vlille_gcp icon vlille_gcp

Learning GCP : gcloud CLI, BigQuery, Storage, Function, Pub/Sub, Dataproc, Cloud Run. Flask + Docker + Chart.js web dashboard app.

ws2812b icon ws2812b

An elegant and streamlined script designed for managing a WS2812B addressable LED strip with FastLED library using an embedded Arduino Nano, powered by a standard USB power bank.

zapmaths icon zapmaths

Maths training web app I created when I was mathematics teacher. Python, Php/mySQL (LAMP Stack)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.