Giter VIP home page Giter VIP logo

local-data-lakehouse's Introduction

Hey there

I am a German student, who is passionate about Data Engineering and Infrastructure. I have work experience in Data- and Software Engineering. In my free time I like learning new skills and concepts and building completely overengineered projects, which are showcased on my Github.

Tech Stack:

Java Python MySQL

Apache Spark Apache Airflow Dbt Trino

Docker AWS Terraform

Linux Git

Example projects, if you are interested in ...

Infrastructure / Data Platform / Data Engineering 🏗

Open source contributions 💡

Project Added Link
Apache Airflow Functionality and respective unit tests to export and import roles including permissions using the Airflow CLI Merged Pull-Request
Apache Airflow Changed the Airflow docker-compose to easily ingest custom config files and added relevant documentation Merged Pull-Request
PM4PY Functionality to filter for a maximum coverage percentage of graph variants Merged Pull-Request

GitHub Stats:

local-data-lakehouse's People

Contributors

dominikhei avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar

Forkers

savadev mahmadmujtaba dgg23 softiger maxvcbhan julioszeferino krish240574 caugrad

local-data-lakehouse's Issues

Problem with account to login metabase

Hi dominikhei,

Thank you for the useful repository, I have try your code to make lakehouse at local. Everythings is ok, but the account to login Metabase that you leave in the readme.md, test and test123!, it is not work. The Metabase login page require a email, so your account not work in there. Please help me fix this case. Thank you so much !!
Uploading Screenshot 2023-05-14 233126.png…

Apache iceberg and hive metastore ?

Hello, sir.

I'm passionate about new architectures, including the Data Lakehouse. Fortunately, I came across his project of "Local-Data-LakeHouse ".It's a good start for me, I'm testing it on my machine.

But I don't understand how you did exactly in the second layer for Iceberg and hive metastore.
Please, can you explain this step to me ?

Thank you in advance.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.