Giter VIP home page Giter VIP logo

data-modeling-project's Introduction

Economic Indicators Project

Link to Tableau Dashboard

Welcome to my Economic Indicators project! This GitHub repository contains the assets for a robust data engineering pipeline that links Wikipedia world economic indicators data to a dashboard displayed on Tableau Public (linked above). With this project, you can easily sync data from Wikipedia to the dashboard and with it interactively experiment with visualizing economic data in a world map, see what countries are more developed or less developed compared to others, etc. I'm a huge fan of learning about macroeconomics and international economics, so the project idea came easily to me.

The project is meant to be a demonstration of usage of the Modern Data Stack to develop a user-facing dashboard. Here are the technologies used and the order in which I used them:

  1. Wikipedia data -> Google Sheets via the IMPORTHTML function
  2. Prefect for workflow orchestration used to robustly transfer Google Sheets data into a BigQuery data warehouse
  3. dbt (data build tool) for data modeling to clean and prepare the data and output into one final table
  4. Tableau to take the data from BigQuery and display it in interactive visualizations

This github repository contains the dbt files used in step 3, and folder prefect-files contains the files I used in Prefect. The source folder in prefect-files contains the original Google Sheets files.

It was a great experience creating this project, and I'm excited to present the dashboard and the data engineering backend to the community.

dbt lineage graph:

dbt lineage graph

data-modeling-project's People

Contributors

johnchandlerbaldwin avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.