Topic: datawarehouse Goto Github

👇 Here are 376 public repositories matching this topic...

azure / cortana-intelligence-customer360
datawarehouse,This repository contains instructions and code to deploy a customer 360 profile solution on Azure stack using the Cortana Intelligence Suite.
Organization: azure
azure azure-functions datawarehouse data-science customer-enrichment feature-engineering data-virtualization multi-class-classification decision-trees

balajirvp / de-zoomcamp
datawarehouse,Code/Notes for the Data Engineering Zoomcamp by DataTalksClub
User: balajirvp
batchprocessing bigquery dataengineering datalake datamodeling datawarehouse dbt docker gcp prefect pyspark python rdd spark sql streaming terraform

capsicohealth / tilda
datawarehouse,
Organization: capsicohealth
tilda database orm json postgresql datamart datawarehouse model-driven-development

chenqingspring / rules-based-modeling-engine
datawarehouse,一款基于规则的可视化模型构建引擎。支持指标定义，规则定义，多数据源接入，RESTful API 查询
User: chenqingspring
big-data data-modeling datawarehouse restful-api rule-engine sql-generator

chessbrain / imdb-db-dump-projects
datawarehouse,Taking IMDBs database dumps and turning them into a multiple projects
User: chessbrain
database-dump production-database sql-server datawarehouse relational-databases datamining

cuebook / cueobserve
datawarehouse,Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases
Organization: cuebook
Home Page: https://cueobserve.cuebook.ai
sql anomaly anomaly-detection bigquery redshift snowflake datawarehouse timeseries-analysis timeseries-forecasting prophet-facebook

data-solution-automation-engine / data-solution-framework
datawarehouse,A library for data warehouse and data integration pattern and architecture documentation.
Organization: data-solution-automation-engine
architecture data-warehouses datawarehouse design etl etl-control etl-processes patterns solution

data-solution-automation-engine / data-warehouse-automation-metadata-schema
datawarehouse,Generic interface exchange format for Data Warehouse Automation and ETL generation.
Organization: data-solution-automation-engine
datawarehouse datawarehouseautomation etl-automation etlgeneration metadata-management

data-solution-automation-engine / direct
datawarehouse,DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics control framework that can be used to monitor, log, audit and control data integration / ETL processes.
Organization: data-solution-automation-engine
Home Page: https://github.com/RoelantVos/DIRECT
datawarehouse datawarehouseautomation etl etl-automation etl-framework etl-pipeline

data-solution-automation-engine / virtual-data-warehouse
datawarehouse,The Virtual Data Warehouse is a code generation and template management tool. It is part of the data solution automation ecosystem - the 'engine' for data solution automation.
Organization: data-solution-automation-engine
Home Page: https://github.com/RoelantVos/Virtual-Data-Warehouse
codegeneration datawarehouseautomation etl datawarehouse data datavault datavault20 virtual virtual-data-warehouse etl-automation

dataintoresults / data-brewery
datawarehouse,Data Brewery is an ETL (Extract-Transform-Load) program that connect to many data sources (cloud services, databases, ...) and manage data warehouse workflow.
Organization: dataintoresults
Home Page: https://databrewery.co
etl datawarehouse data-engineering data-warehouse elt

datalinkdc / dinky
datawarehouse,Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
Organization: datalinkdc
Home Page: http://www.dinky.org.cn
flink flinksql real-time-computing-platform flinkcdc olap sql datalake datawarehouse

dataplane-app / dataplane
datawarehouse,Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
Organization: dataplane-app
Home Page: https://dataplane.app
golang airflow kubernetes data scheduler workflows workflow-automation data-pipelines data-science data-engineering

datavault-uk / automate-dv
datawarehouse,A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
Organization: datavault-uk
Home Page: https://www.automate-dv.com
datavault20 dbt datawarehousing datavault etl snowflake dataengineering datawarehouse datalake elt

dazheng / sparketl
datawarehouse,Implement a complete data warehouse etl using spark SQL
User: dazheng
sparksql spark etl datawarehouse

dermatologist / hephaestus
datawarehouse, :stars: Hephaestus - ETL and ML tools for OHDSI - OMOP CDM
User: dermatologist
Home Page: http://nuchange.ca
datawarehouse etl emr health-informatics health-data

dermatologist / pyomop
datawarehouse,Python package for managing OHDSI clinical data models. Includes support for LLM based plain text queries!
User: dermatologist
Home Page: https://nuchange.ca
ohdsi datawarehouse health-informatics health-data-analysis clinical-trials cdm python hacktoberfest llm text-to-sql

erdemozgen / data-engineering-roadmap
datawarehouse,Roadmap for Data Engineering
User: erdemozgen
awesome ci-cd cloud data-science dataengineering development devops machine-learning mlops roadmap

fanruan / intelli-swift-core
datawarehouse,Distributed, Column-oriented storage, Realtime analysis, High performance Database
Organization: fanruan
Home Page: http://www.fanruan.com
distributed column-store realtime-analysis high-performance datawarehouse database

getdozer / dozer
datawarehouse,Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.
Organization: getdozer
Home Page: https://getdozer.io
apis data rust sql realtime streaming etl low-code postgres snowflake

glynnbird / couchwarehouse
datawarehouse,Data warehouse for CouchDB
User: glynnbird
couchdb datawarehouse sql sqlite nodejs cli mysql postgresql elasticsearch

hifxit / dataligo
datawarehouse,A library to accelerate ML and ETL pipeline by connecting all data sources
User: hifxit
database datalake datawarehouse etl-pipeline ml-pipeline nosql python

hydradatabase / hydra
datawarehouse,Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.
Organization: hydradatabase
Home Page: https://www.hydra.so
data-warehouse datawarehouse postgres postgresql postgresql-extension

imsanjoykb / etl-project
datawarehouse,The goal of this project is to illustrate Extract Transform Load (ETL) using Python and SQL. ETL is a process commonly done in computing, which takes raw data, cleans it and stores it for later use. The extraction phase targets and retrieves the data. Transform manipulates and cleans the data. Then load stores the data, typically in a data warehouse.
User: imsanjoykb
Home Page: https://imsanjoykb.github.io/
etl datawarehouse datalake etl-pipeline data-engineering database etl-automation etl-solutions

jitsucom / bulker
datawarehouse,Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
Organization: jitsucom
Home Page: https://github.com/jitsucom/bulker
data-engineering datawarehouse etl etl-pipeline ingestion pipeline

josephmachado / online_store
datawarehouse,End to end data engineering project
User: josephmachado
python3 data-engineering data-pipeline dagster postgresql datawarehouse data-processing data-platform data-analysis

josephmachado / simple_dbt_project
datawarehouse,Code for dbt tutorial
User: josephmachado
Home Page: https://www.startdataengineering.com/post/dbt-data-build-tool-tutorial
tutorial dbt postgres datawarehouse analytics

judeleonard / prescriber-etl-data-pipeline
datawarehouse,An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS application using Apache Airflow as an orchestration tool and various data warehouse technologies and finally using Apache Superset to connect to DWH for generating BI dashboards for weekly reports
User: judeleonard
Home Page: https://judeleonard.github.io/Prescriber-ETL-data-pipeline/
airflow apache-superset bi-dashboards dataengineering datawarehouse etl-pipeline pyspark airflow-docker amazon-s3 azure-blob-storage

kennethanceyer / awesome-data-pipeline
datawarehouse,Awesome list for datapipeline
User: kennethanceyer
Home Page: https://github.com/KennethanCeyer/awesome-data-pipeline
architecture awesome awesome-list big-data bigdata cloud data data-engineering dataeng datalake datapipeline datawarehouse hadoop hive opensource query spark

kevchant / azuredevops-fabricdwdbproject
datawarehouse,Template to perform CI/CD for Microsoft Fabric Data Warehouses
User: kevchant
Home Page: https://www.kevinrchant.com/2023/10/25/ci-cd-for-microsoft-fabric-data-warehouses-using-yaml-pipelines/
datawarehouse microsoft-fabric

kromozome2003 / snowflake-json-datapipeline
datawarehouse,Building Json data pipeline within Snowflake using Streams and Tasks
User: kromozome2003
database datawarehouse datawarehousing datapipeline datapipe datapipes snowflake cloud json stream

labmemno004 / amazonmoviesdatawarehouse
datawarehouse,数据仓库--存储并分析亚马逊历年电影数据
User: labmemno004
amazon movie datawarehouse

locnd-172 / ibm-data-engineer-specialization-coursera-personal-note-public
datawarehouse,All of my individual learning materials, documents, and notes from the process of getting the Coursera IBM Data Engineer Professional Certificate specialization are stored in this repository.
User: locnd-172
coursera data-engineering datawarehouse etl ibm

marco-roy / ddo
datawarehouse,A DBT package to perform DataOps & administrative CI/CD on your data warehouse.
User: marco-roy
dbt snowflake data datawarehouse datawarehouseautomation dataops

matts966 / alphasql
datawarehouse,AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery
User: matts966
bigquery zetasql typechecker parallelization graphviz dot-language datawarehouse datawarehouseautomation docker workflow-automation

mohamedhmini / tweetsolaping
datawarehouse,implementing an end-to-end tweets ETL/Analysis pipeline.
User: mohamedhmini
datawarehousing datawarehouse etl-pipeline tweets tweets-classification tweets-scraper twitter-api google-api-client api-client web-crawling

mvrabel / nifi-postgres-metabase
datawarehouse,Template for creating batch based ETL workflow for datawarehouses
User: mvrabel
nifi apache-nifi etl template workflow datawarehouse dwh

nathnael12 / datawarehouse
datawarehouse,Fully dockerized Data Warehouse (DWH) using Airflow, dbt, PostgreSQL and dashboard using redash
User: nathnael12
Home Page: https://data-engineering-dwh.netlify.app/#!/overview
airflow dataengineering datawarehouse dbt postgresql redash

rdagumampan / yuniql
datawarehouse,Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!
User: rdagumampan
Home Page: https://yuniql.io
sql yuniql database-migrations sqlserver postgresql mariadb mysql redshift snowflake amazon-rds

samber / awesome-olap
datawarehouse,A curated list of awesome Online Analytical Processing databases, frameworks, ressources and other awesomeness.
User: samber
analytics awesome awesome-list batch-processing big-data database datalake datawarehouse lakehouse metastore olap processing sql stream-processing streaming timeseries

searceinc / rstoolkit
datawarehouse,RStoolKit - A utility to perform a complete health check of your AWS RedShift Cluster
Organization: searceinc
Home Page: https://medium.com/searce/diagnose-and-optimize-redshift-cluster-performance-with-rstoolkit-bd9ac2feb4bb
aws redshift lambda health-check datawarehouse sql

semashkinvg / datavault
datawarehouse,
User: semashkinvg
datavault datavault20 datawarehouse enterprise-data-architecture business-intelligence

sharpdata / sharpetl
datawarehouse,Write ETL using your favorite SQL dialects
Organization: sharpdata
Home Page: https://sharpdata.github.io/SharpETL/
bigdata data-warehouse datawarehouse etl etl-framework flink flink-sql hive paimon scala spark spark-sql sql

shunfei / indexr
datawarehouse,An open-source columnar data format designed for fast & realtime analytic with big data.
Organization: shunfei
indexr columnar-storage olap datawarehouse realtime

simbafl / datawarehouse
datawarehouse,从数据仓库到用户画像，从数据建设到数据应用
User: simbafl
olap datawarehouse sql bigdata presto userprofile

svenskaspel / cobra-policytool
datawarehouse,Manage Apache Atlas and Ranger configuration for your Hadoop environment.
Organization: svenskaspel
Home Page: https://svenskaspel.github.io/cobra-policytool/
database datawarehouse hive hadoop atlas ranger utility

tauwu / backend_learning_notes
datawarehouse,后端学习笔记，本项目存放了一些我阅读有关的技术类的书籍和部分源码阅读的笔记整理。 涉及范围包括后端开发中的计算机学科基础知识、高级语言的基础知识、源码阅读笔记、数据库知识、数据挖掘知识等，同时也会涉及到一些具体生产场景中会遇到的一些实际问题。 :-D
User: tauwu
python3 golang java leetcode data-structures operating-system network datawarehouse database

techsparksguru / data_ai_for_all
datawarehouse,Data Analysis, Analytics, Science, AI & ML, LLM etc.
Organization: techsparksguru
python pandas datascience jupyter spark apache-spark metabase datawarehouse datawarehousing

umer7 / data-warehouse-concepts-design-and-data-integration
datawarehouse, Repo for Data Warehouse Concepts, Design, and Data Integration by University of Colorado System (coursera)(Notes,Assignments, quiz and research papers)
User: umer7
datawarehouse pentaho data-integration data-warehouse oracle

varigence / bimlflex-community
datawarehouse,Community-focused content to supplement working with BimlFlex.
Organization: varigence
datawarehouse datawarehouseautomation microsoft