tangguoqiang172528725 Goto Github PK

aigc_llm_engineering20230712

arroyo20230712

Distributed stream processing engine in Rust

auto_ts

Automatically build ARIMA, SARIMAX, VAR, FB Prophet and XGBoost Models on Time Series data sets with a Single Line of Code. Now updated with Dask to handle millions of rows.

bigdata-docker-compose20230128

Deploy bigdata platform using docker compose. Big data components include hadoop, hive, hbase, presto, flink, es, kafka, etc.

binlog

java订阅binlog，解析数据库的dml/dcl/ddl转换成sql文件进行存储。

binlog2redshift

An experimental MySQL binlog to Redshift syncer

blog_demos

CSDN博客专家程序员欣宸的github，这里有六百多篇原创文章的详细分类和汇总，以及对应的源码，内容涉及Java、Docker、Kubernetes、DevOPS等方面

book

They are information technology related book.

chatgpt-plus-

AI 助手全套开源解决方案，自带运营管理后台，开箱即用。集成了 ChatGPT, Azure, ChatGLM,讯飞星火，文心一言等多个平台的大语言模型。支持 MJ AI 绘画，Stable Diffusion AI 绘画，微博热搜等插件工具。采用 Go + Vue3 + element-plus 实现。

dagster-poor-mans-data-lake20230825

datamigration20240619

历史迁移解决方案。微服务的架构为基础，使用多种设计模式，如：单利、桥接、工厂、模板、策略等。其中涉及的核心技术有，多线程、过滤器等。致力于解决mysql大表迁移的问题。提供多种迁移模式，如：库到库、库到文件再到库等！ Historical migration solution. Based on the architecture of microservices, multiple .......

datax

DataX 是阿里巴巴集团内被广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、HDFS、Hive、OceanBase、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

dbt-postgres-tutorial20230816

dbt tutorial using a local PostgreSQL database

debezium

CDC spring boot app with debezium

docker-containers

A collection of pedantic docker containers.

docker-hadoop-spark-workbench

[EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook and HDFS FileBrowser.

docker-hadoop20230106

docker-spark-iceberg20231127

flink-learning

flink learning blog. http://www.54tianzhisheng.cn 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

flink-streaming-platform-web-20201216

flink-tutorial

fqueue20230313

Automatically exported from code.google.com/p/fqueue

gphost20230110

Image to run Greenplum

greenplum_docker20230110

基于dockerfile制作Greenplum6 数据库单节点的集群docker镜像。

hudi20221107

Upserts, Deletes And Incremental Processing on Big Data.

juicesync20231214

A tool to move your data between any clouds or regions.

lakesoul20230217

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

movie-plays-kafka

mysql-listener

MySQL实时变更监控

open-replicator

Open Replicator is a high performance MySQL binlog parser written in Java. It unfolds the possibilities that you can parse, filter and broadcast the binlog events in a real time manner.