Giter VIP home page Giter VIP logo

374857922 / straws Goto Github PK

View Code? Open in Web Editor NEW

This project forked from 765276707/straws

0.0 0.0 0.0 2.16 MB

Straws是一款开源的离线数据同步中间件(ETL),提供Mysql、SqlServer等离线同步场景,同时支持定时同步(全量、增量、CDC三种模式)和数据转换清洗等功能

License: GNU General Public License v2.0

JavaScript 6.36% Java 61.92% Groovy 0.05% HTML 0.08% Vue 26.64% SCSS 0.88% TSQL 4.08%

straws's Introduction

straws star fork

Straws

介绍

Straws是一款开源的离线数据同步中间件(ETL),提供Mysql、SqlServer等离线同步场景,同时支持定时同步(全量、增量、CDC三种模式)和数据转换清洗等功能,目前项目仍在持续完善中,若您要使用请自行验证通过过方可使用。

环境要求

  • JDK8
  • Maven 3.2以上版本
  • MySQL 8以上版本
  • Windows/MacOS/Linux系统

应用场景

  • 相同或异构数据库的数据同步,表结构迁移(暂不支持索引、函数、存储过程迁移)
  • 相同或异构数据库的定时同步,支持全量、增量、CDC三种同步模式,可以针对数据进行转换、过滤等
  • 目前仅适配了Mysql、SqlServer两种关系型数据库,后续会陆续适配更多不同类型的数据库

系统架构

Straws

安装教程

  1. 安装JDK8、安装Maven3.2以上版本
  2. 安装Mysql8,创建名为straws的数据库
  3. 克隆项目到本地
  4. 将web模块内的schema文件夹内的sql文件导入到straws数据库内
  5. 编译、打包、部署
  6. 需要拓展的tx可以自行拓展,但请遵守项目指定的开源协议

项目配置(待补充)

  1. 基础配置
  2. 加密配置
  3. 同步配置

简单使用

  1. 添加自己的数据源
  2. 指定同步或迁移的源头数据源和目标数据源,填写参数
  3. 启动任务

界面展示

Straws Straws Straws Straws Straws Straws

参与贡献

  1. Fork 本仓库
  2. 新建 Feat_xxx 分支
  3. 提交代码
  4. 新建 Pull Request

straws's People

Contributors

xzb617 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.