Giter VIP home page Giter VIP logo

dashboard's Introduction

效能看板

pipeline status

需求文档

效能看板

部署方案

部署说明

排期: 2020-12-14 之前
最近xx天指标:全部使用clickhouse计算;
历史累计指标:
    Saas 部署: Hive初始化 + Clickhouse增量迭代
    私有化部署:Clickhouse初始化 + Clickhouse增量迭代

数据流转

source:
    kafka > clickhouse
    mysql > clickhouse

transform:
    clickhoue-sql

sink:
    clickhoue
    mysql

指标计算逻辑

查阅

启动脚本

RunJob.go

运行参数:
    env:运行环境
        idea - 测试业务流程运行是否通畅 clickhouse、 mysql
        dev - 开发环境,测试是业务
        saas - saas 线上部署运行

    debug:是否打印明细sql (true/false)

    start\end: 起止日期,不传,默认是运行昨天

    tasks: 需要计算任务(不传,默认运行全部)
eg:
    go run RunJob.go -env saas -debug false -start 2020-12-01 -end 2020-12-03 -tasks 'aa,bb,cc' -sql /aa/bb/cc/script
    go run RunJob.go -env saas -debug false -sql /aa/bb/cc/script

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.