Giter VIP home page Giter VIP logo

gitlab-status's Introduction

Gitlab Pipelines Stats

Create .env file with appropriate values:

GITLAB_TOKEN=....................
GITLAB_PROJECT_ID=...............

Spin up Elasticsearch & Kibana:

docker-compose up

Ingest 1 days of pipelines' updates from Gitlab:

docker-compose run --rm ingest 1d

Wait until execution ends and go to http://localhost:5600

Import saved objects to Kibana if you want to play with the pre-created dashboards, visualisations and indices:

./import-saved-objects.sh

Check ES for missed intervals for last 10 days:

docker-compose run --rm ingest --no-pipelines --no-merge-requests --check-missing-intervals 10d

Notes

  1. Data is persisted in Docker volumes, check docker volume on how to prune.

  2. Run docker-compose build after git pulls.

Developing

Python hacking can be easy if you build a docker image with docker-compose build first, then bring elastic and kibana services up docker-compose up and then run this command:

docker run -it --env-file .env --rm -v $(pwd)/ingest/:/src --network $(basename $(pwd))_elastic $(basename $(pwd))_ingest --es-hosts elasticsearch 6h

gitlab-status's People

Contributors

aleksandr-vin avatar

Watchers

avatar avatar avatar

gitlab-status's Issues

Combine complete intervals in report

While missing intervals are naturally combined, completed intervals are separate but overlapping, which is too verbose for the high-level overview. Need to combine them as well, m.b. showing number of ingestions within the combined interval.

Checking for missing intervals...
Missing intervals:
2020-05-10 20:15:05.352884+00:00 - 2020-05-11 08:15:04.961735+00:00 (11:59:59.608851)
Complete intervals:
2020-03-08 16:19:53.516747+00:00 - 2020-05-07 16:19:53.516747+00:00 (60 days, 0:00:00)
2020-05-06 18:15:05.008273+00:00 - 2020-05-07 18:15:05.008273+00:00 (1 day, 0:00:00)
2020-05-06 20:15:04.868685+00:00 - 2020-05-07 20:15:04.868685+00:00 (1 day, 0:00:00)
2020-05-06 22:15:04.472537+00:00 - 2020-05-07 22:15:04.472537+00:00 (1 day, 0:00:00)
2020-05-07 08:15:05.547668+00:00 - 2020-05-08 08:15:05.547668+00:00 (1 day, 0:00:00)
2020-05-07 10:20:32.440964+00:00 - 2020-05-08 10:20:32.440964+00:00 (1 day, 0:00:00)
2020-05-07 12:15:07.381165+00:00 - 2020-05-08 12:15:07.381165+00:00 (1 day, 0:00:00)
2020-05-07 14:15:24.841197+00:00 - 2020-05-08 14:15:24.841197+00:00 (1 day, 0:00:00)
2020-05-07 16:15:05.280477+00:00 - 2020-05-08 16:15:05.280477+00:00 (1 day, 0:00:00)
2020-05-07 18:15:04.949445+00:00 - 2020-05-08 18:15:04.949445+00:00 (1 day, 0:00:00)
2020-05-08 00:15:05.299802+00:00 - 2020-05-09 00:15:05.299802+00:00 (1 day, 0:00:00)
2020-05-08 10:15:07.624338+00:00 - 2020-05-09 10:15:07.624338+00:00 (1 day, 0:00:00)
2020-05-08 12:15:05.399722+00:00 - 2020-05-09 12:15:05.399722+00:00 (1 day, 0:00:00)
2020-05-08 14:15:03.798350+00:00 - 2020-05-09 14:15:03.798350+00:00 (1 day, 0:00:00)
2020-05-08 16:15:04.114887+00:00 - 2020-05-09 16:15:04.114887+00:00 (1 day, 0:00:00)
2020-05-08 18:15:04.145034+00:00 - 2020-05-09 18:15:04.145034+00:00 (1 day, 0:00:00)
2020-05-08 20:15:06.772558+00:00 - 2020-05-09 20:15:06.772558+00:00 (1 day, 0:00:00)
2020-05-08 22:15:04.293269+00:00 - 2020-05-09 22:15:04.293269+00:00 (1 day, 0:00:00)
2020-05-09 00:15:04.838545+00:00 - 2020-05-10 00:15:04.838545+00:00 (1 day, 0:00:00)
2020-05-09 02:15:04.370430+00:00 - 2020-05-10 02:15:04.370430+00:00 (1 day, 0:00:00)
2020-05-09 04:15:03.720977+00:00 - 2020-05-10 04:15:03.720977+00:00 (1 day, 0:00:00)
2020-05-09 06:15:04.285865+00:00 - 2020-05-10 06:15:04.285865+00:00 (1 day, 0:00:00)
2020-05-09 08:15:03.610852+00:00 - 2020-05-10 08:15:03.610852+00:00 (1 day, 0:00:00)
2020-05-09 12:24:35.218825+00:00 - 2020-05-10 12:24:35.218825+00:00 (1 day, 0:00:00)
2020-05-09 20:15:05.352884+00:00 - 2020-05-10 20:15:05.352884+00:00 (1 day, 0:00:00)

Ingest tests stats per job

Some jobs have tests, and Gitlab has Test section on the pipeline and in the MR page.

Need to track amount, names and quality (succeeded, failed, ignored, pending,...).

If possible track each test's / spec's duration and coverage if it's reported by Gitlab.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.