Giter VIP home page Giter VIP logo

timescale-benchmark's Introduction

timescale-benchmark

benchmark timescaledb using a csv as input for the queries. output will appear on console as json

See Architecture

Running timescale and benchmark via docker

  1. Run docker-compose build
  2. To start timescale run docker-compose up timescaledb
  3. To load the time series data, In a new terminal run docker-compose exec timescaledb psql -U postgres -h localhost -f /tmp/db/cpu_usage.sql
  4. to see the process run automatically docker-compose up
  5. run docker-compose up | grep benchmark_1
  6. leave timescale running

Running the Tests

To run the tests we can use the make file, assuming you have go installed

  • run make unit_test to run the unit tests only
  • run make integration to run the full integration and view the output
  • run make run or make debug to run the benchmark in debug or non debug mode
  • run make build then ./benchmark for default or ./benchmark --help for args

timescale-benchmark's People

Contributors

shawnfeldman avatar

Watchers

James Cloos avatar

timescale-benchmark's Issues

benchmark improvements: utilize query params to show stats by query param add multiple runs and average out the results

we may want to show which query params were slowest in the benchmark. could hint to use potential indexes we'd need.
Also since each query is used once and we are using non dedicated hardware (potentially). We can get skewed results running the benchmark a single time. We should run it many times times and averaging out the results. We can add p99 and p95s to remove long running outliers.

Question: sanitize the input?

I have some basic sanitization done on headers and column sizes but have paused work there to focus on db queries and stats collection

Does this sound acceptable?

add instructions for running the utility

Will need to update the readme to add instructions to run it

Hopefully having time can just docker-compose the workflow for a demo and have a script to run the process locally

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.