Giter VIP home page Giter VIP logo

yams's Introduction

YAMS - Yet Another Monitoring System

YAMS is designed to be a long term trending system capable of handling large volumes of data. It leverages other open source software such as collectd and Postgres. There are four main components: SUM, ETL, DW and WUI.

See INSTALL.md for installation help, and the doc directory for specific use cases.

System Under Monitor (SUM)

The SUM is a system that is monitored by collectd.

Extract, Load, Transform (ETL)

The ETL is a custom built application that is specifically designed to transform collectd JSON formatted data from the collectd write_http module and load it into a relational database management system. The custon application is suite of software consisting of a FastCGI C program, an ETL C program, Web server, and Redis.

Data Warehouse (DW)

The DW is the PostgreSQL relational database management system.

Web User Interface (WUI)

The WUI is an application built on Pyramid using Flotr2.

Minimum software versions:

  • collectd 5.2
  • fcgi 2.4
  • hiredis 0.9.2
  • json-c 0.10
  • nginx 1.2
  • PostgreSQL 9.2 with json_enhancements extension
  • Pyramid 1.4
  • Redis 2.2
  • spawn-fcgi 1.6

A script is provided for Vagrant http://www.vagrantup.com that will build a working system with YAMS running on it.

yams's People

Contributors

mwongatemma avatar markwkm avatar

Stargazers

Ethan Brown avatar Dmitry Davydov avatar Bach Le avatar Angus H. avatar Mélanie avatar  avatar Gus Becciu avatar Tim Bunce avatar Giles Westwood avatar Ceri Storey avatar  avatar  avatar Selena Deckelmann avatar

Watchers

 avatar James Cloos avatar

yams's Issues

format_graphite: target buffer too small

Hi,
I used your config for collectd. My collectd sends metrics to graphite. I had this error in logs :
"format_graphite: target buffer too small"
I have done some search and I saw this discussion :
https://www.mail-archive.com/[email protected]/msg02600.html
Florian Forster is the main developper of collectd and he said :

...which seems to have 14 data sources. I'm not sure whether that's
excessive or not and I didn't write the plugin so I'm not entirely
sure what it does. :)

163 of 195 types that collectd defines by default have a single data
source. Of the non-legacy types, only "load" has more than two. I'm currently
thinking about eventually removing the support for multiple data sources from
collectd entirely

My issue is caused by the type.db with return too many metrics. So I splitted the type and it works well :
database_stats numbackends:GAUGE:0:u
database_stats_xact xact_rollback:COUNTER:0:u, xact_commit:COUNTER:0:u
database_stats_blks blks_read:COUNTER:0:u, blks_hit:COUNTER:0:u
database_stats_tup tup_returned:COUNTER:0:u, tup_fetched:COUNTER:0:u, tup_inserted:COUNTER:0:u, tup_updated:COUNTER:0:u, tup_deleted:COUNTER:0:u

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.