averni / munin-solr Goto Github PK

Producing values like "4235529.00000000" cause DERIVE type graphs to fail.

LOGS:

2013/09/11 13:26:24 [ERROR] In RRD: Error updating /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-inserts-d.rrd: /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-inserts-d.rrd: not a simple integer: '4235529.00000000'
2013/09/11 13:26:24 [DEBUG] asking for a rrd of size : normal
2013/09/11 13:26:24 [DEBUG] rrd filename: /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-hits-d.rrd
2013/09/11 13:26:24 [DEBUG] Updating /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-hits-d.rrd with 1378902384:3365962.00000000
2013/09/11 13:26:24 [ERROR] In RRD: Error updating /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-hits-d.rrd: /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-hits-d.rrd: not a simple integer: '3365962.00000000'
2013/09/11 13:26:24 [DEBUG] asking for a rrd of size : normal
2013/09/11 13:26:24 [DEBUG] rrd filename: /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-lookups-d.rrd
2013/09/11 13:26:24 [DEBUG] Updating /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-lookups-d.rrd with 1378902384:7601491.00000000
2013/09/11 13:26:24 [ERROR] In RRD: Error updating /var/lib/munin/xxx.com/www.xxx.com-solr_xxx_prod_documentcache_hit_rates-lookups-d.rrd: /var/lib/munin/xxx.com/www.xxx.com-solr_pitch

CONFIG:

multigraph solr_xxx_prod_documentcache_hit_rates
graph_category solr
graph_title Solr xxx_prod Document Cache Hit rates
graph_order lookups hits inserts
graph_scale no
graph_vlabel Hit Rate
graph_args -u 100 --rigid
lookups.label Cache lookups
lookups.graph no
lookups.min 0
lookups.type DERIVE
inserts.label Cache misses
inserts.min 0
inserts.draw STACK
inserts.cdef inserts,lookups,/,100,*
inserts.type DERIVE
hits.label Cache hits
hits.min 0
hits.draw AREA
hits.cdef hits,lookups,/,100,*
hits.type DERIVE

multigraph solr_xxx_prod_documentcache_size
graph_title Solr xxx_prod Document Cache Size
graph_args -l 0
graph_category solr
graph_vlabel Size
size.label Size
size.draw LINE2
evictions.label Evictions
evictions.draw LINE2

VALUES:

multigraph solr_xxx_prod_documentcache_hit_rates
lookups.value 9622876.00000000
hits.value 4530259.00000000
inserts.value 5092617.00000000
multigraph solr_xxx_prod_documentcache_size
size.value 512
evictions.value 5073980

The environment entries are not working if the group name [solr4_*] does not match plugin names

Either the [solr4__] has to be renamed to [solr__]
or the logical links for the plugins have to be renamed to solr4_qps instead of solr_qps

For solr_qps, if you have few queries per day plugin produce data like:

# munin-run solr_qps 
qps_category.value 2.87549924323e-05
qps_filter.value 3.06719911605e-05
qps_product.value 5.75099821289e-05

and errors in log:

2013/08/05 13:05:15 [INFO] creating rrd-file for solr_qps->qps_filter: '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_filter-l.rrd'
2013/08/05 13:05:15 [ERROR] Unable to create '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_filter-l.rrd': Invalid DS type
2013/08/05 13:05:15 [ERROR] In RRD: Error updating /var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_filter-l.rrd: opening '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_filter-l.rrd': No such file or directory
2013/08/05 13:05:15 [INFO] creating rrd-file for solr_qps->qps_product: '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_product-l.rrd'
2013/08/05 13:05:15 [ERROR] Unable to create '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_product-l.rrd': Invalid DS type
2013/08/05 13:05:15 [ERROR] In RRD: Error updating /var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_product-l.rrd: opening '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_product-l.rrd': No such file or directory
2013/08/05 13:05:15 [INFO] creating rrd-file for solr_qps->qps_category: '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_category-l.rrd'
2013/08/05 13:05:15 [ERROR] Unable to create '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_category-l.rrd': Invalid DS type
2013/08/05 13:05:15 [ERROR] In RRD: Error updating /var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_category-l.rrd: opening '/var/lib/munin/my.domain/lvsdr1.my.domain-solr_qps-qps_category-l.rrd': No such file or directory

Similiar problem is in solr_requesttimes:

# munin-run solr_requesttimes 
multigraph category_requesttimes
s75thpcrequesttime_category.value 0.18225
savgtimeperrequest_category.value 2.830934
s99thpcrequesttime_category.value 39.940578
...

logs;

2013/08/05 13:05:13 [INFO] creating rrd-file for category_requesttimes->s75thpcrequesttime_category: '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s75thpcrequesttime_category-g.rrd'
2013/08/05 13:05:13 [ERROR] Unable to create '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s75thpcrequesttime_category-g.rrd': Invalid DS type
2013/08/05 13:05:13 [ERROR] In RRD: Error updating /var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s75thpcrequesttime_category-g.rrd: opening '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s75thpcrequesttime_category-g.rrd': No such file or directory
2013/08/05 13:05:13 [INFO] creating rrd-file for category_requesttimes->savgtimeperrequest_category: '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-savgtimeperrequest_category-g.rrd'
2013/08/05 13:05:13 [ERROR] Unable to create '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-savgtimeperrequest_category-g.rrd': Invalid DS type
2013/08/05 13:05:13 [ERROR] In RRD: Error updating /var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-savgtimeperrequest_category-g.rrd: opening '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-savgtimeperrequest_category-g.rrd': No such file or directory
2013/08/05 13:05:13 [INFO] creating rrd-file for category_requesttimes->s99thpcrequesttime_category: '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s99thpcrequesttime_category-g.rrd'
2013/08/05 13:05:13 [ERROR] Unable to create '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s99thpcrequesttime_category-g.rrd': Invalid DS type
2013/08/05 13:05:13 [ERROR] In RRD: Error updating /var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s99thpcrequesttime_category-g.rrd: opening '/var/lib/munin/my.domain/lvsdr1.my.domain-category_requesttimes-s99thpcrequesttime_category-g.rrd': No such file or directory

I had to edit the shebang line at the top to run python2 rather than python, to make it run.

You have for example:

uri = "/solr/admin/cores?action=STATUS&wt=json"

but for me it is not suitable because I need something like this:

uri = "/search/admin/cores?action=STATUS&wt=json"

I use name of Solr schema 'search' not 'solr' (defined as xml in /etc/tomcat6/Catalina/localhost). Will be great to set it in Munins config file.