Giter VIP home page Giter VIP logo

sirensolutions / kibi Goto Github PK

View Code? Open in Web Editor NEW
491.0 95.0 111.0 293.97 MB

PLEASE READ: Kibi is now "Siren Investigate", part of the Siren Platform. This code repository is only provided to facilitate code review and integration by Siren customers and cannot be successfully compiled. The code also requires Siren Federate to be installed in Elasticsearch.

Home Page: http://siren.io

License: Other

JavaScript 89.85% Shell 0.09% HTML 7.06% CSS 2.88% Batchfile 0.02% Ruby 0.04% CartoCSS 0.04% Roff 0.02%
siren kibana elasticsearch kibi joins relational-browsing

kibi's Introduction

Siren Investigate 10.0-SNAPSHOT

Siren Investigate extends Kibana 5.6.5 with data intelligence features; the core feature of Siren Investigate is the capability to join and filter data from multiple Elasticsearch indexes and from SQL/NOSQL data sources ("external queries").

In addition, Siren Investigate provides UI features and visualizations like dashboard groups, tabs, cross entity relational navigation buttons, an enhanced search results table, analytical aggregators, HTML templates on query results, and much more.

Upgrade from previous version

  • Move any custom configurations in your old kibi.yml to the new investigate.yml file
  • Reinstall plugins
  • Start or restart Siren Investigate

Releases

Starting from Kibi version 5.4.3, all releases are done as part of Siren Platform, and can be downloaded from https://support.siren.io

Quick start

  • Download the Siren Platform distribution: https://support.siren.io
  • Start Elasticsearch by running elasticsearch\bin\elasticsearch on Linux/OS X or elasticsearch\bin\elasticsearch.bat on Windows.
  • Go to the siren-investigate directory and run bin/siren on Linux/OS X or bin\siren.bat on Windows.

A pre-configured Siren Platform is now running at http://localhost:5606; a complete description of the demo is available in the Siren Platform documentation.

Documentation

Visit siren.io for the full Kibi documentation.

Compatibility Table Siren Investigate / Elasticsearch

TODO: prepare a new table

License

Copyright 2015–2018 SIREn Solutions

Siren Investigate is Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Please note that Siren Investigate uses the Siren Federate Plugin for Elasticsearch which is licenced as AGPL version 3.0. For more information see the licensing section on siren.io website

https://siren.io

Acknowledgments

Kibana is a trademark of Elasticsearch BV, registered in the U.S. and in other countries.

kibi's People

Contributors

bargs avatar bevacqua avatar bigfunger avatar blakko avatar bleskes avatar cjcenizal avatar colmose avatar debadair avatar elastic-jasper avatar epixa avatar fabiocorneti avatar felixls avatar jbudz avatar lukasolson avatar mehmetfurkanaydin avatar panda01 avatar ppisljar avatar rashidkpc avatar scampi avatar sergibondarenko avatar simianhacker avatar spalger avatar spenceralger avatar stacey-gammon avatar stormpython avatar szydan avatar thomasneirynck avatar tsullivan avatar w33ble avatar ycombinator avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

kibi's Issues

Marvel sense plugin not compatible with 0.3.1

Grabbed the latest full demo (0.3.1) and installed. Installed the absolutely most crucial plugin Marvel/Sense and got this when restarting Kibi:

[error][status][plugin:marvel] Status changed from yellow to red - Marvel version 2.2.0 is not supported with Kibana 0.3.1

Tried removing plugin and re-installing and made no difference. Is there a specific version I can force? Earlier in the day I played with 0.3.0 and that seemed to work fine.

Elasticsearch 2

Hello,

Just want to know than you plan to upgrade the core to use Elasticsearch 2 (it might be merging Kibana 4.3 in Kibi, I suppose), currently I see next message

Kibana: This version of Kibana requires Elasticsearch ^1.4.4 on all nodes. I found the following incompatible nodes in your cluster:

Elasticsearch v2.1.0 @ localhost/127.0.0.1:9200 (127.0.0.1)

It is completely blocked me to test your solution :-(

Looking forward to see a new version,
Pavel

Error with JDBC Connection

I added the JDBC connections settings on Kibi from end. But was prompted to enable the load_jdbc: true setting in the kibi.yml file. I did this and I get the error below when I start kibi

bin/kibi: line 27: bin/../bin/create_symlink.sh: Permission denied
  log   [13:21:58.842] [warning][config] Settings for "load_jdbc" were not applied, check for spelling errors and ensure the plugin is loaded.

Help with this

sparql over http datasource

Can't make a query work over a sparql http datasource.

Keeps getting "Parameter 'url' must be a string, not undefined" in the the json preview.

Run kibi with external nodejs server

Hi, is that possible to run kibi with external nodejs server which is already installed? I reconfigured the kibi.sh script as follows:

!/bin/sh

SCRIPT=$0

while [ -h "$SCRIPT" ] ; do
ls=$(ls -ld "$SCRIPT")

Drop everything prior to ->

link=$(expr "$ls" : '.-> (.)$')
if expr "$link" : '/.*' > /dev/null; then
SCRIPT="$link"
else
SCRIPT=$(dirname "$SCRIPT")/"$link"
fi
done

DIR=$(dirname "${SCRIPT}")/..
NODE=node
SERVER=${DIR}/src/bin/kibi.js

$DIR/bin/create_symlink.sh

ROOT_DIR="$DIR/" CONFIG_PATH="${DIR}/config/kibi.yml" NODE_ENV="production" exec "${NODE}" --debug ${SERVER} ${@}

then I started the kibi application but there were a lot of "Cannot find module" exceptions thrown out.
Any help will be appreciated.

Best,

Kibi hangs on start on Windows x64 with JDBC enabled

Versions

Kibi: 4.4.2.1

Operating System:
Windows 7/Server 2008 R2 x64 or greater

Problem

After setting kibi_core.load_jdbc: true kibi does not start.

CPU spins and command line reads:

Checking jdbc_enabled flag in <My install folder>
Detected jdbc_enabled: [true]

How I fixed it

  1. Ensure JAVA_HOME is set to your program files java folder
  2. Add an empty file named javac.exe to %JAVA_HOME%\bin

Comments

Hello all, I had this issue trying to start Kibi with kibi_core.load_jdbc: true set in my kibi.yml file.
I spent some time on google and found some details about a workaround that disabled JDBC but allowed kibi to start on windows x64. But i needed JDBC, so i did some research and think i have a fix.

The issue at it's heart is that Kibi uses node package JDBC which uses ultimately Find-Java-Home npm package.

After fiddling with the package installation and eventually looking at the source code i discovered that this package locates the java home directory by:

  1. Does JAVA_HOME env variable exist
  2. If so does the path %JAVA_HOME% actually exist on disk
  3. If so does %JAVA_HOME%\bin\javac.exe exist on disk

My fresh Java 8 x64 installation does not have javac.exe

I created an empty file at this location and Kibi loaded just fine with the JDBC driver i configured.

Hopefully this workaround helps someone who comes googling.

timeline

In kibi 0.3 isn't possible to create a new timeline. The config (options) panel is disabled.

Unable to load "ace-sparql" modules because of a generic script error.

When we try to run the project using npm start[Already downloaded all node modules as well as bower components].

In require.config.js file:

'ace-sparql': 'bower_components/ace-builds/src-noconflict/mode-sparql' --This is included.But this file doesnot exists in the bower module. And when we try to comment out the lines where this is being used..some other errors come from gridster.

SO we are currenty having problem to clone the project from this link of git hub and to run the application using node.

Elastic search is started.
Can you give us a solution to run the application from this clone code of KIBI.
isue

Tabbed dashboards to be proposed in Kibana?

Hi guys!

First of all, congratulations for your great work extending Kibana to create KIbi.

The tabbed dashboards navigation is pretty cool. Do you plan to propose it as a PR to Kibana project?

Sorry if this is not the right place for this kind of discussion.

Cheers

TypeError: Cannot read property 'byName' of undefined

Versions

Kibi: 4.4.2 and master

Operating System: OSX 10.11.5

Behavior:

More often than not (but still not always) the "Discover" tab errors out with TypeError: Cannot read property 'byName' of undefined. Kibana 4.4.2 has no such issue when using the exact same ES cluster.

Expected:

screen shot 2016-06-21 at 10 02 54

Actual:

image

Steps to reproduce the problem

Go to "Discover" tab.

Relational filter run out of an exception when i was using it on cluster

Versions

Kibi: 0.3.2

siren-join: 2.1.2 or a higer version but not use bloom filter

Operating System: CentOS6.7

Behavior

the siren-join plugin can not find data-node in cluster

Expected:

catch 06-16-14-21-21

Actual:

the cluster is working well, its status is green. but when i am trying to use Relational filter, this exception will be accured.
This situation will not happen when i just have only one node.

Steps to reproduce the problem

set up a cluster with elasticsearch2.2.0
client-node: 1
master-node:3
data-node:3
3 shards 1 replica
each node has a siren-join plugin, a head plugin ,and a bigdesk, kopf . sql

connect kibi to the client-node, then use the Relational filter.

duplicate relational filters in filter bar

Versions

Kibi: 4.4.1

Operating System:

osx 10.10.3

Behavior

Duplicate relational filters displayed in filter bar

Expected:

When using the Relational Filter visualization to browse to another dashboard, kibi should recognize duplicate relational filters and keep only one.

Actual:

Duplicate Relational filters apear in filters bar.

Steps to reproduce the problem

With kibi demo version, start in Articles dashboard. Use the Companies --> () button provided in the Relational Filter visualization to browse to the Companies dashboard. As expected, the Companies dashboard is displayed with one filter.

Use the navigation tabs to browse back to the Articles dashboard.

Use the Companies --> () button provided in the Relational Filter visualization to browse to the Companies dashboard. Wow... why are there now duplicate As mentioned in Articles filters in the filters bar?

Relations not working correctly?

Hi,

i noticed some strange behaviors (or I’m doing something wrong, of course) where relations are behaving very strangely.

Short explanation - when filtering accounts based on all transactions, I get listed some accounts that are not connected with transactions as a Payee (“platitelj_racun”).

Screencast link: https://www.dropbox.com/s/q9qjuc7d2qu97a5/Kibi%20screencast.mp4?dl=0

Explained:

  • in screencast you can see definition: transactions.platitelj_racun -> accounts.iban
  • in transactions dashboard click on relation to accounts based on relation above
  • showing accounts (that should be) connected to transactions
  • filtering one of those account in accounts tab
  • returning to transactions tab and filtering same there
  • nothing returned - where there should be at least one transaction with “platitelj_racun” having that account

Kibi version: 4.4.1, Build 9010
Sire plugin version: 2.2.0-1
ES version: 2.2.0

If any more information is needed, just ask.

Questions

Hello,

Congratulations for this very good Kibana fork. I have a few questions.

  1. How could one change the logo that is displayed in the top left corner of the interface?
  2. How could one eliminate some of the options that are displayed in the top menu bar, so that, for example, only the Discover menu is displayed?
  3. Last, what is the procedure in order to install Kibana plugins in Kibi, for example Shield or Sense?

Thank you!

Issue about Dashboard search bar cookie.

Versions

Kibi: 4.4.2-1

Operating System:
Server: CentOS 6.7
Client: Win10 Pro 1511
Browser:Chrome 52.0.2743.116 m

Behavior

Use search bar and select cookie in the Dashboard.

Expected:

Use selected cookie as filter and refresh this Dashboard.

Actual:

Whole kibi page reloaded, and after reload action the whole page's dark theme did not work properly.

Steps to reproduce the problem

1.Set kibi.yml: kibana.defaultAppId: dashborad/test
Set kibi/Settings/Advanced: dashboard:defaultDarkTheme: true

2.Open kibi page in the browser

3.Type something(such as: "name:") in the search bar and select the cookie(such as: "name: sarufarr")

Then the whole page reloaded, and the dark theme seems crashed.

Forgive my laziness, there is another problem happened when I use kibi recently.
If I click the option button of the visualization window in Dashboard.
(Just the "Pen" beside the delete button "Close" on the left-top of the visualization window.)
The whole Dashboard page will change into white first and jumped into Visualize page.
And then if I click the Dashboard button to jump back to Dashboard page, I notice the visualization window shape changed. It seems that your dashboard layout adaptive algorithm goes wrong. After I refresh the whole page, the layout become correct again.

I'm sorry for my poor English. XD
If you have some doubt about what I wrote, you can E-mail me.
Looking forward to receive your response.

Question - Cherry picking visualisations

Hi!

I'm really impressed with what Kibana can come up with and how Kibi extends it, my question is about taking the visualisations a step further.

Currently, Kibana and Kibi provide a user interface to manage queries and make visualisations out of it, great! But what if I were only to present the visualisations to others, in order to integrate it with a website or web app. So, the people viewing the vis. don't need to manage the query themselves or indulge themselves into the Kibana (Kibi) Web UI, but only see a useful graphical representation of data.

Is such a thing possible (or with another jQuery based platform on top of ES perhaps)? If my question is not clear, compare it with youtube and their embed urls, but then for Kibana (Kibi).

Error on startup

I get the following error when I start kibi after installing the software:

{
  "name": "Kibana",
  "hostname": "ip-172-31-31-231",
  "pid": 7814,
  "level": 50,
  "err": {
    "message": {
      "root_cause": [
        {
          "type": "search_parse_exception",
          "reason": "No mapping found for [buildNum] in order to sort on"
        }
      ],
      "type": "search_phase_execution_exception",
      "reason": "all shards failed",
      "phase": "query",
      "grouped": true,
      "failed_shards": [
        {
          "shard": 0,
          "index": ".kibi",
          "node": "kfiuoBvdTLaE3oHD-0d2pw",
          "reason": {
            "type": "search_parse_exception",
            "reason": "No mapping found for [buildNum] in order to sort on"
          }
        }
      ]
    },
    "name": "Error",
    "stack": "Error: [object Object]\n at respond (/opt/kibi-0.2.0-linux-x64/src/node_modules/elasticsearch/src/lib/transport.js:235:15)\n at checkRespForFailure (/opt/kibi-0.2.0-linux-x64/src/node_modules/elasticsearch/src/lib/transport.js:203:7)\n at HttpConnector. (/opt/kibi-0.2.0-linux-x64/src/node_modules/elasticsearch/src/lib/connectors/http.js:156:7)\n at IncomingMessage.bound (/opt/kibi-0.2.0-linux-x64/src/node_modules/elasticsearch/node_modules/lodash-node/modern/internals/baseBind.js:56:17)\n at IncomingMessage.emit (events.js:117:20)\n at _stream_readable.js:944:16\n at process._tickCallback (node.js:442:13)"
  },
  "msg": "",
  "time": "2016-02-10T20:57:07.598Z",
  "v": 0
}

Any assistance would be appreciated.

Visualize: Bad Gateway

export data from an "Enhanced search result"

It would be very important and useful to have the data export inside the widget "Enhanced search result": the behavior should be the same as in the other widget (export as raw or formatted).

Missing sql_jdbc datasource type

Versions

Kibi: 4.4.1-1

Operating System:

Behavior

Unable to retrieve query variables for sql_jdbc datasource type.
See src/ui/public/kibi/directives/kibi_select_helper.js:241.

core during computing join

screenshot from 2016-05-20 09 44 08
To improve performance and it would be possible make computing joins multi core? If you look my screenshot there is just one core running, but joins in this case are 7.

URIError: URI malformed errors when building from source

All:

I'm working on building from source via these instructions: https://github.com/sirensolutions/kibi/blob/master/CONTRIBUTING.md

When I execute "npm start" and attempt to browse to "http://localhost:5606/app/kibana" I receive a TON of these types of errors on the command line:

ERROR in ./src/ui/public/chrome/directives/app_switcher/app_switcher.less
    Module build failed: ModuleBuildError: Module build failed: URIError: URI malformed

ERROR in ./src/plugins/kibana/public/visualize/styles/main.less
    Module build failed: ModuleBuildError: Module build failed: URIError: URI malformed

ERROR in ./src/ui/public/styles/list-group-menu.less
    Module build failed: ModuleBuildError: Module build failed: URIError: URI malformed

And so on and so forth. I've opened a few of these ".less" files and modified the "@import (reference)" statements with various file variations on the file path to no avail.

Is there is a solution for this, or perhaps I'm missing something?

Thanks,
Nathan

Relational Panel Configuration

Hello,
The Relational Panel configuration seems to be intuitive but I can't seem to configure the left/right panel relationship. I've configured the index pattern relations and the labels appear in the label selection in the Relational Panel configuration widget, but the dash board selection remains empty (I have two dashboards defined for the related indices).

Sorry about the doc. I'll try it again.
The fields are the same type: string, not_analyzed.

Sorry about the doc. I'll try again.
The fields are the same type: string, not_analyzed.

Kibi_issue.zip

Export to CSV from table visualisation

Hi are there any plans to include an "Export Raw/Formatted" feature to the table visualisation in Kibi? If not, is this something that you would consider including in Kibi if somebody submitted a pull request?

Find identical field values from different indexes

Is it possible to find identical field values from different indexes and list the corresponding files? Let's say I have two syslogs and I need to find the IP addresses that occur in both logs. Is that possible to do with kibi?

Thanks a lot.

Kibi dies unexpectedly if connection (or ES) goes down

If ES is down or unreacheable, kibi dies with:

/root/production/kibi/kibi-0.3.2-linux-x64/src/plugins/kibi_core/lib/query_engine.js:90
self._isKibiIndexPresent().then(function () {
^
TypeError: undefined is not a function
at [object Object].QueryEngine.loadTemplates as _onTimeout
at Timer.listOnTimeout (timers.js:119:15)

IMO, it should be a little more robust wrt ES availability.

count on relational buttons

Versions

Kibi: 0.3.3 biuld n. 8971

Operating System: ubuntu 14.04

Behavior

The count on relational buttons seems not work as expected.

Expected:

Actual:

Steps to reproduce the problem

  1. Start from a dashboard without filters.
  2. The buttons have just (*)
  3. Select a filter
  4. The count is updated
  5. Remove filter and the count is updated (with all documents from other indexes)
  6. Refresh page and the count is again (*)

out-2.ogv.zip

Numbers are interpreted as text in Datasource form if I modify those settings

Hello!
I tried kibi and found it very nice, but I found a weird behavior and a workaround.

Versions

Kibi: 4.4.2-1

Operating System: Linux version 4.4.11-23.53.amzn1.x86_64 (mockbuild@gobi-build-60009) (gcc version 4.8.3 20140911 (Red Hat 4.8.3-9) (GCC) ) #1 SMP Wed Jun 1 22:22:50 UTC 2016

Behavior

When I create or edit MySQL datasource and set timeout/max_age to other than default number,
properties are saved as text, which results in an error below:

TypeError: Uncaught error: msecs must be a number
at Object.exports.enroll (timers.js:152:11)
at Protocol._startSequence (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/Protocol.js:348:12)
at Protocol._dequeue (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/Protocol.js:343:8)
at Handshake. (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/Protocol.js:157:12)
at emitNone (events.js:67:13)
at Handshake.emit (events.js:166:7)
at Handshake.Sequence.end (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/sequences/Sequence.js:99:12)
at Handshake.Sequence.OkPacket (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/sequences/Sequence.js:105:8)
at Protocol._parsePacket (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/Protocol.js:280:23)
at Parser.write (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/Parser.js:73:12)
at Protocol.write (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/protocol/Protocol.js:39:16)
at Socket. (/home/ec2-user/kibi/kibi-4.4.2-1-linux-x64/node_modules/mysql/lib/Connection.js:96:28)
at emitOne (events.js:77:13)
at Socket.emit (events.js:169:7)
at readableAddChunk (_stream_readable.js:146:16)
at Socket.Readable.push (_stream_readable.js:110:10)
at TCP.onread (net.js:523:20)

I can manually fix the problem by removing quotes from "Objects -> datasource -> edit" menu.

Expected:

Those properties are saved as int when I create a datasource and leave those settings default.
I suppose it is supposed to be saved as int when I modify those properties.

Actual:

Modified number properties are saved as text.

Steps to reproduce the problem

Create MySQL datasource and modify max_age/timeout, then save the settings.

Best regards!

error when use the demo provided by official

[2016-05-12 17:14:04,296][INFO ][rest.suppressed          ] /.kibi/template/kibi-json-jade Params: {index=.kibi, op_type=create, id=kibi-json-jade, type=template}
RemoteTransportException[[Grey King][127.0.0.1:9330][indices:data/write/index[p]]]; nested: DocumentAlreadyExistsException[[template][kibi-json-jade]: document already exists];
Caused by: [.kibi][[.kibi][1]] DocumentAlreadyExistsException[[template][kibi-json-jade]: document already exists]
    at org.elasticsearch.index.engine.InternalEngine.innerCreateNoLock(InternalEngine.java:432)
    at org.elasticsearch.index.engine.InternalEngine.innerCreate(InternalEngine.java:390)
    at org.elasticsearch.index.engine.InternalEngine.create(InternalEngine.java:362)
    at org.elasticsearch.index.shard.IndexShard.create(IndexShard.java:515)
    at org.elasticsearch.index.engine.Engine$Create.execute(Engine.java:810)
    at org.elasticsearch.action.index.TransportIndexAction.executeIndexRequestOnPrimary(TransportIndexAction.java:236)
    at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:157)
    at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:65)
    at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase.doRun(TransportReplicationAction.java:595)
    at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
    at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:263)

Kibi index NOT found

Kibi 0.3.2 full demo version windows 64, getting below error frequently. Suspect related to timeout, though not sure where one would increase it.

log [10:47:25.032] [error][status][plugin:elasticsearch] Status changed from green to red - Request Timeout after 1500ms
log [10:47:32.124] [info][status][plugin:elasticsearch] Status changed from red to green - Kibana index ready
log [10:47:33.171] [warning][query_engine] Kibi index NOT found
H:\dev\Kibi-0.3.2\kibi-0.3.2-demo-full-windows64\kibi\src\plugins\kibi_core\lib\query_engine.js:90
self._isKibiIndexPresent().then(function () {
^
TypeError: undefined is not a function
at [object Object].QueryEngine.loadTemplates [as _onTimeout](H:devKibi-0.3.2kibi-0.3.2-demo-full-windows64kibisrcplugi
nskibi_corelibquery_engine.js:90:8)
at Timer.listOnTimeout (timers.js:119:15)

Re-starting and navigating to the same page sometimes works.

java version "1.8.0_60"
Java(TM) SE Runtime Environment (build 1.8.0_60-b27)
Java HotSpot(TM) 64-Bit Server VM (build 25.60-b23, mixed mode)

Error when activating load jdbc : libjvm.so

Kibi Version: 4.4.2
Operating System: Linux CentOS 7
Error report in kibi configuration
kibi_core:
load_jdbc: true

path: kibi/config/kibi.yml

Log:

  log   [17:06:22.246] [info][query_engine] Loading templates
  log   [17:06:22.675] [error][kibi_core] Error: libjvm.so: cannot open shared object file: No such file or directory
    at Error (native)
    at Object.Module._extensions..node (module.js:434:18)
    at Module.load (module.js:343:32)
    at Function.Module._load (module.js:300:12)
    at Module.require (module.js:353:17)
    at require (internal/module.js:12:17)
    at Object.<anonymous> (/opt/kibi-4.4.2/kibi/node_modules/jdbc/node_modules/java/lib/nodeJavaBridge.js:21:16)
    at Module._compile (module.js:409:26)
    at Module._extensions..js (module.js:416:10)
    at Object.require.extensions.(anonymous function) [as .js] (/opt/kibi-4.4.2/kibi/node_modules/babel-core/lib/api/register/node.js:214:7)
    at Module.load (module.js:343:32)
    at Function.Module._load (module.js:300:12)
    at Module.require (module.js:353:17)
    at require (internal/module.js:12:17)
    at Object.<anonymous> (/opt/kibi-4.4.2/kibi/node_modules/jdbc/node_modules/java/index.js:2:18)
    at Module._compile (module.js:409:26)
    at Module._extensions..js (module.js:416:10)
    at Object.require.extensions.(anonymous function) [as .js] (/opt/kibi-4.4.2/kibi/node_modules/babel-core/lib/api/register/node.js:214:7)
    at Module.load (module.js:343:32)
    at Function.Module._load (module.js:300:12)
    at Module.require (module.js:353:17)
    at require (internal/module.js:12:17)
  log   [17:06:22.676] [error][status][plugin:kibi_core] Status changed from yellow to red - Query engine initializiation failed

Error: libjvm.so: cannot open shared object file: No such file or directory
kibi/bin/java_home_lib_server -> /opt/jdk/jdk1.8.0_91/jre/lib/amd64/server
rwxrwxrwx 1 10 143 16925812 Abr 1 05:06 libjvm.so

As you can see the file exists in the libraries folder but displays error loading the kibi and the server is bad status.
If you turn off the load jdbc , the server starts smoothly.

tilemap isn't zooming more than 8 levels

Versions

Kibi: 4.4.2-1

Operating System:
Linux

Behavior

When using WMS complaint map (like defined in fix bug on the 13 of july)
the map is zooming till some level, and then the Plus + button is going gray and i can't zoom anymore

The behavior is like i have 7-8 level of zoom only...

Expected:

In other environment (Windows 64 bit) with kibi 4.4.2 the zoom is working fine

Actual:

Steps to reproduce the problem

can not get the correct result on version 2.2.*

I have two index, DNS and UDP.
DNS has a field named address, UDP has a field named dip.
I want to join the index DNS and UDP with these field.

The correct result should be**:** After joined, the unique count of DNS and UDP should be equal. And the content of DNS's field address and UDP's field dip should be equal too.

when i was using ES2.1 and siren-join 2.1, i got the correct result
THE RESULT OF DNS(correct)
image

THE RESULT OF UDP(correct)
image

but, when i use ES2.2 and siren-join 2.2 or 2.2.0-1, the result was wrong
THE RESULT OF DNS(wrong)
image

THE RESULT OF UDP(wrong)
image

I mentioned that in version 2.1 you are using FieldDataTermsQueryHelper.hash , but in version 2.2.* you change it into LongBloomFilter.hash3_x64_128.
I 'm not sure if it is different that the way to use version 2.2.* and version 2.1.* on kibi , Or the new algorithm of hash has a bug....

The dashboard search bar did not work.

Here is condition: I have set up the kibi default dashboard("dashboard-One") in the kibi.yml.

If I type in the URL: 192.168.0.1:5601 ("locahost:port") into the browser address bar, the kibi jumped to "dashboard-One" as I expected.

But the dashboard search bar did not work whatever I type in at this time.

And the search bar would work properly after I chose the DISCOVER page and went back to DASHBOARD page.

Looking forward to hearing from you soon.

[Linux x64] Sqlite dependency requires GLIBC 2.14

Hello,
I'm trying to use kibi on my Linux x64 (Red Hat Enterprise Linux Server release 6.5 (Santiago)) and getting the below issue regarding Sqlite:

module.js:356
  Module._extensions[extension](this, filename);
                               ^
Error: /lib64/libc.so.6: version 'GLIBC_2.14' not found (required by /myPath/kibi-0.2.0-linux-x64/src/node_modules/sqlite3/lib/binding/node-v11-linux-x64/node_sqlite3.node)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/myPath/kibi-0.2.0-linux-x64/src/node_modules/sqlite3/lib/sqlite3.js:4:15)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/myPath/kibi-0.2.0-linux-x64/src/lib/sindicetech/sqliteQuery.js:5:15)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/myPath/kibi-0.2.0-linux-x64/src/lib/sindicetech/queryEngine.js:14:19)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/myPath/kibi-0.2.0-linux-x64/src/routes/proxy.js:17:19)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/myPath/kibi-0.2.0-linux-x64/src/app.js:14:13)
    at Module._compile (module.js:456:26)

I'm running on GLIBC 12.2 :

-bash-4.1$  /lib64/libc.so.6
GNU C Library stable release version 2.12, by Roland McGrath et al.
Copyright (C) 2010 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
Compiled by GNU CC version 4.4.7 20120313 (Red Hat 4.4.7-9).
Compiled on a Linux 2.6.32 system on 2015-01-19.
Available extensions:
        The C stubs add-on version 2.1.2.
        crypt add-on version 2.1 by Michael Glad and others
        GNU Libidn by Simon Josefsson
        Native POSIX Threads Library by Ulrich Drepper et al
        BIND-8.2.3-T5B
        RT using linux kernel aio
libc ABIs: UNIQUE IFUNC
For bug reporting instructions, please see:
<http://www.gnu.org/software/libc/bugs.html>.
-bash-4.1$ yum -y update glibc
Loaded plugins: downloadonly, security
You need to be root to perform this command.

How should I deal with this issue? Is it possible to use another version of node-sqlite?

Thanks a lot

Relational Filter - minus joins

Firstly, great work you guys on siren join and kibi!

Is there a way for me to do minus/not joins on Kibi? The relational filter (using siren-join) constructs a left join elastic search query. Can the relational filter be configured to construct a minus join query?

Suppose, I've 2 indices - emails sent and users and I wish to find users who haven't been sent an email.

I was able to do this using a plain elastic search query (as an external REST datasource) and including the results on the dashboard using a template. This seemed a little cumbersome and unintuitive.

Is there any plan to provide this feature on the relational filter itself?

Thanks.

Compatibility with ES 1.7.2

Versions

Kibi: 4.4.2
Operating System: OSX el capitan 10.11.3
ES: 1.7.2

Behavior

My version of elasticsearch is incompatible with this version of Kibi. I'd like to know what version of Kibi can I install that is compatible with ES 1.7.2

Actual:

Status changed from red to red - This version of Kibana requires Elasticsearch ^2.2.0 on all nodes. I found the following incompatible nodes in your cluster: Elasticsearch v1.7.2 @ inet/192.168.1.79:9200

Sense plugin causing kibi_core not to start

I installed the full demo of 0.3.1 and the Sense plugin and restarted Kibi.

Now on restart the kibi_core will not start causing every page of Kibi to go the the Status page.

The startup error is
[info][status][plugin:kibi_core] Status changed from uninitialized to yellow - Initialising the query engine

But it never finished. If I remove the Sense plugin and restart the cache gets rebuilt and everything works again. But as soon as Sense is installed 0.3.1 stops working.

0.3.0 worked fine, but 0.3.1 is broken with Sense.

Feature request - export Relations objects

In Settings->Objects there is no "Relations" tab which would enable us to export/import relations. This would be quite helpful having in mind that there can be many relations between indexes and that removing and creating instances of ELK stack is quite usual process in development.

timeline after selection

Versions

Kibi: Kibi: 0.3.3 biuld n. 8971

Operating System: ubuntu 14.04 64 bit

Behavior

The timeline doesn't show events and states after an aggregation filter

Expected:

The timeline should show the events also after a filter

Actual:

Steps to reproduce the problem

  1. Dashboard without filter show timeline with first 10 (configured) events for each index.
  2. Select some documents by Data Table
  3. The timeline does't show anything.
  4. After remove the filter timeline show again events/states
    out-2-1.ogv.zip

kibi-icons missing in npm

Versions

Kibi_timeline_vis-4.4.2

Kibi:

Operating System:

Behavior

Unable to manually install Kibi_timeline_vis .

Expected:

Kibi_timeline_vis needs kibi-icons.In npm this library is missing.

Can you add it please

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.