Giter VIP home page Giter VIP logo

helicalinsight / helicalinsight Goto Github PK

View Code? Open in Web Editor NEW
285.0 285.0 99.0 185.84 MB

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

Home Page: https://helicalinsight.github.io/helicalinsight/

License: Apache License 2.0

Java 78.97% JavaScript 12.87% CSS 4.03% HTML 4.13%
amazon-redshift big-data business-intelligence dashboard data-analysis data-visualization druid graph-database hive mongodb mysql neo4j nosql oracle-database postgresql rdbms reporting sql-editor sqllite

helicalinsight's Introduction

Helical Insight

Community driven innovation via Helical Insight CE.

What is it

Helical Insight is world's first Open Source Business Intelligence framework which can help you derive insights out of your one or multiple datasources. Helical Insight is having all the features which you generally expect out of any BI tool (be it open source or proprietary). Being a framework, Helical Insight is highly extensible via APIs and SDK, thus features can be extended whenever required without compromising on your business requirement.

Helical Insight also comes with a unique Workflow rule engine, allowing you to call any functionality of Helical Insight or external functionality and thus empowering you to implement any sort of custom business process.

Use HTML skillset and Java skillset to add functionalities at the frontend and backend respectively.

Click here for quick installation guide.

Features

  • New generation UI with one click access
  • Backend EFW method of reports, dashboards and other data analysis creation
  • User Role Management
  • Exporting to Multiple Formats
  • Email scheduling
  • Data Security
  • XML driven Workflow
  • API Driven Framework
  • Community Support
  • Community Upgrades
  • Direct links to tutorials
  • Mobile & Cloud compatible
  • Cache for faster Performance
  • Compatible with All Modern Browsers

Supported Databases

We support all the JDBC4 complaint databases, NoSQL, Big Data, RDBMS, Cloud db, Columnar database etc

RDBMS

  • MySQL
  • PostgreSQL
  • SQL Server
  • Oracle
  • Firebird
  • Informix
  • Ingres
  • MariaDB
  • Presto
  • Progress
  • SQlite

NoSQL & Big Data

  • Cassandra
  • Druid
  • HBase
  • MongoDb
  • Hive
  • NuoDB
  • Neo4j

Cloud

  • Microsoft Azure SQL
  • Amazon RedShift Database
  • Google Cloud Sql

Flat Files

  • CSV
  • TSV
  • JSON

How to build ?

Prerequisite:

To build Helical Insight Community Edition project you need

  • Maven 3 or higher version installed.
  • JDK 7 or higher version installed.
  • Apache tomcat 7 or 8 should be installed.
  • Use Mysql 5.7 or higher version.

NOTE: In case database is not accessed remotely then grant all priviledges to user.

  • Database with name hice to be created in Mysql. Using file db.sql, present in github at location helicalinsight/db-dump/db.sql.

Steps:

  1. Download the Helical Insight project from Helical Insight Github Page.

  2. Find the hikaricp, tomcat-jdbc jar files in the resources folder at <project-path>\helicalinsight-master\resources and then install it locally in your maven repository using command:

     a. mvn install:install-file -Dfile={path/to/file} -DartifactId=HikariCP -Dversion=2.4.7-hi -Dpackaging=jar
    
     Example: mvn install:install-file -Dfile=E:\helicalinsight-master\resources\HikariCP-2.4.7-hi.jar -DgroupId=com.zaxxer -DartifactId=HikariCP -Dversion=2.4.7-hi -Dpackaging=jar
    
     b. mvn install:install-file -Dfile={path/to/file} -DgroupId=org.apache.tomcat -DartifactId=jdbc-pool -Dversion=7.0.65 -Dpackaging=jar
    
     Example: mvn install:install-file -Dfile=E:\helicalinsight-master\resources\tomcat-jdbc-7.0.65.jar -DgroupId=org.apache.tomcat -DartifactId=tomcat-jdbc -Dversion=7.0.65 -Dpackaging=jar
    
  3. Change the below variables in the pom.xml present at location <project-path>\helicalinsight-master\hi-ce folder for configuring HI Repository , Log Location and Database credentials of the hice database.

Where:

a)<systemDirectory> : This is the Helical Insight Report repository path , which contains all created reports and dashboards i.e. <project-path>\helicalinsight-master\hi-repository.

b)<logLocation> : Location of Helical Insight Application log file i.e, <project-path>\helicalinsight-master\hi-repository\System\Logs.

c) Database credentials like

	<dbUser>DBUsername</dbUser>
	<dbPassword>DBPassword</dbPassword>
	<dbServer>DBName<dbServer>
	<dbPort>DBPort<dbPort>

d)<dbName>: The hice database which will store users/roles/profile information

Please refer the below example to do changes for production environment in pom.xml file

	<systemDirectory>path/to/SystemDirectory<systemDirectory>
	<logLocation>path/to/log/folder<logLocation>
	<dbUser>database-user-name<dbUser>
	<dbPassword>database-password<dbPassword>
	<dbServer>database-server-host<dbServer>
	<dbPort>database-port<dbPort>
	<dbName>hice<dbName>

	eg:
	<systemDirectory>E:/hi-repositorysystemDirectory>
	<!--This is the path which points to the hi-repository folder present with the download--&gt;
	<logLocation>E:/logs<logLocation> <!--log location--&gt;
	<dbUser>hiuser<dbUser>
	<dbPassword>hiuser<dbPassword>
	<dbServer>localhost<dbServer>
	<dbPort>3306<dbPort>
	<dbName>hice<dbName>

4.Do following changes in Setting.xml configurations :

a) Open the Helical Insights setting.xml file present at below location

	Location: <project-path>\helicalinsight-master\hi-repository\System\Admin\

b) Find the <efwSolution> tag and change the value to your hi-repository path like :
   <efwSolution><project-path>\helicalinsight-master\hi-repository</efwSolution>

c) Find the <BaseUrl> tag and change the value with your base url

	Format for base URL is:

	http://<ip_address>:<port_no>/hi-ce/hi.html

	Example:<BaseUrl>http://localhost:8080/hi-ce/hi.html</BaseUrl>

5.To view sample reports of hi-repository , import Sample Travel Data in your mysql database, present in github at location helicalinsight/db-dump/SampleTravelData.sql.

6.Update database details in sample reports in below files :

<project-path>\helicalinsight-master\hi-repository\Sample Reports\Sample EFW Dashboard\sample_dashboard.efwd
<project-path>\helicalinsight-master\hi-repository\Sample Reports\Travel Dashboard\travel_dashboard.efwd
<project-path>\helicalinsight-master\hi-repository\Sample Reports\1568094343090\d3b00d97-7864-41a4-ab67-c58abb3da198.efwd


<DataSources>
    <Connection id="1" type="sql.jdbc">
        <Driver>com.mysql.jdbc.Driver</Driver>
        <Url>jdbc:mysql://192.168.2.9:3306/SampleTravelData</Url>
        <User>devuser</User>
        <Pass>devuser</Pass>
    </Connection>
</DataSources>

where ,
<Driver> : Name of database driver.
<Url>    : Database connection URL with dbhost,database name as SampleTravelData.
<User>   : Username of database.
<Pass>   : Password of database.

7.Run the below command according to environment which builds the Helical Insight Community Edition project and creates the hi-ce.war file in target folder <project-path>\helicalinsight-master\hi-ce\target.

Go to the Helical Insight project location and run the following command :

		For Dev Environment

		mvn clean package -Denv=dev

		For Production Environment

		mvn clean package -Denv=production

8.Now Deploy the application on any webserver like Apache tomcat and access the application using above mention url.

http://<ip_address>:<port_no>/hi-ce/hi.html

Example: http://localhost:8080/hi-ce/hi.html

Directly deploy

You may also directly deploy the hi-ce.war file in the application server from the hi-ce/target module You need tomcat or any other server. Please follow the instructions given here

Application Screenshots

CommunityEdition

CommunityEdition

CommunityEdition

CommunityEdition

CommunityEdition

Sample Report

CommunityEdition

Admin Page

CommunityEdition

Examples

Check out the Demos to Helical Insight in use.

Try Enterprise Edition

Helical Insight Enterprise Edition comes with many addon features like self-service interface for reports and dashboards creation, multi tenancy, machine learning and NLP, UI driven workflow etc.

Try Now Download Free Trial.

License

Copyright (c) Helical Insight. All rights reserved.

Licensed under the Apache License.

helicalinsight's People

Contributors

helicalinsight avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

helicalinsight's Issues

Automated installer

Hi all,

I noticed that there were a lot of issues in the installers instructions. For example, missing instructions regarding database user, database name, issues in the db.sql dump. Instead of correcting them, I thought I'd try to re-make the installation experience by automating it in Ansible for Linux at least.

At the end, I'll end up with a simple yaml file alá
setting: value-x
setting2: value-y

I'm pretty far gone atm and hope to be done in the coming week or sooner. Please note that this makes the installer omnipotent as well, meaning you can re-run it without problems. Also, this fixes that db.sql contains statement for setting the root user password and allows the user to encrypt database / hi-ce user passwords using an Ansible vault.

Anyways. This turns the complete installations into editing the yaml settings file and running three commands:

[root@ip-172-31-24-100 ansible-installer]# yum -y install python-pip && pip install ansible
[root@ip-172-31-24-100 ansible-installer]# vi vars/settings.yml
[root@ip-172-31-24-100 ansible-installer]# ansible-playbook -i hosts install_helical.yml

PLAY [localhost] *****************************************************************************************************************************************

TASK [Enable EPEL] ***************************************************************************************************************************************
ok: [localhost]

TASK [Register to RHN and auto-subscribe to available content.] ******************************************************************************************
ok: [localhost]

TASK [Enable RHSM repositories (extras, optional)] *******************************************************************************************************
ok: [localhost] => (item=rhel-7-server-extras-rpms)
ok: [localhost] => (item=rhel-7-server-optional-rpms)

TASK [Install prerequisites] *****************************************************************************************************************************
[WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to
this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message.

changed: [localhost]

TASK [Enable MariaDB service] ****************************************************************************************************************************
ok: [localhost]

TASK [Create the Helical database user] ******************************************************************************************************************
ok: [localhost]

TASK [Import sample report to Helical database] **********************************************************************************************************
changed: [localhost]

TASK [Set hi-repository path] ****************************************************************************************************************************
ok: [localhost]

TASK [Set BaseURL to listen to] **************************************************************************************************************************
ok: [localhost]

TASK [Configure app with correct helical database user] **************************************************************************************************
ok: [localhost]

TASK [Configure app with correct helical database password] **********************************************************************************************
ok: [localhost]

TASK [Configure app with correct helical database source] ************************************************************************************************
ok: [localhost]

TASK [Deploy hi-ce war file] *****************************************************************************************************************************
changed: [localhost]

TASK [Restart tomcat] ************************************************************************************************************************************
changed: [localhost]

TASK [Print BaseURL] *************************************************************************************************************************************
ok: [localhost] => {
"msg": "Helical Insights will be reachable at: http://35.157.136.233:8080/hi-ce/hi.html"
}

PLAY RECAP ***********************************************************************************************************************************************
localhost : ok=15 changed=4 unreachable=0 failed=0

building errors

hello all,
When I followed steps givn to build source code , some errors came to me. Some message like these:

[WARNING] The POM for com.helicalinsight:hi-vf-plugin:jar:2.0.0.0-CE is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] parent ............................................. SUCCESS [ 0.125 s]
[INFO] hi-core ............................................ SUCCESS [ 5.733 s]
[INFO] hi-cache ........................................... SUCCESS [ 0.713 s]
[INFO] hi-validation ...................................... SUCCESS [ 0.630 s]
[INFO] hi-export .......................................... SUCCESS [ 0.659 s]
[INFO] hi-externalauth .................................... SUCCESS [ 1.072 s]
[INFO] hi-hwf ............................................. SUCCESS [ 0.707 s]
[INFO] hi-scheduling ...................................... SUCCESS [ 0.769 s]
[INFO] hi-ce .............................................. FAILURE [ 0.160 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 10.795 s
[INFO] Finished at: 2017-10-27T22:14:53+08:00
[INFO] Final Memory: 52M/721M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hi-ce: Could not resolve dependencies for project com.helicalinsight:hi-ce:war:2.0.0.0-CE: Failure to find com.helicalinsight:hi-vf-plugin:jar:2.0.0.0-CE in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :hi-ce

Did I miss some steps for building?
Or there is a jar file (maybe a module) which is missed?

Where can i create the reports?

I have built and deployed the helicalinsight 2.0.0-CE succsesfully. But i cann't find the place to create my reports, just see some guides on the Reports page. Please tell me where can i create the reports. THX.

Open Source?

You advertise Helical Insight as open source. Where is the source code?

hi ce 2.0.0 build from source guide too simple

Hello, I am interested in your hi as a big data bi tool.
But I cannot build hi 2.0.0 ce from master branch.
I followed your README.md :

  1. create db hice in MySQL
    exec the db.sql in */helicalinsight/db-dump/
  2. config */helicalinsight/hi-ce/pom.xml at production node
systemDirectory  -  */helicalinsight/hi-repository
logLocation
dbUser
dbPassword
  1. mvn clean package -Denv=production
  2. copy */helicalinsight/hi-ce/target/hi-ce.war to tomcat/webapps
  3. visit localhost:8080/hice/hi.html or localhost:8080/hice/*
    HTTP status 404
    When I download binary from your website, it's hi 1.0.0, not what I want.
    Where have I made a mistake as above? Can you give me any suggestion for build it myself?

as mention in the quickstart 2.2 , there is no INSTALLATIONPATH\hi-ce\hi-repository under my */helicalinsight/hi-ce/ directory

is the INSTALLATIONPATH my source code path?
when I build from source,
hi-repository
Third Party Licenses
db-dump
is in */helicalinsight/
hi-ce.war is in */helicalinsight/hi-ce/target/

SQL querry in mongoDB

Hi all,
I'm stating using HelicalInsight for a company,
I'm using commercial version of HelicalInsight to connect to my Mongo Database,
I able to connect, but I'm not able to get even one column in the collection.
My mongo database name is scrapy and the collection in which I want retrieve only the column news is feeds. The result of this query is a table in which all the raw are set to null.

Can someone help me to find the error in this configuration or tell me the way? The guide in the website is not so explicit for me.
Thank you so much @helicalinsight .

inline: {
version: '1.0',
defaultSchema: 'mongo',
schemas: [
{
type: 'custom',
name: 'mongo_raw',
factory: 'org.apache.calcite.adapter.mongodb.MongoSchemaFactory',
operand: {
host: '127.0.0.1:27017',
database: 'scrapy'
}
},
{
name: 'feeds',
tables: [
{
name: 'feeds',
type: 'view',
sql: 'select cast(_MAP['news'] AS VARCHAR(30)) AS "news" \nfrom "scrapy"."feeds"'
}
]
}
]
}

hikaricp and tomcat-jdbc dependency

Is there any reason Hikaricp and tomcat-jdbc dependency needs manually deployed instead of getting it from maven. Following versions seems to work to compile. Is that has to be 2.4.7-hi? #4

    <java7.hikaricp.version>2.7.9</java7.hikaricp.version>
    <tomcat.jdbc.version>7.0.92</tomcat.jdbc.version>

Build Error

When trying to build app from source downloaded from git, getting the below issue.

Please help me resolve the issue.

Failed to execute goal org.apache.maven.plugins:maven-war-plugin:3.0.0:war (default-war)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.