Giter VIP home page Giter VIP logo

avenir_analysis-framework's Introduction

โญ AVENIR DATA ANALYSIS FRAMEWORK โญ

This is a framework developed in Perl to analyse the data created by the Avenir systems. The analysis done by the framework will help with finding trends within the products developed, which could help to make the products more user-friendly and efficient.

Tutorials ๐Ÿ”ฅ

I have created/ collected a bunch of tutorials for people who are interested in learning the basics of Perl and SQL:

How to run the framework

  • To run all all scripts and store them in the 'reports' directory: perl main or ./run
  • To run files from a specific directory: perl main -s scripts/aix
  • To run files from a specific file: perl main -s scripts/aix/action_count.sql
  • To store reports in a specific directory: perl main -d reports/aix
  • To format the script file type: perl main -f csv
  • To set the name of the client server: perl main -c aix

Command Line flags details

  • Source : -src or -s
  • Destination: -dest or -d
  • Format: -format or -f
  • Client: -client or -c
  • Graph: -g

Gnuplot - Graphing reports

To graph the reports generated by the framework you can do one of the following:

  • Execute the 'run' bash script with the flag -g following the path to file
    • ./run -g reports/topFeatures.sql

TODO

  • Learn basic and Perl and SQL ๐Ÿ‘ (checkout the tutorials I made!)
  • Set up VM ๐Ÿ‘Œ
  • Develop a Perl framework that runs SQL on Avenir database
  • Recursively execute sql files from any directory
  • Move modules to seperate 'pm' files
  • Generate command line flags for users
  • Add Error log message with a timestamp
  • Create run and install bash scripts
  • Exception handling for subroutines
  • Generate graphs based on report files generated by SQL queries using Gnuplot
  • Create a list of trends to be found and make SQL scripts for them
  • Make the graphs available for users online (maybe via webserver?) - more research needed
  • Find trends within the products by checking the data returned by the SQL queries ๐Ÿ“ˆ
  • Add any details about framework in Wiki
  • More to come ๐Ÿ”œ

๐Ÿ”š

avenir_analysis-framework's People

Contributors

nevinjojo avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.