Giter VIP home page Giter VIP logo

bigtop's Introduction

bigtop

##About Apache BigTop v1.1 on Power: Ubuntu 14.04

####This README describes some scripts and tools to get the Apache BigTop v 1.1 bundle up and running quickly with minimum intervention required. IBM uses Apache BigTop for one of their Big Data Analytics Hadoop-Spark solutions. Zeppelin is an excellent notebook used to showcase benchmark workloads.

#####The install_bigtop.sh script downloads, installs, and configures the following components:

  • Java Open JDK 1.8
  • Apache Bigtop v1.1
    • Hadoop v2.7.1
    • Spark v1.5.1
    • Zeppelin v0.5.6
    • Bigtop-groovy v2.4.4
    • jsvc v1.0.15
    • Tomcat v6.0.36
    • Zookeeper v3.4.6
  • Scala v2.10.4
A Brief Outline of scripts included in this project and their function follows:
- install_bigtop.sh
 	Downloads, installs, configures, and starts all of the components listed above.
- cleanup.sh
  Prepares the system for the install_bigtop.sh.

Note: If the ~/bigtop/source directory is present, remove it manually prior to running the install_bigtop.sh script

- restart-bigtop.sh
  A convenient way to restart all BigTop components.
- Status.sh
 JPS does not automatically produce the component status. This script will report BigTop component current status.
- sparkTest.sh
 A quick workload provided to verify that Spark is working as desired.
- hadoopTest.sh
 A quick test script to aid in verifying the Hadoop configuration.

For System Minimum Requirements and installation procedures, visit the Apache BigTop v1.1 on IBM SoftLayer Ubuntu 14.04 Quick Start guide located in the /docs directory.

https://github.com/ibmsoe/bigtop/blob/master/docs

Documentation

Documentation is available in the docs/ directory.

The Apache BigTop v1.1 on IBM SoftLayer Ubuntu 14.04 Quick Start provides: has everything you need to:
  • Instructions on how to get started on IBM’s SoftLayer Bare Metal Systems
  • Information on how to use the scripts provided in this folder to quickly download, install, and configure a BigTop Hadoop – Spark environment.
  • How to access Zeppelin notebooks and run a provided Tutorial workload.
  • Information on how to optimize Spark properties through the Zeppelin Interpret
  • Directions to upload then run the Sample Stock_workload.

License

Hadoop-Spark is licensed under the Apache License, Version 2.0

bigtop's People

Contributors

afsanjar avatar dball22 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.