View Code? Open in Web Editor
NEW
Multihost docker hadoop cluster
docker-hadoop-cluster's Introduction
Multi host hadoop cluster based on Docker containers.
- Docker should be installed on each host.
- Docker daemon should be run in tcp mode.
- Each host should be able to recognize each other by hostname. Simplest way to do this - use /etc/hosts
- Specify host names of the master and slave nodes in files
masters
and nodes
respectively.
- Run script
set-up-env.sh
for download all dependencies.
- Run script
build.sh
for build Docker images.
- Run script
start.sh
for start cluster.
- Run
stop.sh
for stop cluster.
docker-hadoop-cluster's People
Watchers