This project aimed to reduce the configuration worked requiered at the initial part of any Hadoop related project. Where you need to configure every node in the cluster so they can share the ssh key and establish a trusted connection with eachother.
Before executing the shell scripts there are some issues that need to be known:
- The project is in an eraly stage
- It solves the system update part
- It solves the ssh-copy-id part
- Every node in the cluster needs to have the same password
- Every node in the cluster needs to follow an specific patter: node-1, node-2, ..., node-n
- The script has only been tested on Ubuntu 14.04.
The user need to change the PARAMS section in both scripts. This parameters include: user name, password, node naming convention and node range. Later, the user needs to assign execution permisions to both Master and Step1 scripts. Finally, the execution is done by:
$ ./Master.sh NameNode DataNodePrefix,Start,End User,Password
Ex.
$ ./Master.sh hadoopnamenode hdatanode-,1,16 jdoe,hadoop123