A docker way to quick build a hadoop and hive cluster with hadoop3.2&hive3.1.2

clone this repository to your computer

first you need to make a basic image that login without password,so in this repository it called centos7_with_nopass_ssh_basic.

copy your id_rsa.pub to centos7_with_nopass_ssh_basic/

in this directory, you get two files:id_rsa.pub and Dockerfile,then run this command:

docker build -t centos7_with_nopass_ssh_basic .

docker network create --subnet=172.168.8.0/24 bridge_for_hadoop

change your directory to hadoop_cluster and run: add apache-hive-3.1.2-bin.tar.gz and hadoop-3.2.2.tar.gz to this directory add jdk-8u311-linux-aarch64.tar.gz or jdk-8u311-linux-x64.tar.gz to this directory

docker build -t hadoop_cluster .

mkdir -p your_path_to_docker_volumn(you need to change this command for you)

change hosts_info to you create network change VOLUME_DIR to you create then,run

./hadoop-start.sh

you can get the log:

******** start hadoop cluster ok! ********
******** start hiveserver2 ok! ********
******** all ok! ********

enjoy you journey！