smizy / docker-hbase Goto Github PK

Thanks for providing the container! After pulling the image we notice that hbase.regionserver.thrift.framed is set to False in hbase-default.xml.

However, the HBase official document and Cloudera troubleshooting page recommends to set hbase.regionserver.thrift.framed and hbase.regionserver.thrift.compact to True :

• This is the recommended transport for thrift servers and requires a similar setting on the client side. Changing this to false will select the default transport, vulnerable to DoS when malformed requests are issued due to THRIFT-601.

• To prevent the possibility of crashes due to buffer overruns, use the framed and compact transport protocols by setting hbase.regionserver.thrift.framed and hbase.regionserver.thrift.compact to true in hbase-site.xml.

Maybe it's better to enable these two parameters? Thank you!

got hint on hbase master web console:
2 nodes with inconsistent version

env:
docker 1.12.4
hmaster on 1 server
3 regionserver node on 3 server

Hello @smizy,

Thanks for sharing!

The volume_from is not supported in docker-compose 3.x version.

I tried to replace volume_from :

 namenode-1:
    container_name: namenode-1
    networks: ["vnet"]
    hostname: namenode-1.vnet
    image: smizy/hadoop-base:2.7.3-alpine
    expose: ["8020"]
    ports:  ["50070"]
    environment:
      - SERVICE_8020_NAME=namenode
      - SERVICE_50070_IGNORE=true
      - HADOOP_ZOOKEEPER_QUORUM=zookeeper-1.vnet:2181 
      - HADOOP_HEAPSIZE=1000
      - HADOOP_NAMENODE_HA=    
    entrypoint: entrypoint.sh
    volumes:
      - namenode:/usr/local/hadoop-2.7.3
    command: namenode-1

hmaster-1:
    container_name: hmaster-1
    networks: ["vnet"]
    hostname: hmaster-1.vnet
    image: smizy/hbase:1.2.6-alpine
    expose: [16000]
    ports:  [16010]
    depends_on: ["zookeeper-1"]
    environment:
      - SERVICE_16000_NAME=hmaster
      - SERVICE_16010_IGNORE=true
      - HBASE_ZOOKEEPER_QUORUM=zookeeper-1.vnet:2181   
    volumes:
      - namenode:/usr/local/hadoop-2.7.3
    command: hmaster-1
volumes:
  namenode:

And I got this error :

namenode-1        | ls: /usr/local/hadoop-2.7.3/etc/hadoop/*.mustache: No such file or directory
namenode-1        | su-exec: hdfs: No such file or directory

Do you have any idea?

Thanks!