codingtony / docker-impala Goto Github PK

I'm trying to add this as a service in my docker-compose.yml file, and run it with docker-compose run --service-ports impala. However, when doing this, I am unable to access the datanode web UI at localhost:50075, and when running hadoop fs -put /some/file.ext /tmp/somefile.txt, it says there are 0 datanodes running.

Running with docker run instead works fine. My docker-compose.yml file is below. Any thoughts on why using docker-compose fails to run a datanode correctly?

version: '3.7'
services:
  impala:
    image: codingtony/impala
    ports: 
    - 9000:9000
    - 50010:50010
    - 50020:50020
    - 50070:50070 
    - 50075:50075 
    - 21000:21000 
    - 21050:21050 
    - 25000:25000 
    - 25010:25010 
    - 25020:25020
    stdin_open: true
    tty: true
    command: /start-bash.sh

For reference, I created this docker-compose.yml file based on the command provided in this repo's README.md: docker run --rm -ti -p 9000:9000 -p 50010:50010 -p 50020:50020 -p 50070:50070 -p 50075:50075 -p 21000:21000 -p 21050:21050 -p 25000:25000 -p 25010:25010 -p 25020:25020 codingtony/impala /start-bash.sh

We have multi format files (json, csv, tsv, Text Data Files, Parquet Data Files, Avro Data Files, RCFile Data Files, SequenceFile Data Files ...) how to load it to Impla?
thank you so much

Hi on my computer the build for the docker image ends with an error:

...
E: The method driver /usr/lib/apt/methods/https could not be found.
The command '/bin/sh -c sudo apt-get update -y' returned a non-zero code: 100

I am trying to use the ImpalaJDBC4-2.5.5.jar on top of codingtony/docker-impala image to query data from the impala container in my java application. It works fine for the most part, but if the table has decimal fields, the driver throws a null pointer exception.

example table:

CREATE TABLE transaction
(
ID string,
Total DECIMAL
);

Impala jdbc driver throws a null pointer when trying to read the table metadata, and then throws "TABLE NOT FOUND" exception. If i remove the decimal field or change the data type to int, then the code works fine.

The driver unfortunately is not open source, and as such I cannot debug efficiently without the source:
http://www.cloudera.com/content/www/en-us/downloads/connectors/impala/jdbc/2-5-5.html

Not sure if this would be a bug on the driver or on the image.