lewuathe / docker-trino-cluster Goto Github PK

PRESTO_VERSION=330 docker-compose up

Recreating coordinator ... done
Recreating worker1 ... done
Recreating worker0 ... done
Attaching to worker1, coordinator, worker0
worker0 | Rendered etc/node.properties
worker0 | Rendered etc/config.properties
worker1 | Rendered etc/node.properties
worker1 | Rendered etc/config.properties
coordinator | Rendered etc/node.properties
coordinator | Rendered etc/config.properties
coordinator | ERROR: Future versions of Presto will require Java 11 after March 2020.
coordinator |
coordinator | You may temporarily continue running on Java 8 by adding the following
coordinator | JVM config option:
coordinator |
coordinator | -Dpresto-temporarily-allow-java8=true
coordinator |
worker0 | ERROR: Future versions of Presto will require Java 11 after March 2020.
worker0 |
worker0 | You may temporarily continue running on Java 8 by adding the following
worker0 | JVM config option:
worker0 |
worker0 | -Dpresto-temporarily-allow-java8=true
worker0 |
worker1 | ERROR: Future versions of Presto will require Java 11 after March 2020.
worker1 |
worker1 | You may temporarily continue running on Java 8 by adding the following
worker1 | JVM config option:
worker1 |
worker1 | -Dpresto-temporarily-allow-java8=true
worker1 |
coordinator exited with code 100
worker0 exited with code 100
worker1 exited with code 100

PRESTO_VERSION=329 docker-compose up

worker0 |
worker0 | 1) Error: Invalid configuration property node.id: is malformed (for class io.airlift.node.NodeConfig.nodeId)
worker0 |
worker0 | 1 error
worker0 | com.google.inject.CreationException: Unable to create injector, see the following errors:
worker0 |
worker0 | 1) Error: Invalid configuration property node.id: is malformed (for class io.airlift.node.NodeConfig.nodeId)
worker0 |
worker0 | 1 error
worker0 | at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:543)
worker0 | at com.google.inject.internal.InternalInjectorCreator.initializeStatically(InternalInjectorCreator.java:159)
worker0 | at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:106)
worker0 | at com.google.inject.Guice.createInjector(Guice.java:87)
worker0 | at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:240)
worker0 | at io.prestosql.server.PrestoServer.run(PrestoServer.java:120)
worker0 | at io.prestosql.server.PrestoServer.main(PrestoServer.java:70)
worker0 |
worker0 |
worker1 | 2020-03-08T15:33:00.561Z ERROR main io.prestosql.server.PrestoServer Unable to create injector, see the following errors:
worker1 |
worker1 | 1) Error: Invalid configuration property node.id: is malformed (for class io.airlift.node.NodeConfig.nodeId)
worker1 |
worker1 | 1 error
worker1 | com.google.inject.CreationException: Unable to create injector, see the following errors:
worker1 |
worker1 | 1) Error: Invalid configuration property node.id: is malformed (for class io.airlift.node.NodeConfig.nodeId)
worker1 |
worker1 | 1 error
worker1 | at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:543)
worker1 | at com.google.inject.internal.InternalInjectorCreator.initializeStatically(InternalInjectorCreator.java:159)
worker1 | at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:106)
worker1 | at com.google.inject.Guice.createInjector(Guice.java:87)
worker1 | at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:240)
worker1 | at io.prestosql.server.PrestoServer.run(PrestoServer.java:120)
worker1 | at io.prestosql.server.PrestoServer.main(PrestoServer.java:70)
worker1 |
worker1 |
worker0 exited with code 1
worker1 exited with code 1
coordinator | 2020-03-08T15:33:01.622Z ERROR main io.prestosql.server.PrestoServer Unable to create injector, see the following errors:
coordinator |
coordinator | 1) Error: Invalid configuration property node.id: is malformed (for class io.airlift.node.NodeConfig.nodeId)
coordinator |
coordinator | 1 error
coordinator | com.google.inject.CreationException: Unable to create injector, see the following errors:
coordinator |
coordinator | 1) Error: Invalid configuration property node.id: is malformed (for class io.airlift.node.NodeConfig.nodeId)
coordinator |
coordinator | 1 error
coordinator | at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:543)
coordinator | at com.google.inject.internal.InternalInjectorCreator.initializeStatically(InternalInjectorCreator.java:159)
coordinator | at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:106)
coordinator | at com.google.inject.Guice.createInjector(Guice.java:87)
coordinator | at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:240)
coordinator | at io.prestosql.server.PrestoServer.run(PrestoServer.java:120)
coordinator | at io.prestosql.server.PrestoServer.main(PrestoServer.java:70)
coordinator |
coordinator |
coordinator exited with code 1

log has
worker0 | 2020-03-08T15:11:28.481Z INFO main Bootstrap node.id ---- -- n/a --

Hi. This may be more of a feature request than it is an issue.

I would like to find out how best to access data within ADLS Gen 2 storage. I know there are some Azure jar files necessary but where exactly would I need to place these?In the base Presto Dockerfile or within both the Coordinator and Worker images?

I believe I'd also require a Hive metastore, is there a configuration pattern I can follow to add this to the current stack?

Any help would be greatly appreciated.

Eddie

When I running query from presto-cli, below error will pop up, seems the dependency "less" is lost, after I manually installed the less package, the error gone.

presto> SELECT sum(unblendedcost) AS cost
     -> FROM statistics.statistics.aws
     -> WHERE "user:project" = 'test';
ERROR: failed to open pager: Cannot run program "less": error=2, No such file or directory

So I think the "less" package should be added to the base docker images?

Trying to view the documentation on how to setup with Fargate, but the link to terraform-aws-trino is broken. Did you mean terraform-aws-presto?