Encounter FileNotFoundError when executing ./deploy-mgmt-hub.sh about devops HOT 8 CLOSED

@oliverchan It looks like you have the python version of docker-compose installed on your system, instead of the more common golang version. The person who opened issue 76 had the same error. But their situation was caused by deploy-mgmt-hub.sh not defaulting to the correct version of docker-compose in some circumstances. But that was fixed a month ago.

The only environment that we've tested the python version of docker-compose in is ppc64. All other environments should be using the golang version. Please look at your path and figure out where docker-compose is coming from and who installed it.

from devops.

@bmpotter , thanks for the response. Taken a look of isse 76
I believe I faced exactly what the person faced as well. My issue was faced by executing the same command curl -sSL https://raw.githubusercontent.com/open-horizon/devops/master/mgmt-hub/deploy-mgmt-hub.sh | bash on a newly setup VM, and I don't think I have the python version of docker-compose installed on the VM.

Regards
Oliver

from devops.

@bmpotter . I believe something was changed. I'm receiving a different error. Will you be able advice what I can do to overcome the below error?

root@hub1:/home/oliver/devops/mgmt-hub# ./deploy-mgmt-hub.sh
------- Checking input and initializing...
Management hub services will listen on http://127.0.0.1
....
....
....
------- Downloading template files...
Substituting environment variables into template files...
------- Downloading/starting Horizon management hub services...
Downloading management hub docker images...
Pulling openhorizon/amd64_agbot:latest ...
Pulling openhorizon/amd64_exchange-api:latest ...
Pulling openhorizon/amd64_cloud-sync-service:latest ...
Pulling postgres:latest ...
Pulling mongo:latest ...
Pulling openhorizon/sdo-owner-services:latest ...
Starting management hub containers...
Creating network "hzn_horizonnet" with driver "bridge"
Creating volume "hzn_postgresvol" with default driver
Creating volume "hzn_mongovol" with default driver
Creating volume "hzn_agbotmsgkeyvol" with default driver
Creating volume "hzn_ocsdb" with default driver
Creating postgres ... done
Creating mongo ... done
Creating exchange-api ... done
Creating sdo-owner-services ... done
Creating css-api ... done
Creating agbot ... done
Waiting for the exchange.................
------- Creating the user org, the admin user in both orgs, and an agbot in the exchange...
Creating exchange hub admin user, and the admin user and agbot in the system org...
Creating exchange user org and admin user...
------- Downloading/installing/configuring Horizon agent and CLI...
Downloading the Horizon agent and CLI packages...
Installing the Horizon agent and CLI packages...
Configuring the Horizon agent and CLI...
Publishing /tmp/horizon-all-in-1/agent-install.cfg in CSS as public object agent-install.cfg in the IBM org...
Digital sign with SHA1 will be performed for data integrity. It will delay the MMS object publish.
Start hashing the file...
Data hash is generated. Start digital signing with the data hash...
Digital sign finished.
Error: Encountered HTTP error: Put "http://127.0.0.1:9443/api/v1/objects/IBM/agent_files/agent-install.cfg": read tcp 127.0.0.1:50192->127.0.0.1:9443: read: connection reset by peer calling Model Management Service REST API PUT http://127.0.0.1:9443/api/v1/objects/IBM/agent_files/agent-install.cfg. HTTP status: .
Error: exit code 5 from: publishing /tmp/horizon-all-in-1/agent-install.cfg in CSS as a public object
root@hub1:/home/oliver/devops/mgmt-hub#

from devops.

@bmpotter
Suspect something to do with css-api and mongo db. Here's the trace from docker ps and docker log css-api

`root@oliver-VirtualBox:/home/oliver/devops/mgmt-hub# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS
NAMES
9429f753ced3 openhorizon/amd64_agbot:latest "/bin/sh -c /usr/hor…" 3 minutes ago Up 3 minutes (healthy) 127.0.0.1:3110->8080/tcp, 127.0.0.1:3111->8083/tcp agbot
cc5ab604e795 openhorizon/sdo-owner-services:latest "/bin/sh -c $WORKDIR…" 3 minutes ago Up 3 minutes (healthy) 127.0.0.1:8040->8040/tcp, 127.0.0.1:8042->8042/tcp, 127.0.0.1:9008->9008/tcp sdo-owner-services
313002718baa openhorizon/amd64_cloud-sync-service:latest "/usr/edge-sync-serv…" 3 minutes ago Up 3 minutes (unhealthy) 127.0.0.1:9443->8080/tcp
css-api
57af38a61a33 openhorizon/amd64_exchange-api:latest "/bin/sh -c '/usr/bi…" 3 minutes ago Up 3 minutes (healthy) 8083/tcp, 127.0.0.1:3090->8080/tcp
exchange-api
9ee61958532b mongo:latest "docker-entrypoint.s…" 3 minutes ago Restarting (132) About a minute ago
mongo
7248ee7b6556 postgres:latest "docker-entrypoint.s…" 3 minutes ago Up 3 minutes (healthy) 5432/tcp
postgres
root@oliver-VirtualBox:/home/oliver/devops/mgmt-hub# docker ps | grep css-api
313002718baa openhorizon/amd64_cloud-sync-service:latest "/usr/edge-sync-serv…" 3 minutes ago Up 3 minutes (unhealthy) 127.0.0.1:9443->8080/tcp
css-api
root@oliver-VirtualBox:/home/oliver/devops/mgmt-hub# docker logs css-api

• CSS: 2021/07/14 15:54:21 Loaded configuration:
  NodeType CSS
  DestinationType Cloud
  DestinationID Cloud
  OrgID
  ListeningType unsecure
  ListeningAddress
  SecureListeningPort 8080
  UnsecureListeningPort 8080
  ServerCertificate <...>
  ServerKey <...>
  CSSOnWIoTP false
  UsingEdgeConnector false
  LeadershipTimeout 30
  AuthenticationHandler dummy
  CommunicationProtocol http
  MQTTClientID
  MQTTUserName
  MQTTPassword
  MQTTUseSSL true
  MQTTCACertificate <...>
  MQTTSSLCert
  MQTTSSLKey
  MQTTAllowInvalidCertificates false
  MQTTBrokerConnectTimeout 300
  MQTTParallelMode
  PersistenceRootPath /var/edge-sync-service/persist/
  BrokerAddress
  BrokerPort 0
  HTTPPollingInterval 10
  HTTPCSSHost
  HTTPCSSPort 0
  HTTPCSSUseSSL false
  HTTPCSSCACertificate
  LogLevel INFO
  LogRootPath /var/edge-sync-service/log
  LogTraceDestination stdout
  LogFileName sync-service
  TraceLevel INFO
  TraceRootPath /var/edge-sync-service/trace
  TraceFileName sync-service
  LogTraceFileSizeKB 20000
  MaxCompressedlLogTraceFilesNumber 50
  LogTraceMaintenanceInterval 60
  ResendInterval 5
  ESSPingInterval 1
  RemoveESSRegistrationTime 30
  MaxDataChunkSize 122880
  MaxInflightChunks 1
  MongoAddressCsv mongo:27017
  MongoAuthDbName admin
  MongoDbName d_edge
  MongoUsername
  MongoPassword
  MongoUseSSL false
  MongoCACertificate
  MongoAllowInvalidCertificates false
  MongoSessionCacheSize 1
  DatabaseConnectTimeout 300
  StorageMaintenanceInterval 30
  ObjectActivationInterval 30
  StorageProvider mongo
  ESSConsumedObjectsKept 1000
  MessagingGroupCacheExpiration 60
  ShutdownQuiesceTime 60
  ObjectsDataPath
  CSS: 2021/07/14 15:54:22 INFO: Horizon Authenticator starting with exchange authenticated identity
• CSS: 2021/07/14 15:54:22 INFO: Connecting to mongo...
• CSS: 2021/07/14 15:54:42 ERROR: Failed to dial mgo. Error: no reachable servers
• CSS: 2021/07/14 15:54:42 ERROR: Retrying to connect to mongo

from devops.

@bmpotter Suspect something to do with css-api and mongo db. Here's the trace from docker ps and docker log css-api

`root@oliver-VirtualBox:/home/oliver/devops/mgmt-hub# docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 9429f753ced3 openhorizon/amd64_agbot:latest "/bin/sh -c /usr/hor…" 3 minutes ago Up 3 minutes (healthy) 127.0.0.1:3110->8080/tcp, 127.0.0.1:3111->8083/tcp agbot cc5ab604e795 openhorizon/sdo-owner-services:latest "/bin/sh -c $WORKDIR…" 3 minutes ago Up 3 minutes (healthy) 127.0.0.1:8040->8040/tcp, 127.0.0.1:8042->8042/tcp, 127.0.0.1:9008->9008/tcp sdo-owner-services 313002718baa openhorizon/amd64_cloud-sync-service:latest "/usr/edge-sync-serv…" 3 minutes ago Up 3 minutes (unhealthy) 127.0.0.1:9443->8080/tcp css-api 57af38a61a33 openhorizon/amd64_exchange-api:latest "/bin/sh -c '/usr/bi…" 3 minutes ago Up 3 minutes (healthy) 8083/tcp, 127.0.0.1:3090->8080/tcp exchange-api 9ee61958532b mongo:latest "docker-entrypoint.s…" 3 minutes ago Restarting (132) About a minute ago mongo 7248ee7b6556 postgres:latest "docker-entrypoint.s…" 3 minutes ago Up 3 minutes (healthy) 5432/tcp postgres root@oliver-VirtualBox:/home/oliver/devops/mgmt-hub# docker ps | grep css-api 313002718baa openhorizon/amd64_cloud-sync-service:latest "/usr/edge-sync-serv…" 3 minutes ago Up 3 minutes (unhealthy) 127.0.0.1:9443->8080/tcp css-api root@oliver-VirtualBox:/home/oliver/devops/mgmt-hub# docker logs css-api

• CSS: 2021/07/14 15:54:21 Loaded configuration:
  NodeType CSS
  DestinationType Cloud
  DestinationID Cloud
  OrgID
  ListeningType unsecure
  ListeningAddress
  SecureListeningPort 8080
  UnsecureListeningPort 8080
  ServerCertificate <...>
  ServerKey <...>
  CSSOnWIoTP false
  UsingEdgeConnector false
  LeadershipTimeout 30
  AuthenticationHandler dummy
  CommunicationProtocol http
  MQTTClientID
  MQTTUserName
  MQTTPassword
  MQTTUseSSL true
  MQTTCACertificate <...>
  MQTTSSLCert
  MQTTSSLKey
  MQTTAllowInvalidCertificates false
  MQTTBrokerConnectTimeout 300
  MQTTParallelMode
  PersistenceRootPath /var/edge-sync-service/persist/
  BrokerAddress
  BrokerPort 0
  HTTPPollingInterval 10
  HTTPCSSHost
  HTTPCSSPort 0
  HTTPCSSUseSSL false
  HTTPCSSCACertificate
  LogLevel INFO
  LogRootPath /var/edge-sync-service/log
  LogTraceDestination stdout
  LogFileName sync-service
  TraceLevel INFO
  TraceRootPath /var/edge-sync-service/trace
  TraceFileName sync-service
  LogTraceFileSizeKB 20000
  MaxCompressedlLogTraceFilesNumber 50
  LogTraceMaintenanceInterval 60
  ResendInterval 5
  ESSPingInterval 1
  RemoveESSRegistrationTime 30
  MaxDataChunkSize 122880
  MaxInflightChunks 1
  MongoAddressCsv mongo:27017
  MongoAuthDbName admin
  MongoDbName d_edge
  MongoUsername
  MongoPassword
  MongoUseSSL false
  MongoCACertificate
  MongoAllowInvalidCertificates false
  MongoSessionCacheSize 1
  DatabaseConnectTimeout 300
  StorageMaintenanceInterval 30
  ObjectActivationInterval 30
  StorageProvider mongo
  ESSConsumedObjectsKept 1000
  MessagingGroupCacheExpiration 60
  ShutdownQuiesceTime 60
  ObjectsDataPath
  CSS: 2021/07/14 15:54:22 INFO: Horizon Authenticator starting with exchange authenticated identity
• CSS: 2021/07/14 15:54:22 INFO: Connecting to mongo...
• CSS: 2021/07/14 15:54:42 ERROR: Failed to dial mgo. Error: no reachable servers
• CSS: 2021/07/14 15:54:42 ERROR: Retrying to connect to mongo

Does anyone have an answer in this I have the exact same problem with the exact same logs.

from devops.

#82 (comment)
@bmpotter I am facing the exact same thing. Does anyone have any solution? @oliverchan did you solve it?

from devops.

same error here. I tried like 5 times in brand new Ubuntu VMs both 18.x and 20.x. I also ensured, I did a apt update, apt upgrade this time... nothing works and same error. strange and hope they fix it.

from devops.

@ravinata Check issue #137

from devops.