Comments (3)
zelima
commented on July 19, 2024
1
@pwalsh yes https://travis-ci.org/datopian/ckan-cloud-operator/jobs/624029871?utm_medium=notification&utm_source=github_status
from ckan-cloud-operator.
akariv
commented on July 19, 2024
This is the cluster initialize log from my machine.
Note:
- The required resources for minikube
- The responses to the interactive questions
- You need to wait for the solrcloud pods to get to the running state before continuing (around the
Enter a value for num-shardsquestion is a good place to wait)
$ minikube delete && minikube start && ckan-cloud-operator cluster initialize --interactive --cluster-provider=minikube
🔥 Deleting "minikube" in hyperkit ...
💔 The "minikube" cluster has been deleted.
🔥 Successfully deleted profile "minikube"
😄 minikube v1.5.2 on Darwin 10.14.6
▪ KUBECONFIG=/Users/adam/.kube/config.minikube
🔥 Creating hyperkit VM (CPUs=4, Memory=8192MB, Disk=20000MB) ...
🐳 Preparing Kubernetes v1.16.2 on Docker '18.09.9' ...
🚜 Pulling images ...
🚀 Launching Kubernetes ...
⌛ Waiting for: apiserver
🏄 Done! kubectl is now configured to use "minikube"
2019-11-28 11:42 INFO Starting interactive initialization of the operator on the following cluster:
Error from server (NotFound): namespaces "ckan-cloud" not found
2019-11-28 11:42 INFO No configmap created yet
- clientMajor: '1'
clientMinor: '16'
name: minikube
nodes:
- minikube
operator_version: not-configured
server: https://192.168.64.14:8443
serverMajor: '1'
serverMinor: '16'
user: minikube
Verify you are connected to the right cluster and press <RETURN> to continue
2019-11-28 11:54 INFO Creating operator namespace: ckan-cloud
namespace/ckan-cloud created
secret/ckan-cloud-provider-cluster-minikube created
configmap/operator-conf created
2019-11-28 11:54 INFO (cluster-init="labels") Initializing
2019-11-28 11:54 INFO (cluster-init="labels") setting label-prefix: ckan-cloud
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
configmap/operator-conf configured
2019-11-28 11:54 INFO (cluster-init="cluster") Initializing
configmap/operator-conf configured
Using Minikube
{}
2019-11-28 11:54 INFO (cluster-init="crds") Initializing
2019-11-28 11:54 INFO (cluster-init="crds",crd-group="stable.viderum.com",crd-prefix="CkanCloud") Setting default crds module configurations
configmap/operator-conf configured
2019-11-28 11:54 INFO (cluster-init="db") Initializing
2019-11-28 11:54 INFO (cluster-init="db") Initializing DB provider
configmap/operator-conf configured
Error from server (NotFound): secrets "ckan-cloud-provider-db-minikube-credentials" not found
Error from server (NotFound): secrets "ckan-cloud-provider-db-minikube-credentials" not found
secret/ckan-cloud-provider-db-minikube-credentials created
secret/ckan-cloud-provider-db-minikube-credentials configured
secret/ckan-cloud-provider-db-minikube-credentials configured
secret/ckan-cloud-provider-db-minikube-credentials configured
secret/ckan-cloud-provider-db-minikube-credentials configured
service/ckan-cloud-provider-db-minikube created
deployment.apps/ckan-cloud-provider-db-minikube created
2019-11-28 11:54 INFO (cluster-init="routers") Initializing
Error from server (NotFound): configmaps "routers-config" not found
Enter a value for env-id (required)
env-id: p
Enter a value for default-root-domain (required)
default-root-domain: localhost
Enter a value for dns-provider (required)
dns-provider: none
Error from server (NotFound): configmaps "routers-config" not found
configmap/routers-config created
2019-11-28 11:54 INFO (dns_provider="none")
Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "ckancloudrouters.stable.viderum.com" not found
Creating CkanCloudRouter v1 custom resource definition
customresourcedefinition.apiextensions.k8s.io/ckancloudrouters.stable.viderum.com created
Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "ckancloudroutes.stable.viderum.com" not found
Creating CkanCloudRoute v1 custom resource definition
customresourcedefinition.apiextensions.k8s.io/ckancloudroutes.stable.viderum.com created
2019-11-28 11:54 INFO (infra_router_name="infra-1",default_root_domain="localhost") Creating infra router
Error from server (NotFound): ckancloudrouters.stable.viderum.com "infra-1" not found
Error from server (NotFound): ckancloudrouters.stable.viderum.com "infra-1" not found
Creating CkanCloudRouter infra-1 {'type': 'traefik', 'default-root-domain': 'localhost', 'cloudflare': {'email': 'default', 'api-key': 'default'}, 'wildcard-ssl-domain': None, 'external-domains': False, 'dns-provider': 'none'}
2019-11-28 11:54 INFO (dns_provider="none",default_dns_provider="none")
ckancloudrouter.stable.viderum.com/infra-1 created
2019-11-28 11:54 INFO Creating persistent volume claim: cce00468fc4896cb49f486e7c0
2019-11-28 11:54 INFO labels: {'ckan-cloud/router-name': 'infra-1', 'ckan-cloud/router-type': 'traefik', 'ckan-cloud/provider-cluster-volume': 'multi-user'}
persistentvolumeclaim/cce00468fc4896cb49f486e7c0 created
ckancloudrouter.stable.viderum.com/infra-1 annotated
2019-11-28 11:54 INFO (cluster-init="solr") Initializing
Error from server (NotFound): secrets "solr-config" not found
Enter a boolean value for self-hosted, leave empty to use the default value: True
self-hosted [y/n]: y
Error from server (NotFound): secrets "solr-config" not found
secret/solr-config created
2019-11-28 11:54 INFO submodule solr using provider_id solrcloud
service/ckan-cloud-provider-solr-solrcloud-zk-headless created
Error from server (NotFound): configmaps "ckan-cloud-provider-solr-solrcloud" not found
2019-11-28 11:54 INFO creating persistent disk cca81deac3f6b5cd597b677b3b with size 20
persistentvolume/cca81deac3f6b5cd597b677b3b created
persistentvolumeclaim/cca81deac3f6b5cd597b677b3b created
Error from server (NotFound): configmaps "ckan-cloud-provider-solr-solrcloud" not found
configmap/ckan-cloud-provider-solr-solrcloud created
Error from server (NotFound): configmaps "ckan-cloud-provider-solr-solrcloud-zk-config" not found
configmap/ckan-cloud-provider-solr-solrcloud-zk-config created
2019-11-28 11:54 INFO Starting interactive update of zookeeper deployments
Deployments will be done one by one, you should check if deployment succeeded before moving on to next one
Update zookeeper deployment zk-0? [y/n]: y
deployment.apps/ckan-cloud-provider-solr-solrcloud-zk-0 created
configmap/ckan-cloud-provider-solr-solrcloud configured
2019-11-28 11:54 INFO Initialized zookeeper: ['zk-0.ckan-cloud-provider-solr-solrcloud-zk-headless.ckan-cloud.svc.cluster.local:2181']
deployment.apps/ckan-cloud-provider-solr-solrcloud-zoonavigator created
2019-11-28 11:54 INFO Initialized zoonavigator: ckan-cloud-provider-solr-solrcloud-zoonavigator
Error from server (NotFound): configmaps "ckan-cloud-provider-solr-solrcloud-sc-logs-config" not found
configmap/ckan-cloud-provider-solr-solrcloud-sc-logs-config created
service/ckan-cloud-provider-solr-solrcloud-sc-headless created
2019-11-28 11:54 INFO creating persistent disk cc8108d0e1a70fbd2d5a450d43 with size 100
persistentvolume/cc8108d0e1a70fbd2d5a450d43 created
persistentvolumeclaim/cc8108d0e1a70fbd2d5a450d43 created
configmap/ckan-cloud-provider-solr-solrcloud configured
Error from server (NotFound): configmaps "ckan-cloud-provider-solr-solrcloud-sc-config" not found
configmap/ckan-cloud-provider-solr-solrcloud-sc-config created
2019-11-28 11:54 INFO Starting interactive update of solrcloud deployments
Deployments will be done one by one, you should check if deployment succeeded before moving on to next one
Update solrcloud deployment sc-3? [y/n]: y
deployment.apps/ckan-cloud-provider-solr-solrcloud-sc-3 created
configmap/ckan-cloud-provider-solr-solrcloud configured
2019-11-28 11:54 INFO Initialized solrcloud: ['sc-3']
service/ckan-cloud-provider-solr-solrcloud-sc created
configmap/ckan-cloud-provider-solr-solrcloud configured
2019-11-28 11:54 INFO Initialized solrcloud service: ckan-cloud-provider-solr-solrcloud-sc
configmap/operator-conf configured
Enter a value for num-shards, leave empty to use the default value: 1
num-shards:
Enter a value for replication-factor, leave empty to use the default value: 3
replication-factor: 1
secret/solr-config configured
2019-11-28 12:06 INFO (cluster-init="storage") Initializing
2019-11-28 12:06 INFO (cluster-init="ckan") Initializing
2019-11-28 12:06 INFO Installing crds
2019-11-28 12:06 INFO Installing operator crd: dbmigration, dbmigrations, DbMigration
configmap/operator-conf configured
Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "ckanclouddbmigrations.stable.viderum.com" not found
Creating CkanCloudDbMigration v1 custom resource definition
customresourcedefinition.apiextensions.k8s.io/ckanclouddbmigrations.stable.viderum.com created
Error from server (NotFound): configmaps "global-ckan-config" not found
2019-11-28 12:06 INFO Installing operator crd: ckaninstance, ckaninstances, CkanInstance
configmap/operator-conf configured
Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "ckancloudckaninstances.stable.viderum.com" not found
Creating CkanCloudCkanInstance v1 custom resource definition
customresourcedefinition.apiextensions.k8s.io/ckancloudckaninstances.stable.viderum.com created
2019-11-28 12:06 INFO Installing operator crd: ckaninstancename, ckaninstancenames, CkanInstanceName
configmap/operator-conf configured
Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "ckancloudckaninstancenames.stable.viderum.com" not found
Creating CkanCloudCkanInstanceName v1 custom resource definition
customresourcedefinition.apiextensions.k8s.io/ckancloudckaninstancenames.stable.viderum.com created
Checking CKAN Solr config in ZooKeeper
Node does not exist: /configs
No default Solr config found. Putting CKAN 2.8 config for Solr to ZooKeeper as ckan_default...
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/managed-schema --> /configs/ckan_default/managed-schema
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default
0
copy /configs/ckan_default/managed-schema
0
create /configs/ckan_default/managed-schema
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/managed-schema
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/protwords.txt --> /configs/ckan_default/protwords.txt
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
copy /configs/ckan_default/protwords.txt
0
create /configs/ckan_default/protwords.txt
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/protwords.txt
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/currency.xml --> /configs/ckan_default/currency.xml
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
copy /configs/ckan_default/currency.xml
0
create /configs/ckan_default/currency.xml
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/currency.xml
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/schema.xml --> /configs/ckan_default/schema.xml
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
copy /configs/ckan_default/schema.xml
0
create /configs/ckan_default/schema.xml
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/schema.xml
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/synonyms.txt --> /configs/ckan_default/synonyms.txt
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
copy /configs/ckan_default/synonyms.txt
0
create /configs/ckan_default/synonyms.txt
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/synonyms.txt
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/_rest_managed.json --> /configs/ckan_default/_rest_managed.json
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
copy /configs/ckan_default/_rest_managed.json
0
create /configs/ckan_default/_rest_managed.json
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/_rest_managed.json
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/solrconfig.xml --> /configs/ckan_default/solrconfig.xml
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
copy /configs/ckan_default/solrconfig.xml
0
create /configs/ckan_default/solrconfig.xml
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/solrconfig.xml
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/stopwords.txt --> /configs/ckan_default/stopwords.txt
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
copy /configs/ckan_default/stopwords.txt
0
create /configs/ckan_default/stopwords.txt
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/stopwords.txt
0
/Users/adam/code/viderum/ckan-cloud-operator/ckan_cloud_operator/data/solr/ckan_default/lang/stopwords_en.txt --> /configs/ckan_default/lang/stopwords_en.txt
create /configs null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs
0
create /configs/ckan_default null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Node already exists: /configs/ckan_default
0
create /configs/ckan_default/lang null
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/lang
0
copy /configs/ckan_default/lang/stopwords_en.txt
0
create /configs/ckan_default/lang/stopwords_en.txt
Connecting to localhost:2181
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
Created /configs/ckan_default/lang/stopwords_en.txt
0
Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "ckanclouddatapushers.stable.viderum.com" not found
Creating CkanCloudDatapusher v1 custom resource definition
customresourcedefinition.apiextensions.k8s.io/ckanclouddatapushers.stable.viderum.com created
Error from server (NotFound): ckancloudrouters.stable.viderum.com "datapushers" not found
Error from server (NotFound): ckancloudrouters.stable.viderum.com "datapushers" not found
Error from server (NotFound): ckancloudrouters.stable.viderum.com "datapushers" not found
Error from server (NotFound): ckancloudrouters.stable.viderum.com "datapushers" not found
Creating CkanCloudRouter datapushers {'type': 'traefik', 'default-root-domain': 'default', 'cloudflare': {'email': 'default', 'api-key': 'default'}, 'wildcard-ssl-domain': None, 'external-domains': False, 'dns-provider': None}
2019-11-28 12:06 INFO (dns_provider="None",default_dns_provider="none")
ckancloudrouter.stable.viderum.com/datapushers created
2019-11-28 12:07 INFO Creating persistent volume claim: cc09e15d9fb664842a3cf65871
2019-11-28 12:07 INFO labels: {'ckan-cloud/router-name': 'datapushers', 'ckan-cloud/router-type': 'traefik', 'ckan-cloud/provider-cluster-volume': 'multi-user'}
persistentvolumeclaim/cc09e15d9fb664842a3cf65871 created
ckancloudrouter.stable.viderum.com/datapushers annotated
wildcard_ssl_domain=localhost
Error from server (NotFound): ckancloudrouters.stable.viderum.com "instances-default" not found
Error from server (NotFound): ckancloudrouters.stable.viderum.com "instances-default" not found
Error from server (NotFound): ckancloudrouters.stable.viderum.com "instances-default" not found
Error from server (NotFound): ckancloudrouters.stable.viderum.com "instances-default" not found
Creating CkanCloudRouter instances-default {'type': 'traefik', 'default-root-domain': 'default', 'cloudflare': {'email': 'default', 'api-key': 'default'}, 'wildcard-ssl-domain': 'localhost', 'external-domains': False, 'dns-provider': None}
2019-11-28 12:07 INFO (dns_provider="None",default_dns_provider="none")
ckancloudrouter.stable.viderum.com/instances-default created
2019-11-28 12:07 INFO Creating persistent volume claim: ccb99f07c04cc4d217ba897b50
2019-11-28 12:07 INFO labels: {'ckan-cloud/router-name': 'instances-default', 'ckan-cloud/router-type': 'traefik', 'ckan-cloud/provider-cluster-volume': 'multi-user'}
persistentvolumeclaim/ccb99f07c04cc4d217ba897b50 created
ckancloudrouter.stable.viderum.com/instances-default annotated
Error from server (NotFound): secrets "ckan-storage-config" not found
Enter a value for default-storage-bucket, leave empty to use the default value: ckan
default-storage-bucket:
Error from server (NotFound): secrets "ckan-storage-config" not found
secret/ckan-storage-config created
2019-11-28 12:07 WARNING Minio bucket policy was not applied!
2019-11-28 12:07 INFO Great Success!
from ckan-cloud-operator.
pwalsh
commented on July 19, 2024
@zelima @akariv is this fully done? Can I review acceptance criteria?
from ckan-cloud-operator.
Related Issues (20)
- Integrate Jenkins in CCO image(s), remove jnlp image
- Restore unit tests HOT 1
- Start measuring coverage by unit tests, fail build if coverage below threshold
- Add tests for delete instance - ensure all resources and state are removed HOT 1
- ckan-cloud-operator should support Azure DNS provider HOT 3
- should support external plugins HOT 3
- Configure Traefik to support azure as DNS provider HOT 3
- Internal server error with the "Datasets" button HOT 1
- Error: chart "ckan" matching version "v0.0.15-rc3" not found in ckan-cloud index. HOT 2
- Support pulling images from private container registries HOT 1
- Volume mounting issues with helm deployment HOT 2
- cco ckan instance create helm does not terminate if failed creating solr collection HOT 1
- Solr pods are not stable on aks HOT 2
- Support ssl enforcement HOT 1
- Upgrade to helm3 HOT 1
- Fix `awscli` dependencies when installing with pip HOT 1
- Fix cluster initialization for the AWS provider
- Ensure domain registration flow works, integrate with AWS CI HOT 2
- Add smoke tests to created ckan instance to be run on CI on all providers
- Use packer.io to build an AMI for cco in CI HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ckan-cloud-operator.