CI/CD for AWS deployments about ckan-cloud-operator HOT 16 CLOSED

If this ticket is for GSA, we already have the credentials for CI and the base environment setup. Work should be done in https://github.com/gsa/datagov-infrastructure-live and https://github.com/gsa/datagov-infrastructure-modules unless there is reason not to.

from ckan-cloud-operator.

@adborden ok.

@akariv cc

from ckan-cloud-operator.

Why is the minikube story #77 a dependency?

from ckan-cloud-operator.

@adborden by ensuring we are super clear in code and documentation about explicit and implicit dependencies on this cloud platform or that, we are paving a clear path for deterministic deployments on all cloud providers (two GSA related - AWS and GCP), and perhaps more importantly we are making it easier to develop and debug without having to standup sandbox environments on these cloud providers.

With the 4 different CI/CD tasks we have defined in here at #77 #78 #79 #80 we are also making it much easier for both the core developers and future contributors to isolate issues as being general (eg reproducible on the minikube environment) or target platform specific (AWS, GCP, Azure).

This work is not all 100% for GSA, we also have some team members working on this via other projects (so, some work is in parallel).

from ckan-cloud-operator.

That is great, and I am all for accomplishing these, but in terms of priorities right now, the focus should be on GSA and making CCO work for GSA's infrastructure under GSA's processes. This story seems too big, with too many dependencies. Can we either a) re-scope this story to be more narrow and not include the other dependencies or b) create a new issue that we can prioritize next sprint that works toward GSA's goals?

from ckan-cloud-operator.

@aluminiumgeek, please take over this issue - I updated the task list in the description with some more details.

Make sure you build upon @zelima 's work in #77.

from ckan-cloud-operator.

@estebanruseler and @akariv to rework this ticket to be more specific to GSA needs

from ckan-cloud-operator.

Discussed with @adborden and did clarify that all of this is needed. Just want to be really clear that this is so we have a GSA-working CI script.

from ckan-cloud-operator.

I added this AC:

• CCO and its AWS dependencies are deployed into the GSA sandbox via CircleCI

from ckan-cloud-operator.

I don't think the AC was met yet, are we deploying into the GSA cluster as part of CI/CD?

from ckan-cloud-operator.

@estebanruseler to determine status of this ticket

from ckan-cloud-operator.

@akariv @zelima is this in a state for me to do acceptance testing yet (aside from data.gov specific requirements)?

from ckan-cloud-operator.

Not sure about Circle CI but it's green on travis

from ckan-cloud-operator.

ok. so @akariv just waits for you to confirm on CCI for datagov

from ckan-cloud-operator.

Yes, CI is travis-ci and it's deploying to AWS (Datopian Sandbox) on each run.

from ckan-cloud-operator.

AC for CCO and its AWS dependencies are deployed into the GSA sandbox via CircleCI isn't met, but we're going to call this done and move on.

from ckan-cloud-operator.