Giter VIP home page Giter VIP logo

docker-build-workflow's Introduction

Template: Docker Build GitHub Actions Workflow

Lint Code Base Docker Build

A Reusable Workflow of the Docker GitHub Actions steps. Enhanced with learnings from production use.

⚠️ DO NOT call this workflow directly, rather, use it as a template repository and fork it for your own reusable workflow. I might change this workflow at anytime, based on new GHA features or learnings, and your calling workflow might break. ⚠️

Reasons to use this workflow

  1. Easier to start with than hand-building all the Docker Actions into a single workflow.
  2. Provides inline docs based on real-world usage of this workflow.
  3. Gives you inputs so you can reuse this workflow across many repositories and only needing the full workflow stored in a central repository.
  4. New in 2023: Adds SBOM and Provenance metadata to your images.
  5. New in 2023: Example template to use the reusable workflow twice, in an "image promotion" style of dual registries (one for devs and PRs, one for production after PR merges)

Steps to adopt this workflow

  1. Fork this repository and tweak the reusable workflow to your liking: .github/workflows/reusable-docker-build.yaml
  2. Copy my "calling" workflow templates/call-docker-build.yaml to all the repositories you want to build images in and change it to point to the forked workflow above.

"But what does this workflow really do beyond just docker build?"

  1. Clone the repository
  2. Setup QEMU for multi-platform building (via buildx) via docker/setup-qemu-action
  3. Setup buildx for awesome and fast building via docker/setup-buildx-action
  4. Log into Docker Hub and/or GHCR
  5. Add labels and tags via docker/metadata-action
  6. Build and push image via docker/build-push-action with GitHub-based layer caching
  7. Reports tags and labels in the PR comments

What other ways can I use this workflow?

I have a more advanced example of using this reusable workflow to do a "promotion" style workflow of:

  1. On PR creation, build and push to a "dev" registry (GHCR)
  2. On PR merge, build and push to a "prod" registry (Docker Hub)
  3. Create a GitOps YAML update PR to update image tags
  4. Notify of GitOps PR creation in Slack

I've added that example to my github-actions-templates repository. It calls the reusable reusable-docker-build.yaml file in this repository.

This repository is part of my example DevOps repositories on GitHub Actions

More reading

🎉🎉🎉 Join my cloud native DevOps community 🎉🎉🎉

docker-build-workflow's People

Contributors

bretfisher avatar dependabot[bot] avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

docker-build-workflow's Issues

Create a GitOps deployment PR when image is pushed

Scenario:

  • I use something like this repo to build docker images and push them to a registry. I do this in multiple app repos across my solution, and the PR merge creates a new image tag that's immutable, ready for deployment to servers. e.g. stable-<date>-<commit-sha>
  • I might use Argo CD or Flux for GitOps, I might use Helm or Kustomize to define my environment values, or I might just use GHA itself to push a image change (in yaml, toml, json, etc.)

Problem:

  • Our CI tools (in this case GHA, but could be Drone, CircleCI, Jenkins, Codefresh, etc.) build our image smartly with all the fancy tags and metadata, and push to our production registry and repo, but they stop there.
  • Then our CD solution needs to change the image tag, first for staging, and then eventually promoting to prod. There are some tools like Argo CD Image Updater which will watch registries for new image tags (fitting a regex or date pattern) and update Kubernetes with that image, and optionally update a GitOps repo with the tag change, but this doesn't fit all workflows. For one, updating Git after a cluster change isn't fully GitOps IMO.
  • This "CI to CD" gap requires humans to merge their PR, and then go find what image tag was built (which could be 10+ minutes later since it's creating a new image from the new merge commit), and paste the correct tag into a different repo where their IaC/GitOps is stored.

Proposed solution:

  • Assuming in this case we're using GHA for CI, it knows when that image is pushed to the "final" registry and what the tag is. It should "bridge the gap" with a helpful commit or PR to our IaC/GitOps repos based on our human workflow requirements.
  • All this solution needs to be is a final GHA Job after a default_branch commit or PR merge. It links the CI run to an environment deployment. Bonus points for adding a notification (Slack, etc.) that the IaC/GitOps repo has a new image ready for PR merge.

Provide image promotion workflow

In the current reusable workflow, it'll push to either Docker Hub, GHCR, or both. It'll push all tags to both registries every build. This isn't typically how more complex setups work. We should provide workflows and docs to support an additional process:

  1. Image is only pushed to a single registry/repo while a PR is open. Assume this is the "Dev" registry/repo. There are multiple tags, including datetime, PR number, GHA run ID, etc.
  2. Once PR is merged, a true "promotion" of that PR isn't possible (AFAIK) because the merge is really a GitHub push event. GHA can't correlate the PR merging and the push event. The image must be built again (but can lean on the layer cache of BuildKit, so it shouldn't need to rebuild any layers if the Dockerfile is designed properly).
  3. Once that image is rebuilt, push the image to both registries, but only the tags we prefer for "promoted" images.

Proposal:

  1. Add a new step using docker/build-push-action, but with different inputs for tags and labels. That step needs an if key to only fire on push (and if a promotion input is enabled.)
  2. Change the current id: build_image step to only fire on pull_rest if the promotion input is enabled.

This should allow the calling workflow to opt-in to a promotion multi-build setup, and choose different image names and tags. Note, the image names for the promotion build will determine which registries and repos to push to.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.