Giter VIP home page Giter VIP logo

rules_kubebuilder's Introduction

rules_kubebuilder

These bazel rules download and make available the Kubebuilder SDK for building kubernetes operators in bazel.

To use these rules, add the following to your WORKSPACE file:

load("@bazel_tools//tools/build_defs/repo:git.bzl", "git_repository")

git_repository(
    name = "rules_kubebuilder",
    branch = "main",
    remote = "https://github.com/ob/rules_kubebuilder.git",
)

load("@rules_kubebuilder//kubebuilder:sdk.bzl", "kubebuilder_register_sdk")

kubebuilder_register_sdk(version = "2.3.1")

load("@rules_kubebuilder//controller-gen:deps.bzl", "controller_gen_register_toolchain")

controller_gen_register_toolchain()

load("@rules_kubebuilder//kustomize:deps.bzl", "kustomize_register_toolchain")

kustomize_register_toolchain()

And in your go_test() files, add etcd as a data dependency like this:

go_test(
    name = "go_default_test",
    srcs = ["apackage_test.go"],
    data = [
        "@kubebuilder_sdk//:bin/etcd",
    ],
    embed = [":go_default_library"],
    deps = [
    ],
)

You'll need to run the test as:

bazel test --test_env=KUBEBUILDER_ASSETS=$(bazel info execution_root 2>/dev/null)/$(bazel run @kubebuilder_sdk//:pwd 2>/dev/null) //...

You can also add the following to BUILD.bazel at the root of your workspace:

load("@rules_kubebuilder//kubebuilder:def.bzl", "kubebuilder")
kubebuilder(name = "kubebuilder")

to be able to run kubebuilder like so:

bazel run //:kubebuilder -- --help

Controller-gen

In order to use controller-gen you will need to do something like the following in your api/v1alpha1 directory (essentially where the *_type.go files are):

load("@io_bazel_rules_go//go:def.bzl", "go_library")
load(
    "@rules_kubebuilder//controller-gen:controller-gen.bzl",
    "controller_gen_crd",
    "controller_gen_object",
    "controller_gen_rbac",
)

filegroup(
    name = "srcs",
    srcs = [
        "groupversion_info.go",
        # your source files here, except for zz_generated_deepcopy.go
    ],
)

DEPS = [
    "@io_k8s_api//core/v1:go_default_library",
    "@io_k8s_apimachinery//pkg/api/resource:go_default_library",
    "@io_k8s_apimachinery//pkg/apis/meta/v1:go_default_library",
    "@io_k8s_apimachinery//pkg/runtime:go_default_library",
    "@io_k8s_apimachinery//pkg/runtime/schema:go_default_library",
    "@io_k8s_sigs_controller_runtime//pkg/scheme:go_default_library",
]

controller_gen_object(
    name = "generated_sources",
    srcs = [
        ":srcs",
    ],
    deps = DEPS,
)

# keep
go_library(
    name = "go_default_library",
    srcs = [
        "generated_sources",
        "srcs",
    ],
    importpath = "yourdomain.com/your-operator/api/v1alpha1",
    visibility = ["//visibility:public"],
    deps = DEPS,
)

controller_gen_crd(
    name = "crds",
    srcs = [
        ":srcs",
    ],
    visibility = ["//visibility:public"],
    deps = DEPS,
)

Developers

The toolchain that describes controller-gen needs to be built and the binaries committed so that they can be used. Fortunately Go supports cross compiling so in order to build the controller, you'll need to get and install Go either from their download page or from homebrew by running

brew install golang

After that you can run the script in scripts/build-controller-gen.sh which will compile controller-gen for both Linux and macOS.

rules_kubebuilder's People

Contributors

eudaimos avatar littlewat avatar minh-ng avatar ob avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

rules_kubebuilder's Issues

Update controller-tools dependency to at least version 0.4.0

I need to be able to use a map to pointers for my CRD which isn't working when I use the controller_gen_crd rule from this package. The error I get is

map values must be a named type, not *ast.StarExpr

This is fixed in an updated version of controller-tools but this package is currently fixed to version 0.3.0 as seen here in scripts/build-controller-gen.sh:5.

This was fixed in controller-tools in this PR kubernetes-sigs/controller-tools#317
and released in version v0.4.0

kubebuilder download URL for v3 and above does not contain kubebuilder-tools

I am trying to support kubebuilder v3 and above
https://github.com/ob/rules_kubebuilder/pull/13/files

but kubebuilder download URL for v3 and above just contains kubebuilder binary.

  • v2: tar.gz that contains kubebuilder,etcd, kube-apiserver, kubectl
  • v3: just kubebuilder binary file

etcd, kube-apiserver ,kubectl are now in kubebuilder-tools

e.g. https://storage.googleapis.com/kubebuilder-tools/kubebuilder-tools-1.23.5-linux-amd64.tar.gz

So we might need the step like below...?
https://github.com/cert-manager/cert-manager/blob/70842364304fb472ed1c62afc4f1c3898c73164c/hack/bin/deps.bzl#L73-L116

Controller-gen binary has bad version

First of, great tool!

The only issue I have encountered is that the version of controller-gen included in the bazel rules does not have the correct version set.

See:
image

This results in the following annotation on the generated CRDs:

apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
metadata:
  annotations:
    controller-gen.kubebuilder.io/version: (devel)

Because of this we can't tell which version is used to generate the different CRDs.

Detected a change in checksum for 0.1.0 on Jan 30 2023

This seems to be a false alarm, but posting here to note that we are still looking into an issue as a user (not a committer).

This artifact:
https://github.com/ob/rules_kubebuilder/archive/refs/tags/v0.1.0.tar.gz

Our builds started failing as of this morning because the SHA256 checksum is now:
087af23f803ba41b6654f71e776cf8374f646eb3f711c51b226ead4492ab54f2

whereas previously it was:
50ce5afefd208f265701bf9b682a894f39c0824243fa5ca7668799ff477d6a65

It seems like the old/new artifacts are the same inside. There is a previous incident of GitHub artifacts checksums changing due to an OS upgrade.

Anyone else seeing this, can validate our findings that the artifacts are still the same?

Unable to get configuration working

@ob creating an issue working with this repo (which is awesome that you put this together) - hoping you can help with a little troubleshooting

Essentially bazel is saying it cannot download kubebuilder or find the @rules_kubebuilder//controller-gen:toolchain - here are 3 different command tries with basically the same response:

bazel query //...

➜  kb-operator-sbox bazel query //...
INFO: Repository kubebuilder_sdk instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule _kubebuilder_download_sdk defined at:
  /private/var/tmp/_bazel_jeff/77a1926f3e1f14e13b1c87bbae4eb719/external/rules_kubebuilder/kubebuilder/sdk.bzl:34:44: in <toplevel>
WARNING: Download from https://github.com/kubernetes-sigs/kubebuilder/releases/download/v2.3.1/kubebuilder_2.3.1_darwin-x86_64.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
ERROR: An error occurred during the fetch of repository 'kubebuilder_sdk':
   Traceback (most recent call last):
	File "/private/var/tmp/_bazel_jeff/77a1926f3e1f14e13b1c87bbae4eb719/external/rules_kubebuilder/kubebuilder/sdk.bzl", line 23, column 29, in _kubebuilder_download_sdk_impl
		ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/kubernetes-sigs/kubebuilder/releases/download/v2.3.1/kubebuilder_2.3.1_darwin-x86_64.tar.gz] to /private/var/tmp/_bazel_jeff/77a1926f3e1f14e13b1c87bbae4eb719/external/kubebuilder_sdk/kubebuilder_2.3.1_darwin-x86_64.tar.gz: GET returned 404 Not Found
ERROR: Evaluation of query "//..." failed due to BUILD file errors
Loading: 0 packages loaded

bazel run //:kubebuilder -- --help

➜  kb-operator-sbox bazel run //:kubebuilder -- --help
INFO: Repository kubebuilder_sdk instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule _kubebuilder_download_sdk defined at:
  /private/var/tmp/_bazel_jeff/77a1926f3e1f14e13b1c87bbae4eb719/external/rules_kubebuilder/kubebuilder/sdk.bzl:34:44: in <toplevel>
WARNING: Download from https://github.com/kubernetes-sigs/kubebuilder/releases/download/v2.3.1/kubebuilder_2.3.1_darwin-x86_64.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
ERROR: An error occurred during the fetch of repository 'kubebuilder_sdk':
   Traceback (most recent call last):
	File "/private/var/tmp/_bazel_jeff/77a1926f3e1f14e13b1c87bbae4eb719/external/rules_kubebuilder/kubebuilder/sdk.bzl", line 23, column 29, in _kubebuilder_download_sdk_impl
		ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/kubernetes-sigs/kubebuilder/releases/download/v2.3.1/kubebuilder_2.3.1_darwin-x86_64.tar.gz] to /private/var/tmp/_bazel_jeff/77a1926f3e1f14e13b1c87bbae4eb719/external/kubebuilder_sdk/kubebuilder_2.3.1_darwin-x86_64.tar.gz: GET returned 404 Not Found
ERROR: /Users/jeff/dev/scratch/kb-operator-sbox/BUILD.bazel:9:12: //:kubebuilder depends on @kubebuilder_sdk//:bin/kubebuilder in repository @kubebuilder_sdk which failed to fetch. no such package '@kubebuilder_sdk//': java.io.IOException: Error downloading [https://github.com/kubernetes-sigs/kubebuilder/releases/download/v2.3.1/kubebuilder_2.3.1_darwin-x86_64.tar.gz] to /private/var/tmp/_bazel_jeff/77a1926f3e1f14e13b1c87bbae4eb719/external/kubebuilder_sdk/kubebuilder_2.3.1_darwin-x86_64.tar.gz: GET returned 404 Not Found
ERROR: Analysis of target '//:kubebuilder' failed; build aborted: Analysis failed
INFO: Elapsed time: 0.566s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (1 packages loaded, 0 targets configured)
FAILED: Build did NOT complete successfully (1 packages loaded, 0 targets configured)

bazel build //api/v1beta1:crds

➜  kb-operator-sbox bazel build //api/v1beta1:crds
ERROR: While resolving toolchains for target //api/v1beta1:crds: no matching toolchains found for types @rules_kubebuilder//controller-gen:toolchain
ERROR: Analysis of target '//api/v1beta1:crds' failed; build aborted: no matching toolchains found for types @rules_kubebuilder//controller-gen:toolchain
INFO: Elapsed time: 0.140s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (2 packages loaded, 2 targets configured)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.