pingcap-qe / ee-ops Goto Github PK

View Code? Open in Web Editor NEW

1.0 1.0 5.0 2.47 MB

GitOps everything for Efficiency Engineering in PingCAP Inc.

Home Page: https://pingcap-qe.github.io/ee-ops/

License: Apache License 2.0

Shell 11.45% Smarty 36.29% TypeScript 18.89% Mustache 33.37%

devops

ee-ops's People

Contributors

Stargazers

Watchers

Forkers

derekstrong purelind hawkingrei topscrew ran-huang

ee-ops's Issues

Hello world from ti-ee

jenkins ui-test pod use the wrong image tag

If we try to use an image built from the internal mirror repository, there may be cases where the image does not exist due to improper tag settings.

Hello world from ti-ee

Disable jenkins plugins autoupdate when restart jenkins

Same issue https://community.jenkins.io/t/disable-auto-update-of-jenkins-and-jenkins-plugins-when-restarting-jenkins/1662.

Possible sulution https://github.com/jenkinsci/helm-charts/tree/main/charts/jenkins#consider-using-a-custom-image.

clean-go-caches cronjob deed to add node affinity

Need add node affinity in here https://github.com/PingCAP-QE/ee-ops/blob/main/apps/prod/jenkins/post/_base/cronjob-go-caches.yaml

Hello world from ti-ee

helmchart jenkins controller need add nodeaffinity

add nodeaffinity to deploy the service on the desired node.

update jenkins version to 2.426.2-lts

Need add CI tests for cel expression for Tekton trigger

Hello world from ti-ee

add ci jobs to verify boskos config for tekton.

# TODO: add ci jobs to verify boskos config for tekton.

https://github.com/PingCAP-QE/ee-ops/blob/97093abaac48c1eda2587f062ef4075c527ec755/apps/prod/boskos/boskos-resources.yaml#L19

Add cache for cypress binariy

example: setup a PVC to cache for cypress binaries:
~/.cache/Cypress/8.5.0/Cypress/

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Rate-Limited

These updates are currently rate-limited. Click on a checkbox below to force their creation now.

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

Detected dependencies

ansible

apps/gcp/tekton-dev/configs/tasks/echo.yaml

apps/gcp/tekton-dev/configs/tasks/git-clone.yaml

apps/gcp/tekton-dev/configs/tasks/github-set-status.yaml

python 3.12

apps/gcp/tekton-dev/configs/tasks/golang-build.yaml

apps/gcp/tekton-dev/configs/tasks/golang-test.yaml

apps/gcp/tekton-dev/configs/tasks/ko-test-infra.yaml

apps/gcp/tekton-dev/configs/tasks/kubernetes-actions.yaml

apps/gcp/tekton-dev/configs/tasks/multi-arch-image-push.yaml

mikefarah/yq 4.43.1

apps/prod/tekton/configs/tasks/aws-cli.yaml

docker.io/amazon/aws-cli 2.17.8

apps/prod/tekton/configs/tasks/boskos-acquire.yaml

gcr.io/k8s-staging-boskos/boskosctl sha256:a7fc984732c5dd0b4e0fe0a92e2730fa4b6bddecd0f6f6c7c6b5501abe4ab105

docker.io/lachlanevenson/k8s-kubectl sha256:be98414e6907f0e6913c54ad98cfa59ffb86b843d2d7cf10dd7107e4d1822866

gcr.io/k8s-staging-boskos/boskosctl sha256:a7fc984732c5dd0b4e0fe0a92e2730fa4b6bddecd0f6f6c7c6b5501abe4ab105

apps/prod/tekton/configs/tasks/boskos-release.yaml

gcr.io/k8s-staging-boskos/boskosctl sha256:a7fc984732c5dd0b4e0fe0a92e2730fa4b6bddecd0f6f6c7c6b5501abe4ab105

docker.io/lachlanevenson/k8s-kubectl sha256:be98414e6907f0e6913c54ad98cfa59ffb86b843d2d7cf10dd7107e4d1822866

apps/prod/tekton/configs/tasks/crane-copy.yaml

gcr.io/go-containerregistry/crane v0.15.2

apps/prod/tekton/configs/tasks/echo.yaml

apps/prod/tekton/configs/tasks/gen-build-binaries-scripts.yaml

apps/prod/tekton/configs/tasks/gen-build-images-scripts.yaml

apps/prod/tekton/configs/tasks/git-clone.yaml

apps/prod/tekton/configs/tasks/github-set-status.yaml

python 3.12

apps/prod/tekton/configs/tasks/golang-build.yaml

apps/prod/tekton/configs/tasks/golang-test.yaml

apps/prod/tekton/configs/tasks/ko-prow.yaml

apps/prod/tekton/configs/tasks/ks3utils.yaml

ghcr.io/pingcap-qe/cd/utils/ks3util v20231216-31-g613ba06

apps/prod/tekton/configs/tasks/kubernetes-actions.yaml

apps/prod/tekton/configs/tasks/multi-arch-image-collect.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/multi-arch-image-push.yaml

mikefarah/yq 4.43.1

apps/prod/tekton/configs/tasks/pingcap-auto-add-image-major-tag.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/pingcap-build-binaries-darwin.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

ghcr.io/pingcap-qe/cd/utils/remote v20231216-51-g3bb25fd

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/pingcap-build-binaries.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/pingcap-build-images.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

gcr.io/kaniko-project/executor v1.22.0-debug

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/pingcap-compose-offline-pkgs.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/pingcap-deliver-image.yaml

gcr.io/go-containerregistry/crane/debug v0.15.2

apps/prod/tekton/configs/tasks/pingcap-get-builder-image.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/pingcap-git-clone-ext.yaml

alpine/git 2.43.0

apps/prod/tekton/configs/tasks/pingcap-upload-enterprise-plugins.yaml

python 3.12.3

apps/prod/tekton/configs/tasks/pingcap-upload-offline-packages.yaml

python 3.12.3

docker.io/amazon/aws-cli 2.17.8

apps/prod/tekton/configs/tasks/publish-tiup-from-oci-artifact.yaml

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

ghcr.io/pingcap-qe/cd/utils/release v20240325-60-gb6f8928

apps/prod/tekton/configs/tasks/restore-cache-with-ks3.yaml

ghcr.io/pingcap-qe/cd/utils/ks3util v20231216-31-g613ba06

apps/prod/tekton/configs/tasks/save-cache-with-ks3.yaml

ghcr.io/pingcap-qe/cd/utils/ks3util v20231216-31-g613ba06

dockerfile

.github/actions/flux2/tools/Dockerfile

flux

clusters/gcp/flux-system/gotk-components.yaml

fluxcd/flux2 v0.41.2

clusters/prod/flux-system/gotk-components.yaml

fluxcd/flux2 v0.41.2

clusters/staging/flux-system/gotk-components.yaml

fluxcd/flux2 v0.41.2

github-actions

.github/workflows/charts_lint-test.yaml

actions/checkout v4

azure/setup-helm v4

actions/setup-python v5

helm/chart-testing-action v2.6.1

.github/workflows/charts_release.yaml

actions/checkout v4

azure/setup-helm v4

helm/chart-releaser-action v1.6.0

.github/workflows/charts_test-bazel-remote.yaml

actions/checkout v4

azure/setup-helm v4

actions/setup-python v5

helm/chart-testing-action v2.6.1

engineerd/setup-kind v0.5.0

.github/workflows/charts_test-jenkins.yaml

actions/checkout v4

azure/setup-helm v4

actions/setup-python v5

helm/chart-testing-action v2.6.1

engineerd/setup-kind v0.5.0

.github/workflows/charts_test-prow.yaml

actions/checkout v4

azure/setup-helm v4

actions/setup-python v5

helm/chart-testing-action v2.6.1

engineerd/setup-kind v0.5.0

.github/workflows/gitops_test.yaml

actions/checkout v4

gomod

go.mod

go 1.19

helm-values

charts/ats/values.yaml

charts/bazel-remote/values.yaml

charts/buildbarn/values.yaml

buildbarn/bb-browser 20230208T101541Z-73a5362

buildbarn/bb-scheduler 20230213T172655Z-e0ae60c

buildbarn/bb-runner-installer 20230213T172655Z-e0ae60c

busybox 1.36.1-uclibc

buildbarn/bb-worker 20230213T172655Z-e0ae60c

ghcr.io/catthehacker/ubuntu act-22.04@sha256:91f67c0ca67fde4eceb59cb8c3c74cde09c074eadaf9ebc0050df11cd031ef21

buildbarn/bb-storage 20230208T220714Z-fd356c8

charts/git-cdn/values.yaml

charts/greenhouse/values.yaml

charts/jenkins/values.yaml

kiwigrid/k8s-sidecar 1.25.2

maorfr/kube-tasks 0.2.0

charts/prow/values.yaml

regex

apps/staging/jenkins/release/values-controller-plugins.yaml

kubernetes 3845.va_9823979a_744

kubernetes-client-api 6.8.1-224.vd388fca_4db_3b_

git 5.2.1

configuration-as-code 1763.vb_fe9c1b_83f7b

prometheus 2.4.1

blueocean 1.27.8

job-dsl 1.87

pipeline-utility-steps 2.16.0

http_request 1.18

workflow-aggregator 596.v8c21c963d92d

workflow-cps-global-lib 609.vd95673f149b_b

ghprb 1.42.2

generic-webhook-trigger 1.88.2

timestamper 1.26

ssh-agent 346.vda_a_c4f2c8e50

j3t/jenkins-pipeline-cache-plugin 0.2.0

charts/jenkins/values.yaml

kubernetes 4029.v5712230ccb_f8

workflow-aggregator 596.v8c21c963d92d

git 5.2.1

configuration-as-code 1756.v2b_7eea_874392

apps/prod/cloudevents-server/release.yaml

ghcr.io/pingcap-qe/ee-apps/cloudevents-server v20240228-49-g6a033f9

apps/prod/dl/release.yaml

ghcr.io/pingcap-qe/ee-apps/dl v20240228-25-g1214fb5

apps/staging/jenkins/release/values-controller-plugins.yaml

kubernetes-client-api 6.8.1-224.vd388fca_4db_3b_

git 5.2.1

prometheus 2.4.1

blueocean 1.27.8

job-dsl 1.87

pipeline-utility-steps 2.16.0

http_request 1.18

ghprb 1.42.2

generic-webhook-trigger 1.88.2

timestamper 1.26

apps/staging/jenkins/release/values-controller.yaml

jenkins/jenkins 2.426.2-lts

Check this box to trigger a request for Renovate to run again on this repository

Hello world from ti-ee

Some manual checks and operations after do jenkins restart

Some configurations are temporarily not configured. Here, record some inspection items.

Hello world from ti-ee

Hello world from [object Object]

Migrate OpenAI task files to ti-community-infra/configs repo

Hello world from ti-ee

Hello world from [object Object]

move ccache-pvc to directory in jenkins-cd namespace

The jenkins-cd dir is not ready yet. when ready, we can move the dir
apps/prod/ccache-pvc/base/

Hello world from [object Object]

Hello world from ti-ee

jenkins schedule k8s default pod alway failed with 100s timeout

schedule default k8s pod failed with error

Error in provisioning; agent=KubernetesSlave name: default-jhfkf, template=PodTemplate{id='bc6c1d4296b4a646c70ffd279fe27173e151c486c69e53ebba909ff2509bb12d', name='default', namespace='jenkins-ci-default', slaveConnectTimeout=100, label='jenkins-jenkins-agent', serviceAccount='default', nodeUsageMode=NORMAL, podRetention='Never', containers=[ContainerTemplate{name='jnlp', image='jenkins/inbound-agent:4.11-1', workingDir='/home/jenkins/agent', command='sleep', args='', resourceRequestCpu='512m', resourceRequestMemory='512Mi', resourceRequestEphemeralStorage='', resourceLimitCpu='512m', resourceLimitMemory='512Mi', resourceLimitEphemeralStorage='', envVars=[KeyValueEnvVar [getValue()=http://jenkins.apps.svc.cluster.local:8080/jenkins, getKey()=JENKINS_URL]], livenessProbe=ContainerLivenessProbe{execArgs='', timeoutSeconds=0, initialDelaySeconds=0, failureThreshold=0, periodSeconds=0, successThreshold=0}}]}. Container jnlp. Logs: sleep: missing operand
Try 'sleep --help' for more information.

Error in provisioning; agent=KubernetesSlave name: default-jhfkf, template=PodTemplate{id='bc6c1d4296b4a646c70ffd279fe27173e151c486c69e53ebba909ff2509bb12d', name='default', namespace='jenkins-ci-default', slaveConnectTimeout=100, label='jenkins-jenkins-agent', serviceAccount='default', nodeUsageMode=NORMAL, podRetention='Never', containers=[ContainerTemplate{name='jnlp', image='jenkins/inbound-agent:4.11-1', workingDir='/home/jenkins/agent', command='sleep', args='', resourceRequestCpu='512m', resourceRequestMemory='512Mi', resourceRequestEphemeralStorage='', resourceLimitCpu='512m', resourceLimitMemory='512Mi', resourceLimitEphemeralStorage='', envVars=[KeyValueEnvVar [getValue()=http://jenkins.apps.svc.cluster.local:8080/jenkins, getKey()=JENKINS_URL]], livenessProbe=ContainerLivenessProbe{execArgs='', timeoutSeconds=0, initialDelaySeconds=0, failureThreshold=0, periodSeconds=0, successThreshold=0}}]}
java.lang.IllegalStateException: Pod 'default-jhfkf' is terminated. Status: Failed
	at org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher.launch(KubernetesLauncher.java:206)
	at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:298)
	at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:48)
	at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:82)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)

Hello world from ti-ee

Fix prow approve plugin issue kubernetes/test-infra#7690

Hello world from ti-ee

Hello world from [object Object]

Hello world from ti-ee

Action Required: Fix Renovate Configuration

There is an error with this repository's Renovate configuration that needs to be fixed. As a precaution, Renovate will stop PRs until it is resolved.

Location: .github/renovate.json
Error type: Invalid JSON (parsing failed)
Message: Syntax error near ],

Migrate ee-infra-ops to ee-ops and make ansible play books automatic dispatching by GitOps

currently it's need to manually run Ansible to update the infrastructures.
Also mostly contents are not sensitive, no need to keep it in private repository.

How to reproduce the error

Use tiflow release-6.1，run make unit_test_in_verify_ci

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.