Comments (6)
Hello, sorry you're encountering this friction.
What are the CPU and memory specs of your cluster? How many nodes? The elasticsearch pod events suggest your cluster doesn't have enough CPU and memory
Normal TriggeredScaleUp 3m43s cluster-autoscaler pod triggered scale-up: [{https://content.googleapis.com/compute/v1/projects/lexical-pattern-305514/zones/us-east1-c/instanceGroups/gk3-autopilot-cluster-1-nap-1535p6rr-5687b4d4-grp 0->1 (max: 1000)}]
Warning FailedScheduling 3m34s (x3 over 4m39s) gke.io/optimize-utilization-scheduler 0/2 nodes are available: 2 Insufficient cpu, 2 Insufficient memory.
Warning FailedScheduling 3m2s (x2 over 3m2s) gke.io/optimize-utilization-scheduler 0/3 nodes are available: 1 Insufficient ephemeral-storage, 2 Insufficient cpu, 2 Insufficient memory.
Warning FailedScheduling 2m42s (x3 over 2m54s) gke.io/optimize-utilization-scheduler 0/3 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate, 2 Insufficient cpu, 2 Insufficient memory.
It seems like this happened despite a cluster scale-up.
I recommend looking at the Autopilot documentation, and the various constraints of an autopilot cluster - for instance the resource section. Also, I notice that your init containers are privileged, and I believe this isn't allowed in autopilot.
from kubernetes-engine-samples.
from kubernetes-engine-samples.
access to GKE-Autopilot managed nodes is not allowed, hence you cannot change node-level settings like vm.max_map_count
from kubernetes-engine-samples.
from kubernetes-engine-samples.
There is no way to run it with GKE-Autopilot, better to raise this question to GCP support team
Since GKE manages the nodes for you for Autopilot clusters, you cannot alter the nodes.
ref. https://cloud.google.com/kubernetes-engine/docs/concepts/autopilot-overview#no_changes_to_nodes
Probably standard GKE with customer-managed node pools may help you
from kubernetes-engine-samples.
Thanks Viacheslav for providing that info, I agree that GKE standard with customize node pools should work for your use case.
from kubernetes-engine-samples.
Related Issues (20)
- whereami doesn't bind to ipv6 addresses on dualstack clusters HOT 7
- whereami missing requests / limits
- Update bucketName value in deployment manifests for Triton and TFServing tutorial
- sd_dummy_exporter.go has error "Failed to write time series data" HOT 3
- whereami instructions in README are very dated
- Your example manifests for Hubble are formatted incorrectly HOT 3
- add multi-arch whereami image
- Host whereami images in EU HOT 6
- transfer-datasets.sh still references deleted variables.sh file HOT 1
- Reorganize directories to match GKE top-level topics
- CloudVolume - example missing HOT 1
- enable OTEL trace logging correlation in whereami
- fix HTTP retries on whereami
- Tutorial uses wrong value
- Remove Terraform duplication in `streaming/`
- question: GKE VPA recommender proto generation HOT 2
- Update the Ruby quickstart sample (currently crashing on deploy)
- Automate Apache license header addition or checking HOT 1
- "whereami" application faield with error `ModuleNotFoundError`
- Action Required: Fix Renovate Configuration HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kubernetes-engine-samples.