Comments (8)
You may need to add the argo project rollout type to the RBAC for goldilocks.
Can you share the controller logs?
from goldilocks.
Thanks for the quick response.
I actually didn't see any specific ERROR logs for Rollout type. Found something like this, but it looks normal.
I0926 17:38:44.007835 1 vpa.go:184] Reconciling Namespace/default for Rollout/vweb with VPA/goldilocks-vweb
When I search ERROR.
Get something like this
E0926 18:13:29.924914 1 vpa.go:324] Error updating VPA/goldilocks-vsight in Namespace/default: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-vsight": the object has been modified; please apply your changes to the latest version and try again E0926 18:13:29.924944 1 pod.go:42] Error reconciling: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-vsight": the object has been modified; please apply your changes to the latest version and try again E0926 18:13:52.727675 1 vpa.go:324] Error updating VPA/goldilocks-vwatchdog-cronjob-staging-prod-livestreamsd in Namespace/default: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-vwatchdog-cronjob-staging-prod-livestreamsd": the object has been modified; please apply your changes to the latest version and try again E0926 18:13:52.727714 1 pod.go:42] Error reconciling: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-vwatchdog-cronjob-staging-prod-livestreamsd": the object has been modified; please apply your changes to the latest version and try again E0926 18:14:17.992868 1 vpa.go:324] Error updating VPA/goldilocks-valarm-kafka-consumer-hz-p1 in Namespace/default: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-valarm-kafka-consumer-hz-p1": the object has been modified; please apply your changes to the latest version and try again E0926 18:14:17.992900 1 pod.go:42] Error reconciling: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-valarm-kafka-consumer-hz-p1": the object has been modified; please apply your changes to the latest version and try again E0926 18:14:53.983836 1 vpa.go:324] Error updating VPA/goldilocks-vshort in Namespace/default: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-vshort": the object has been modified; please apply your changes to the latest version and try again E0926 18:14:53.983880 1 pod.go:42] Error reconciling: Operation cannot be fulfilled on verticalpodautoscalers.autoscaling.k8s.io "goldilocks-vshort": the object has been modified; please apply your changes to the latest version and try again
Is there any other places which could show the logs. But df let me try add the rollout type to RBAC
from goldilocks.
Is there a VPA object that gets created in that namespace? If so, can you share the yaml definition of that VPA object?
from goldilocks.
I am wondering if this is similar to - #621
from goldilocks.
Yeah, I do see the vpa is created, fyi, and it shows some data in status.
`apiVersion: autoscaling.k8s.io/v1
kind: VerticalPodAutoscaler
metadata:
creationTimestamp: "2023-09-19T20:56:57Z"
generation: 5750
labels:
creator: Fairwinds
source: goldilocks
name: goldilocks-vptz
namespace: default
resourceVersion: "7318817167"
uid: f5060bc3-25ba-4491-82a8-20af305d4acb
spec:
targetRef:
apiVersion: argoproj.io/v1alpha1
kind: Rollout
name: vptz
updatePolicy:
updateMode: "Off"
status:
conditions:
- lastTransitionTime: "2023-09-19T20:57:48Z"
status: "True"
type: RecommendationProvided
recommendation:
containerRecommendations:- containerName: istio-proxy
lowerBound:
cpu: 10m
memory: "203641596"
target:
cpu: 35m
memory: "225384266"
uncappedTarget:
cpu: 35m
memory: "225384266"
upperBound:
cpu: 55m
memory: "257315135" - containerName: vptz
lowerBound:
cpu: 10m
memory: "52428800"
target:
cpu: 11m
memory: "63544758"
uncappedTarget:
cpu: 11m
memory: "63544758"
upperBound:
cpu: 12m
memory: "72547335"`
- containerName: istio-proxy
from goldilocks.
I am wondering if this is similar to - #621
Could be related I think. The Rollout is used to control Deployment(So basically we remove the replicas from deployment). Along with this, there's another HPA to control the Rollout.
from goldilocks.
Interesting. Seeing that there's a VPA with recommendations, this may just be related to the goldilocks dashboard (the summary package really)
from goldilocks.
Hi team, did we figure out why this is happening? Thanks!
from goldilocks.
Related Issues (20)
- Add controller flags to fine-tune the creation of VPA objects HOT 6
- Question: Can goldilocks handle already created VPA objects? HOT 3
- basePath is not being honored for static assets, e.g. CSS and Images HOT 8
- Many completed pods cause high memory consumption of controller
- Do not create VPA for a workload if an HPA or VPA already exists HOT 1
- Question: Get summary HOT 1
- Display resource quota of the namespace HOT 1
- Wrong "current" shown for memory in dashboard HOT 1
- goldilocks-vpa-recommender restarts all the time HOT 3
- Allow to disable CPU limit recommandation
- [RFE] HTML anchors for specific workload in namespace HOT 1
- not possible to force only specific VPA to be in Auto
- For different Kinds with same name, only one VPA created HOT 2
- Setting `--enable-cost=false` breaks the display of the yaml recommendations in the dashboard
- istio-proxy not shown HOT 3
- getAllTopControllers generate too much load on api server
- VPA Mode: Auto HOT 2
- helm chart: wrong values for dashboard template
- Goldilocks makes delay on pods initialization
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from goldilocks.