Comments (4)
Yup, definitely. The idea is to scale up/down pods based on metrics such as request queue length or resource usage, and let Kubernetes services do the load balancing across pods.
from fission.
For the public cloud, I think the scale out by request model like AWS Lambda that one functions' runtime(container) only deal with a request at the same time maybe a better idea. I's easy to bill the runtime cost, control the resource consuming, controls the concurrency.
For private, scale out by metrics is a also a good idea, because you don't need to control the concurrency accurately across multiple router, every router can report the metrics to the monitoring service, or monitoring service collect the resource usage metrics, then monitoring service will analyze the metrics and decide when the function's runtime need to scale out.
A simple way is that we don't need a centric monitoring system, when a functions' waiting queue is beyond limitation or a function's average response time in a period exceed a predefined value in one router, it can ask the poolmgr to scale out this function, the poolmgr will do it when max runtime instance limitation is not exceed.
from fission.
Tracking this in #80.
from fission.
(BTW @hjianhao: happy to discuss this further on slack or the new issue. I didn't have much to comment on your autoscaling ideas, just because we haven't gotten to that point just yet; we'll be doing some scalability experiments at some point and trying out various autoscaling designs.)
from fission.
Related Issues (20)
- About Kubernetes Version HOT 2
- fatal error: concurrent map writes
- client version and server version not match HOT 1
- How to count the 99% tail delay quantile of Fission
- Utilize .Release.Name as Standard Prefix for All Kubernetes Resources in Helm Chart
- [help] how to build fission-bundle image
- Unable to Create Duplicate HTTP Trigger Names Across Different Namespaces HOT 1
- Fission watch all namespaces HOT 1
- Loki integration Issue HOT 5
- Router cannot create resource Ingresses HOT 2
- Fission helm conflicts with Rancher
- [help] Is it possible to create a Python function from a zipped release in GitHub?
- Failed to create MessageQueueTrigger HOT 1
- "fission check" does not work outside of "fission" namespace
- Thoughts on the Functional Positioning of the Executor Component
- fission package build stuck in running
- Package build trigger mechanism (esp. if fission packages are deployed with gitops)
- help,help,help v1.18.0 I get error buildermgr , envwatcher not get watcher to create env by controller
- Package auto retry rebuild HOT 1
- fetcher archive code why use DefaultZip HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fission.