Comments (3)
For CRUSH, the configuration is just super complicated to just add a node.
Currently the design is using Jumping Consistent Hash. I compiled a few slides here:
https://docs.google.com/presentation/d/1qwFO5xrzHtwSR4_gTlRqPxKk5y2nGWanah5P6HL0EoM/edit?usp=sharing
from vasto.
Why using crush if super compilcated to add a node?
ceph already not need to modify crush map by hand. When node stars it run script that add node and it disks via well known rules.
For example when run binary you can automatic add node to crushmap and all it "disks".
from vasto.
the complicated part is not just what scripts to run, but what state/rule needs to keep consistent when a node goes up/down, or when transitioning to a different cluster size.
The rules are much more complicated than a hash algorithm with 2 input numbers.
from vasto.
Related Issues (17)
- Java client HOT 2
- compile error~~how can I compile and benchmark vasto? HOT 3
- go build error HOT 1
- go get vasto&chrislusf/gorocksdb fail HOT 3
- ./go.test.sh error HOT 1
- vasto start server or store fail HOT 1
- vasto bench fail HOT 1
- some wiki guard mistake,benchmark result. possibilities of other KV engine replacement? HOT 5
- Vasto primary/replica failure restore problem HOT 4
- Hash sharding scale strategy question HOT 3
- Crashed with nil pointer when putting a key to a cluster of 2 replicas and one replica is down. (not reproducible) HOT 1
- Question: why client <> store communication uses plain TCP instead of GRPC? HOT 4
- vasto vs cassandra HOT 1
- Understanding rebalancing of keys when new node is added or existing node is removed HOT 3
- Distributed key-value store over RDMA HOT 1
- Rocks-less version?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vasto.