Comments (2)
@ysbqiaqia Thanks for the detailed steps. You are right, there are indeed multiple GetBuffer calls.
The current design is to simplify the API configuration. When dealing with multiple vineyard nodes on k8s, we first need to check the metadata to determine which vineyard node the object is stored on. Then, we can create a corresponding IPC/RPC client to obtain the object, as it may exist locally or remotely.
The GetMetaData function consists of two steps: GetData (to get metadata from etcd) and GetBuffer (to get the payload from vineyard). As you mentioned, both get_meta
and get_object
will invoke the GetMetaData function. One potential solution to address the issue of repeatedly calling GetBuffer and GetData is to split the GetMetaData function.
We will fix it quickly and thanks again!
from v6d.
GetMetaData
yes, I think get_meta function just get meta from etcd, and GetBuffer can be called in some where of get_object function.
from v6d.
Related Issues (20)
- Benchmarks on blob llm kv cache. HOT 1
- Integrate the etcdctl control API to etcd-cpp-apiv3 to avoid subprocess call HOT 2
- Build benchmark suite for vineyard client
- 【BUG REPORT】vineyard client.get(object_id) will not timeout and block program while ETCD get down tens of seconds later. HOT 7
- Remove libtool/automake from vineyard dependencies. HOT 1
- There exists an issue with vineyard server refcnt management HOT 1
- Start vineyardd will not launch an external etcd
- Add new GetRemoteObject api to support use buffer provided by user.
- libfabric.a was mistakenly added to VINEYARD_INSTALL_LIBS
- GetRemoteBlobs operations blocks when multi threads request alarge number of objects and delete this objects at the same time. HOT 2
- Support cached buffer to speed up RDMA HOT 1
- There exists mem leak on rdma server when rdma client crashed.
- Can't build the vineyardd-alpine-builder image HOT 1
- Evict the vineyard object but not store in the disk
- Support Timeout mechanism on client operations HOT 1
- Recover rdma server if rdma client crashed.
- Unlock migrate object if client crashed before send release request.
- The vineyardd will crash when it's restarted with the same etcd cluster
- Different meta typename "T = vineyard::Blob" and "vineyard::Blob" HOT 2
- Deliver vineyard package for Debian GNU/Linux, Ubuntu and CentOS
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from v6d.