Comments (3)
yangsiran
commented on May 17, 2024
@backyes 因为每个worker并不host全量的图数据，而是只host一部分的图数据。而每个worker在训练的时候都是会看到整幅图的，所以可能会用到别的worker里面的图数据。
from euler.
thtb
commented on May 17, 2024
@backyes 因为每个worker并不host全量的图数据，而是只host一部分的图数据。而每个worker在训练的时候都是会看到整幅图的，所以可能会用到别的worker里面的图数据。
哪些模型会需要看到整幅图，这里是负采样时需要吗
from euler.
zakheav
commented on May 17, 2024
全局采样节点/边需要看到整幅图；还有模型训练的时候获取节点的邻居，然后再查询邻居节点的特征，这两步流程在分布式环境下不可能只在一个机器中完成（因为有一些邻居节点信息不在一台机器上），这相当于也需要看到整幅图。
from euler.
Related Issues (20)
- 单机模式下只有一个线程处理数据，node_id从0开始映射成graph_builder输出的Node Count不是应该和节点数量相等吗？
- ThreadLocalRandom() 随机数分布问题 - sample_neighbor_layerwise OP
- 找不到ppi_data.py
- samle_node样遇到 euler service cpu 100% 一直没有结果卡死问题
- pip install euler_gl python版本冲突导致失败 HOT 1
- pip install成功，site-packages下没有源码
- 关于节点权重
- install Grpc error
- 记 euler2 分布式例子run_ppi.sh 失败的原因
- 请问多ps 多euler的情况下有infer的例子可以借鉴吗
- euler目前支持导入预训练的embedding向量吗？ HOT 1
- from euler.tools import json2dat相关
- euler2的graphsage怎么设置use_id=true
- 如何使用Euler做分布式的Embedding训练
- euler1 使用ppi数据集 无监督graphsage训练 loss突然特别特别大
- 子图采样的时候为什么将每一层的源节点拼接？ HOT 1
- Euler1 邻居采样去重
- ValueError: inputs must be a list of at least oneTensor/IndexedSlices with the same dtype and shape
- sample_edge的输出shape是[count,3]吗？
- relation_cov code not understand
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from euler.