Comments (10)
@marco-m They are not, I remember we changed something a while back that fixed it, but can’t remember exactly what it was. @Stebalien do you remember?
from yamux.
not much interesting in the stack trace that i can see, but goroutine 1367200 is the one in question:
https://ipfs.io/ipfs/QmVna5MA35uAvyZtrRfKrvX4RnYPYhe14tw7mtxaKuAvkm
from yamux.
enabling yamux logging on one node (not the node that has the hang, but the node that it should be talking to) gives this:
2016/05/31 17:05:23 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:05:23 [ERR] yamux: Failed to read stream data: read tcp 192.168.0.6:4001->91.7.2.204:54741: use of closed network connection
2016/05/31 17:05:23 [WARN] yamux: failed to send go away: session shutdown
2016/05/31 17:06:38 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:06:38 [ERR] yamux: Failed to read header: MAC verification failed
2016/05/31 17:06:38 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:08:05 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:08:05 [ERR] yamux: Failed to read header: MAC verification failed
2016/05/31 17:13:24 [ERR] yamux: keepalive failed: session shutdown
2016/05/31 17:14:03 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:14:04 [ERR] yamux: Failed to read stream data: read tcp 192.168.0.6:4001->187.22.60.84:4001: use of closed network connection
2016/05/31 17:16:42 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:16:42 [ERR] yamux: Failed to read stream data: read tcp 192.168.0.6:4001->90.9.46.153:4001: use of closed network connection
2016/05/31 17:16:42 [WARN] yamux: failed to send go away: session shutdown
2016/05/31 17:23:22 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:24:58 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:30:56 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:31:29 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:32:08 [ERR] yamux: keepalive failed: connection write timeout
2016/05/31 17:32:17 [ERR] yamux: Failed to write body: write tcp4 192.168.0.6:55160->52.36.247.108:4001: write: broken pipe
2016/05/31 17:32:49 [ERR] yamux: keepalive failed: i/o deadline reached
2016/05/31 17:35:04 [WARN] yamux: frame for missing stream: Vsn:0 Type:1 Flags:0 StreamID:8 Length:210246
from yamux.
Hi @whyrusleeping 2016/05/31 17:06:38 [ERR] yamux: Failed to read header: MAC verification failed
is super fishy and makes me think the message framing is getting messed up. Is that always present when you see this?
from yamux.
@slackpad its hard to tell, i can only repro unreliably on our gateway machines that have hundreds of connections. Its difficult to tell if thats correlated or not. I did just start seeing some more of the 'frame for missing stream' messages which seem a bit odd to me.
from yamux.
sometime last night one of our nodes started accumulating a ton of goroutines stuck in OpenStream
, line 153. Heres a stack trace: http://mars.i.ipfs.team:8080/ipfs/QmNbQh1GUCmAF3e9rL5vz9dAEAUiNV531awmJqXmBqf2ca
from yamux.
@whyrusleeping are these hangs still happening ?
from yamux.
No idea. However, we've made quite a few improvements that you might want to take a look at in https://github.com/whyrusleeping/yamux/.
from yamux.
Thanks @whyrusleeping , @Stebalien :-)
from yamux.
Given the age, deployment of yamux, and lack of understanding of the issue I'm going to go ahead and close this.
from yamux.
Related Issues (20)
- TestPing failed on Windows HOT 1
- yamux: Invalid protocol version: 123
- Protocol Version Error HOT 1
- Should we close the session when streams receive window exceeded ? HOT 1
- Is Session.Accept Result Really Compatible With net.Conn? HOT 2
- What is Disconnect Flow
- [bug] TestGoAway failed
- Add link to who using yamux
- 请问,是否支持UDP协议?
- Download speeds have reduced and upload speeds gone up with the latest version of yamux
- `go test ./...` is failed HOT 1
- Config should take a Logger interface HOT 3
- SESSION关闭后r.Session().NumStreams()依然可以获取通道数?是不是有问题
- How can I change the "initialStreamWindow" gracefully? HOT 1
- Data lost when closing Session HOT 2
- Weird question HOT 2
- "context canceled" error when using with http.ReverseProxy
- at stream read/write wrap underlying error to returned error
- stream recvWindow decremented incorretly HOT 4
- Panic when sending large data HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from yamux.