uber-go / gwr Goto Github PK

Use case: 10s-100s of thousands of items per second

Repro Steps:
log a LOT of items, from a lot of goroutines
curl -X WATCH localhost:4040/tap/

Symptom:
The first several hundred items come through, then all output abruptly stops

Findings so far:

• The 'timeout' branch of HandleItems is hit due to high load
• the datasource is marked active = false
• processItemChan breaks out of its loop

What should happen:
We should silently? drop items, but keep trying to pump them out.

https://github.com/uber-go/gwr/blob/dev/internal/marshaled/source.go#L411