Comments (8)
from kubeshark.
Hi @derrickburns, thanks for submitting an issue.
I'm checking it out. Will update as soon as possible.
from kubeshark.
I can confirm that there is a reproducible issue with Mizu 0.22.16 and Istio 1.11.
Working to fix it.
@derrickburns, if you can reproduce the issue and upload the logs, that would be very helpful. It is done by running mizu tap
with --set dump-logs=true
. The logs are saved to a zip in ~/.mizu
dir.
from kubeshark.
So, strangely, this test started to report GRPC requests then stopped.
Thanks for investigating. This is a nice tool!
$ ~/bin/mizu tap -A --service-mesh qgs-minerva\.\* --set dump-logs=true
Mizu will store up to 200MB of traffic, old traffic will be cleared once the limit is reached.
Tapping pods in all namespaces
+qgs-minerva-85dc9d7589-4td9x
+qgs-minerva-85dc9d7589-d82x2
+qgs-minerva-85dc9d7589-z4jtw
Waiting for Mizu Agent to start...
Mizu is available at http://localhost:8899
t^CYou can find the zip file with all logs in /Users/derrick.burns/.mizu/mizu_logs_2022_01_20__21_08_07.zip
mizu_cli.log
mizu_logs_2022_01_20__21_08_07.zip
from kubeshark.
So, strangely, this test started to report GRPC requests then stopped.
I had similar while testing this tool but for regular http traffic. Had a simple service with a basic http healthcheck hit every 30 seconds. It reported for 4 minutes, then just stopped. Pausing and resuming the stream resumed streaming again.
from kubeshark.
There is an issue which causes Mizu to loose track of long-living HTTP and gRPC connections after about 10 seconds, not just in Istio. A fix will be released at the start of next week.
Stopping after 4 minutes is probably a different bug.
@peter-dolkens, could you share logs?
from kubeshark.
There was an issue which caused Mizu to stop tapping gRPC connections after 10 seconds. The issue was fixed in 0.23.5 c2739a6. Will make its way into stable version 0.24.0 scheduled to be released in the next few hours.
Please let us know if you find the gRPC tapping works smoother or if the issue persists.
Also note that Mizu can only tap gRPC if it is up before the connection is formed (Due to HTTP/2 header compression). The most convenient way to get Mizu to tap gRPC is to tap only the gRPC server and restart the gRPC client after running the Mizu.
from kubeshark.
Version 0.24.0 released. gRPC tapping should work smoother now.
Closing this issue.
Thank you for reporting. Please feel free to comment here / open new issues if there is a need.
@derrickburns @peter-dolkens
from kubeshark.
Related Issues (20)
- Improve support for homebrew HOT 8
- Add Websocket support
- Detect socket creation errors using eBPF
- Kind support( pf-ring, ebpf, serviceMesh) HOT 8
- Specific PCAP TTL for Errors HOT 1
- Kubeshark with Bottlerocket? HOT 1
- kubeshark deployment DOSes `kube-apiserver` if k8s audit events enabled HOT 10
- Client OS: `windows 10`, chrome: `121.0.6167.185` failing HOT 1
- New Helper named Uniqe HOT 1
- Using kubeshark CLI with multiple kubeconfig files
- We can't verify pre-built binaries for windows/amd64 with checksum files HOT 1
- WebSockets in an IPv6 primary cluster fail HOT 2
- no push access for the kubeshark fork HOT 1
- Windows 11 Curl install does not work HOT 1
- Improve/Complete AMQP support
- Resolved K8s component name is inaccurate
- Does ICMP Traffic Capture is not possible?
- Upgrade fails HOT 1
- eBPF tracer Crashes for Kernel versions older than 5.5 HOT 7
- lost prefix docker-io for Pf ring kernel module
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kubeshark.