Comments (4)
dnaby
commented on September 25, 2024
1
Hey @mostafa,
I am using certificates coming from strimzi. They offer an automated certificate management system.
I have tried all these but it's not working. Also the cluster on which I installed kafka is on premise. And lately there has been added a security that block remote ssh connection to the nodes(if the access has not been granted). So I am waiting to get the authorization in order to see if the problem is not coming from there.
from xk6-kafka.
mostafa
commented on September 25, 2024
Hey @dnaby,
Are your certificates self-signed? Have you tried setting insecureSkipTlsVerify to true to see if it works? Or even downgrading the TLS version?
Update:
I released a new version (v0.22.0) just now. Try that as well to see if it is fixed.
from xk6-kafka.
mostafa
commented on September 25, 2024
@dnaby Can you connect the logger to both instances of Writer (in WriterConfig.connectLogger) and Reader (in ReaderConfig.connectLogger) to see what's happening behind the scenes?
from xk6-kafka.
dnaby
commented on September 25, 2024
❯ ./k6 run script_kafka/kafka.js ─╯
/\ |‾‾| /‾‾/ /‾‾/
/\ / \ | |/ / / /
/ \/ \ | ( / ‾‾\
/ \ | |\ \ | (‾) |
/ __________ \ |__| \__\ \_____/ .io
execution: local
script: script_kafka/kafka.js
output: -
scenarios: (100.00%) 1 scenario, 1 max VUs, 10m30s max duration (incl. graceful stop):
* default: 1 iterations for each of 1 VUs (maxDuration: 10m0s, gracefulStop: 30s)
INFO[0000] {"This":{"addr":[{},{},{}],"topic":"xk6_kafka_json_topic","balancer":{},"max_attempts":0,"write_backoff_min":0,"write_backoff_max":0,"batch_size":1,"batch_bytes":0,"batch_timeout":0,"read_timeout":0,"write_timeout":0,"required_acks":0,"async":false,"compression":0,"logger":{"out":{},"hooks":{},"formatter":{"force_colors":false,"disable_colors":false,"force_quote":false,"disable_quote":false,"environment_override_colors":false,"disable_timestamp":false,"full_timestamp":false,"timestamp_format":"","disable_sorting":false,"disable_level_truncation":false,"pad_level_text":false,"quote_empty_fields":false,"field_map":{}},"report_caller":false,"level":4,"buffer_pool":null},"error_logger":null,"transport":{"dial_timeout":0,"idle_timeout":0,"metadata_ttl":0,"metadata_topics":[],"client_id":"","tls":null,"s_a_s_l":null,"resolver":null,"context":null},"allow_auto_topic_creation":false}} source=console
INFO[0000] {"This":{}} source=console
ERRO[0003] Error writing messages., OriginalError: unexpected EOF: broker appears to be expecting TLS error="Error writing messages., OriginalError: unexpected EOF: broker appears to be expecting TLS"m03.0s), 1/1 VUs, 0 complete and 0 interrupted iterations
ERRO[0003] GoError: Error writing messages., OriginalError: unexpected EOF: broker appears to be expecting TLS
at github.com/mostafa/xk6-kafka.(*Kafka).writerClass.func1 (native)
at file:///Users/mac/go/bin/script_kafka/kafka.js:92:19(114) executor=per-vu-iterations scenario=default source=stacktrace
█ teardown
data_received......................: 0 B 0 B/s
data_sent..........................: 0 B 0 B/s
iteration_duration.................: avg=1.5s min=15.2µs med=1.5s max=3.01s p(90)=2.71s p(95)=2.86s
iterations.........................: 1 0.33155/s
✓ kafka_reader_error_count...........: 0 0/s
kafka_writer_acks_required.........: 0 min=0 max=0
kafka_writer_async.................: 0.00% ✓ 0 ✗ 1
kafka_writer_attempts_max..........: 10 min=10 max=10
kafka_writer_batch_bytes...........: 0 B 0 B/s
kafka_writer_batch_max.............: 1 min=1 max=1
kafka_writer_batch_queue_seconds...: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
kafka_writer_batch_seconds.........: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
kafka_writer_batch_size............: 0 0/s
kafka_writer_batch_timeout.........: 277h46m40s min=277h46m40s max=277h46m40s
✓ kafka_writer_error_count...........: 0 0/s
kafka_writer_message_bytes.........: 0 B 0 B/s
kafka_writer_message_count.........: 0 0/s
kafka_writer_read_timeout..........: 2777h46m40s min=2777h46m40s max=2777h46m40s
kafka_writer_retries_count.........: 0 0/s
kafka_writer_wait_seconds..........: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
kafka_writer_write_count...........: 0 0/s
kafka_writer_write_seconds.........: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s
kafka_writer_write_timeout.........: 2777h46m40s min=2777h46m40s max=2777h46m40s
vus................................: 1 min=1 max=1
vus_max............................: 1 min=1 max=1
running (00m03.0s), 0/1 VUs, 1 complete and 0 interrupted iterations
default ✓ [======================================] 1 VUs 00m03.0s/10m0s 1/1 iters, 1 per VUHere is the output when I set the connectLogger to true and I log the writer and reader.
from xk6-kafka.
Related Issues (20)
- Creating Connection object failed on `EOF` HOT 1
- Adding support for K6 0.49.0 HOT 3
- Make docker image supports on arm HOT 8
- Incorrect reader/writer initialization in examples and description
- Wrong documentation for ReaderConfig.startOffset HOT 2
- RabbitMQ Compatibility HOT 1
- GoError: Failed to encode data, OriginalError: cannot decode textual record HOT 9
- Binary is not getting build. HOT 2
- Is there any guidance on how k6 works with complex AVRO schemas? HOT 1
- Error importing SCHEMA_TYPES enum when using index.d.ts. HOT 3
- Load test with Avro Schema that contains references throw an error HOT 2
- Reader.consume wont timeout HOT 1
- Getting tls: bad certificate error when try to write avro type message HOT 1
- Query : Avro with and without Schema Registry HOT 9
- How to come up the limit for reader.consume method? HOT 9
- Request to add authentication through oauth bearer token HOT 2
- Use of xk6-kafka with TS and webpack HOT 2
- Error serializing nullable boolean HOT 1
- Possibility to connect to AWS Glue to get SchemaRegistry data HOT 4
- Schema Registry serialized message causes SchemaRegistryException on AWS HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from xk6-kafka.