Comments (8)
Kafka and no-kafka versions?
from kafka.
ches/kafka seems to install Kafka 0.8.1.1
no-kafka uses V2 group membership which is only available in Kafka 0.9.
Please confirm Kafka version
from kafka.
My bad, meant to install greytip/kafka
(https://hub.docker.com/r/greytip/kafka/) but in the description it's still referencing ches/kafka
. I'm running now the correct version of Kafka, that is 0.9, and [email protected]
, the above error is gone, but I'm getting this:
Error: Failed to join the group
at tryJoinGroup (/home/vagrant/altorepos/new-kafka/node_modules/no-kafka/lib/group_consumer.js:76:19)
at /home/vagrant/altorepos/new-kafka/node_modules/no-kafka/lib/group_consumer.js:82:24
at Timer.listOnTimeout [as ontimeout] (timers.js:112:15)
From previous event:
at /home/vagrant/altorepos/new-kafka/node_modules/no-kafka/lib/group_consumer.js:81:40
from kafka.
This error is only triggered when Kafka server returns 'GroupCoordinatorNotAvailable'. Are you running Kafka 0.9 with the same Zookeeper instance that was used by Kafka 0.8?
from kafka.
I used the same Zookeeper instance, but a different new topic name test-2
. I've just tried with a fresh instance of both Zookeeper & Kafka and it worked fine. But two questions:
- Why was Kafka returning
GroupCoordinatorNotAvailable
in my second test using a new topic? - How would you go on migrating from 0.8.x to 0.9? My idea was to (somehow) do a rolling upgrade of Kafka, keep the same Zookeeper instance, and probably rename the consumer group ids.
from kafka.
- Kafka 0.9 uses incompatible with 0.8 Zookeeper structure
- Really not sure how to migrate, this should probably be covered by Kafka docs, or maybe you can find answers in Kafka mailing list
In order to use the same Zookeeper instance for both 0.8 and 0.9 running at the same time you should run Kafka 0.9 with a different Zookeeper root:
config/server.properties:
zookeeper.connect=localhost:2181/kafka0.9
In this case all Kafka cli operations with 0.9 should also specify this root:
kafka-topics.sh --zookeeper 127.0.0.1:2181/kafka0.9 --create --topic kafka-test-topic --partitions 3 --replication-factor 1
from kafka.
Thanks @oleksiyk!
from kafka.
good job
from kafka.
Related Issues (20)
- Bad signature for getPartitionOffset in base_consumer.js line 95 HOT 1
- LeaderNotAvailable disguised as UnknownTopicOrPartition HOT 1
- Unable to compile no-kafka v 3.2.10 in Angular 6
- Lodash dependency is a security vulnerability HOT 2
- Message timestamps as in KIP-32
- For enable_auto_commit False, no automatic re-join ; Error Heartbeat: local member_id was not recognized; this consumer needs to re-join HOT 2
- Consumer not working with SSL certificate
- 'Connection was aborted before connection was established.' gets stuck in a loop.
- Support Delete Topics
- If consumer group Id is wrong not throwing any error HOT 2
- "--from-beginning" consumer equivalent?
- consume non existing topic
- Return a message to the topic
- How to ensure all messages are read
- Lodash dependency is a security vulnerability HOT 1
- Kafka SASL credential based authentication support for producer and consumer
- Use of Promise.each() inside GroupConsumer dataHandler HOT 3
- support inquiry HOT 2
- There is no way to set enable.auto.commit config for a consumer
- WARN no-kafka-client No partition assignment received
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka.