Zkclient depency about flume-kafka HOT 8 CLOSED

zookeeper-3.3.4 is in pom.xml. I'm not sure what you mean about zkClient? If some dependencies are missing, maven cannot build jar file successfully - actually you have built it.

As for the exception, it seems like you have some mistakes in parameters in flume conf file. Would you like to paste your flume conf file here?

from flume-kafka.

Here is my flume config file:

agent.sinks.loggerSink.type = com.vipshop.flume.sink.kafka.KafkaSink

#Specify the channel the sink should use
agent.sinks.loggerSink.channel = memoryChannel
agent.sinks.loggerSink.zkconnect = 10.192.57.12:2181,10.192.57.13:2181,10.192.57.14:2181,10.192.57.15:2181,10.192.57.16:2181
agent.sinks.loggerSink.topic = test4
agent.sinks.loggerSink.batchsize = 200

For ZKclient, it may be caused by the fact that I'm not compiling on the same machine than the one I run my tests. It was missing zkclient jar, and I was not able to find it on my compiling machine but I may have done a mistake.

from flume-kafka.

In my code, I only parse one zookeeper ip. Can you just use one ip for zkconnect parameter and test again?

from flume-kafka.

I did the test and get the same exception.

On Tue, Sep 3, 2013 at 12:12 PM, Frank Yao [email protected] wrote:

In my code, I only parse one zookeeper ip. Can you just use one ip for
zkconnect parameter and test again?

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/2#issuecomment-23701974
.

from flume-kafka.

I think this is not caused by this project but by your kafka. Things are like that in http://mail-archives.apache.org/mod_mbox/kafka-users/201306.mbox/%[email protected]%3E

Could you reset your kafka (delete all topics on disk and restart kafka)?

from flume-kafka.

OK found it!

I was using kafka_0.8 before moving to kafka_0.7.2 to test your code. It seems that the structure is slightly modified in zookeeper (However I was still able to use the queue). After cleaning up zookeeper structure and kafka I'm able to get a connection.

Thanks for your help!

from flume-kafka.

oh yes, this project is based on kafka-0.7.2 because 0.7.X is more mature than 0.8. Plus, we use 0.7.2 in our production environment.:)

from flume-kafka.

how to solve the problem? Thx

from flume-kafka.