Rebalancing issue while reading messages in Kafka

匿名 (未验证) 提交于 2019-12-03 01:31:01

问题:

I am trying to read messages on Kafka topic, but I am unable to read it. The process gets killed after sometime, without reading any messages.

Here is the rebalancing error which I get:

[2014-03-21 10:10:53,215] ERROR Error processing message, stopping consumer:  (kafka.consumer.ConsoleConsumer$) kafka.common.ConsumerRebalanceFailedException: topic-1395414642817-47bb4df2 can't rebalance after 4 retries     at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.syncedRebalance(ZookeeperConsumerConnector.scala:428)     at kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$reinitializeConsumer(ZookeeperConsumerConnector.scala:718)     at kafka.consumer.ZookeeperConsumerConnector$WildcardStreamsHandler.(ZookeeperConsumerConnector.scala:752)     at kafka.consumer.ZookeeperConsumerConnector.createMessageStreamsByFilter(ZookeeperConsumerConnector.scala:142)     at kafka.consumer.ConsoleConsumer$.main(ConsoleConsumer.scala:196)     at kafka.consumer.ConsoleConsumer.main(ConsoleConsumer.scala) Consumed 0 messages

I tried to run ConsumerOffsetChecker, and this is the error which I get. I have no clue whatsoever, how to resolve this. Anybody, any idea?

./kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zkconnect localhost:9092 --topic mytopic --group  topic_group Group           Topic                          Pid Offset          logSize         Lag             Owner Exception in thread "main" org.I0Itec.zkclient.exception.ZkNoNodeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers/         at org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:47)         at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)         at org.I0Itec.zkclient.ZkClient.readData(ZkClient.java:766)         at org.I0Itec.zkclient.ZkClient.readData(ZkClient.java:761)         at kafka.utils.ZkUtils$.readData(ZkUtils.scala:459)         at kafka.tools.ConsumerOffsetChecker$.kafka$tools$ConsumerOffsetChecker$$processPartition(ConsumerOffsetChecker.scala:59)         at kafka.tools.ConsumerOffsetChecker$$anonfun$kafka$tools$ConsumerOffsetChecker$$processTopic$1.apply$mcVI$sp(ConsumerOffsetChecker.scala:89)         at kafka.tools.ConsumerOffsetChecker$$anonfun$kafka$tools$ConsumerOffsetChecker$$processTopic$1.apply(ConsumerOffsetChecker.scala:89)         at kafka.tools.ConsumerOffsetChecker$$anonfun$kafka$tools$ConsumerOffsetChecker$$processTopic$1.apply(ConsumerOffsetChecker.scala:89)         at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:61)         at scala.collection.immutable.List.foreach(List.scala:45)         at kafka.tools.ConsumerOffsetChecker$.kafka$tools$ConsumerOffsetChecker$$processTopic(ConsumerOffsetChecker.scala:88)         at kafka.tools.ConsumerOffsetChecker$$anonfun$main$3.apply(ConsumerOffsetChecker.scala:153)         at kafka.tools.ConsumerOffsetChecker$$anonfun$main$3.apply(ConsumerOffsetChecker.scala:153)         at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:61)         at scala.collection.immutable.List.foreach(List.scala:45)         at kafka.tools.ConsumerOffsetChecker$.main(ConsumerOffsetChecker.scala:152)         at kafka.tools.ConsumerOffsetChecker.main(ConsumerOffsetChecker.scala) Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for
标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!