Seeing “partition doesn't exist” warnings/failures after kafka using kafka partition re-assignment tool

喜欢而已 提交于 2020-01-13 10:15:10

问题


I am using kafka 0.8.1.1. I have a 3 node kafka cluster with some topics having around 5 partitions. I planned to increase the number of nodes to 5 in cluster and moving some partitions from existing topics to the new brokers.

Previous partition state:
broker1 : topic1 { partition 0 }
broker2 : topic1 { partition 1,2}
broker3 : topic1 { partition 3,4}

New intended state:
broker1 : topic1 { partition 0}
broker2 : topic1 { partition 1}
broker3 : topic1 { partition 3}
broker4 : topic1 { partition 4}
broker5 : topic1 { partition 2}

command which I used:
bin/kafka-reassign-partitions.sh --reassignment-json-file partitions-to-move.json --zookeeper zkserver1:2181,zkserver2:2181,zkserver3:2181 --execute

partitions-to-move.json
{
    "partitions":[{"topic": "topic1","partition": 4,"replicas": [4] }],
    "version":1
}

Error messages that I am seeing:

[2015-12-22 11:19:46,447] WARN [KafkaApi-2] Produce request with correlation id 2462842 from client kafka-node-client on partition [topic1,4] failed due to Partition [topic1,4] doesn't exist on 3 (kafka.server.KafkaApis)

I did search but couldn't find any relevant answers. Appreciate any guidance/help to sort this out.

来源:https://stackoverflow.com/questions/34409605/seeing-partition-doesnt-exist-warnings-failures-after-kafka-using-kafka-parti

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!