kafka-producer-api

来源： https://stackoverflow.com/questions/58169833/kafkaconsumer-poll-behavior-understanding

来源： https://stackoverflow.com/questions/58169833/kafkaconsumer-poll-behavior-understanding

来源： https://stackoverflow.com/questions/63829279/how-to-use-transactions-in-kafka-and-how-to-use-aborttransaction

来源： https://stackoverflow.com/questions/63829279/how-to-use-transactions-in-kafka-and-how-to-use-aborttransaction

来源： https://stackoverflow.com/questions/62070151/how-to-send-key-value-messages-with-the-kafka-console-producer

来源： https://stackoverflow.com/questions/45529308/sending-synchronous-messages-in-kafka

问题 I have a Kafka cluster running on the local machine with default settings outside of my minikube setup. I have created a producer in one of my web services and deployed it on minikube. For producer to connect to Kafka I am using 10.0.2.2 IP which I am also using to connect Cassandra and DGraph outside of minikube for these it is working fine. However Kafka producer is not working and not even throwing an error saying Broker may not be available or any other errors while sending data. But I am

问题 I have a Kafka cluster running on the local machine with default settings outside of my minikube setup. I have created a producer in one of my web services and deployed it on minikube. For producer to connect to Kafka I am using 10.0.2.2 IP which I am also using to connect Cassandra and DGraph outside of minikube for these it is working fine. However Kafka producer is not working and not even throwing an error saying Broker may not be available or any other errors while sending data. But I am

问题 I have a cluster of 3 Kafka brokers with replication factor of 3 for all topics. Since last few days I am facing this issue, suddenly(few times in a day) consumers and producers are stuck while getting response even when Kafka is running on all 3 servers which gets resolved until I check brokers logs ("Connection to 0 was disconnected before the response was read")and find out the culprit node which is 0 (1st node in this case)and restarts zookeeper and broker on that node. As per logs it is

问题 How should I know when i have to scale the consumer in consumer group . What are the triggers for the consumers to scale when there is a fast producer ? 回答1: In Kafka while creating a topic, need to provide number of partitions and replication factor . Let say there is one topic called TEST with 10 partitions, for parallel consumption of data need to create consumer group with 10 consumers, where each consumer will be consuming the data from the respective partition. Here is the catch, if the