Kafka consumer for multiple topic

Question

I have a list of topics (for now it\'s 10) whose size can increase in future. I know we can spawn multiple threads (per topic) to consume from each topic, but in my case if

Answer 1

There is no need for multiple threads, you can have one consumer, consuming from multiple topics. Offsets are maintained by zookeeper, as kafka-server itself is stateless. Whenever a consumer consumes a message,its offset is commited with zookeeper to keep a future track to process each message only once. So even in case of kafka failure, consumer will start consuming from the next of last commited offset.