How to make full replication in kafka?

Question

How to make full replication in kafka?

I have two servers, a leader and a follower.

How to make sure that when the leader refuses (turns off), all messages that

Answer 1

How to make sure that when the leader refuses (turns off), all messages that are sent to the follower also appear on the leader after turning it on

This is built into the protocol, but that assumes every topic you are using has replication-factor=2

---

Sounds like you have only two brokers on the same network, so you do not need MirrorMaker, as the docs show it clearly is between two different, regional datacenters.

I would like to add, if you did want to do that, don't use kafka-mirror-maker. It is not as fault-tolerant and scalable as you might expect.

Instead, use MirrorMaker 2, as part of the apache-kafka-connect framework.

Answer 2

Kafka itself is a distributed system. Per the docs:

Kafka replicates the log for each topic's partitions across a configurable number of servers (you can set this replication factor on a topic-by-topic basis). This allows automatic failover to these replicas when a server in the cluster fails so messages remain available in the presence of failures.

If you want to replicate between Kafka clusters (such as full datacenters, or clusters serving different purposes) then this is where something like MirrorMaker would come in.