SOLR replication keeps downloading entire index from master

Question

I have 2 slaves replicating from a master that has a 17GB index. I synced both slaves to this, AFTER which I set the poll interval to 60 seconds.

One of the slaves t

Answer 1

I can only see three possible causes of this:

1. An optimize is triggered during the time interval causing all of the underlying segmets to be merged. See: Optimize performance
2. You're running with an exessivly high merge factor causing your index to merge with every commit. See: Merge factor
3. You're running with compund files. See the config: <useCompoundFile>false</useCompoundFile> This also causes a segment merge at every commit.

The only way I can think of how to debug this is by manually makingt the replication with the Solr Replication HTTP API.

Disable the replication and watch how files are updated in the Solr master with the command: http://host:port/solr/replication?command=indexversion

followed by:

http://host:port/solr/replication?command=indexversion

Hope this helps!