Horovod example with DistributedOptimizer running in correctly?

Question

Hi I am trying to use horovod in my model but this problem is not a batch optimization. Before implementing with my model I am trying if this works wit