Instance Normalisation vs Batch normalisation

前端 未结 4 1382
攒了一身酷
攒了一身酷 2021-01-29 19:25

I understand that Batch Normalisation helps in faster training by turning the activation towards unit Gaussian distribution and thus tackling vanishing gradients problem. Batch

4条回答
  •  一向
    一向 (楼主)
    2021-01-29 20:21

    Great question and already answered nicely. Just to add: I found this visualisation From Kaiming He's Group Norm paper helpful.

    Source: link to article on Medium contrasting the Norms

提交回复
热议问题