Why would moving_mean and moving _variance in Tensorflow BN layer become nan when I set is_training=False in training time?
问题 In the training time, I want to keep BN layer unchange, so I pass is_training=False to: tf.contrib.layers.batch_norm(tensor_go_next, decay=0.9, center=True, scale=True, epsilon=1e-9, updates_collections=tf.GraphKeys.UPDATE_OPS, is_training=False, scope=name_bn_scope) and didn't put name_bn_scope/gamma:0 name_bn_scope/beta:0 to train var_list. After training, gamma and beta are still the same, which is what I want exactly. But the moving_mean and moving _variance would become nan matrix after