What is the default variable initializer in Tensorflow?

前端 未结 1 1187
别那么骄傲
别那么骄傲 2020-12-31 05:33

What is the default method of variable initialization used when tf.get_variable() is called without any specification for the initializer? The Docs just says \'

相关标签:
1条回答
  • 2020-12-31 06:09

    From the documentation:

    If initializer is None (the default), the default initializer passed in the variable scope will be used. If that one is None too, a glorot_uniform_initializer will be used.

    The glorot_uniform_initializer function initializes values from a uniform distribution.

    This function is documented as:

    The Glorot uniform initializer, also called Xavier uniform initializer.

    It draws samples from a uniform distribution within [-limit, limit],
    where limit is sqrt(6 / (fan_in + fan_out))
    where fan_in is the number of input units in the weight tensor
    and fan_out is the number of output units in the weight tensor.

    Reference: http://jmlr.org/proceedings/papers/v9/glorot10a/glorot10a.pdf

    0 讨论(0)
提交回复
热议问题