what is the default kernel_initializer in keras

前端 未结 2 1723
情话喂你
情话喂你 2021-02-03 17:01

In the user manual, it shows the different kernel_initializer below

https://keras.io/initializers/

the main purpose is to initialize the weight matrix in the neura

相关标签:
2条回答
  • 2021-02-03 17:50

    GlorotUniform, keras uses Glorot initialization with a uniform distribution.r = √(3/fan_avg)

    fan_avg = (fan_in + fan_out) /2

    number of inputs = fan_in

    number of nurons in a layer = fan_out

    0 讨论(0)
  • 2021-02-03 17:56

    Usually, it's glorot_uniform by default. Different layer types might have different default kernel_initializer. When in doubt, just look in the source code. For example, for Dense layer:

    class Dense(Layer):
    ...
        def __init__(self, units,
                     activation=None,
                     use_bias=True,
                     kernel_initializer='glorot_uniform',
                     bias_initializer='zeros',
                     kernel_regularizer=None,
                     bias_regularizer=None,
                     activity_regularizer=None,
                     kernel_constraint=None,
                     bias_constraint=None,
                     **kwargs):
    
    0 讨论(0)
提交回复
热议问题