What are alternatives of Gradient Descent?

前端 未结 5 1511
失恋的感觉
失恋的感觉 2021-01-31 22:19

Gradient Descent has a problem of Local Minima. We need run gradient descent exponential times for to find global minima.

Can anybody tell me about any alternatives of

5条回答
  •  终归单人心
    2021-01-31 22:59

    It has been demonstrated that being stuck in a local minima is very unlikely to occur in a high dimensional space because having all derivatives equals to zero in every dimensions is unlikely. (Source Andrew NG Coursera DeepLearning Specialization) That also explain why gradient descent works so well.

提交回复
热议问题