Comparision of Solutions of Numerical Gradient Descent Method and Continous Time Gradient Descent Dynamics and Lyapunov Stability
Küçük Resim Yok
Tarih
2019
Yazarlar
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
Ieee
Erişim Hakkı
info:eu-repo/semantics/closedAccess
Özet
Gradient descent dynamics is an optimization techniques that is widely used in machine learning applications. This technique updates model parameter in the direction of descending of learning error. In this study, Lyapunov stability of continuous time gradient descent dynamics is investigated and robust stability condition, which is needed for implementation of gradient descent dynamics in intelligent control system applications, is evaluated. In a illustrative example, for a De Jong's function type error function, solutions of continuous gradient descent dynamics and Euler method based numerical solutions are compared and stability concerns is discussed.
Açıklama
27th Signal Processing and Communications Applications Conference (SIU) -- APR 24-26, 2019 -- Sivas Cumhuriyet Univ, Sivas, TURKEY
Anahtar Kelimeler
gradient descent method, learning dynamics, Lyapunov stability
Kaynak
2019 27th Signal Processing and Communications Applications Conference (Siu)
WoS Q Değeri
N/A
Scopus Q Değeri
N/A
