Comparison of the Stochastic Gradient Descent Based Optimization Techniques
| dc.authorid | Talu, Muhammed Fatih/0000-0003-1166-8404 | |
| dc.authorwosid | Talu, Muhammed Fatih/W-2834-2017 | |
| dc.contributor.author | Yazan, Ersan | |
| dc.contributor.author | Talu, M. Fatih | |
| dc.date.accessioned | 2024-08-04T20:44:14Z | |
| dc.date.available | 2024-08-04T20:44:14Z | |
| dc.date.issued | 2017 | |
| dc.department | İnönü Üniversitesi | en_US |
| dc.description | 2017 International Artificial Intelligence and Data Processing Symposium (IDAP) -- SEP 16-17, 2017 -- Malatya, TURKEY | en_US |
| dc.description.abstract | The stochastic gradual descent method (SGD) is a popular optimization technique based on updating each theta(k) parameter in the partial derivative J(theta)/partial derivative theta(k) direction to minimize / maximize the (J theta) cost function. This technique is frequently used in current artificial learning methods such as convolutional learning and automatic encoders. In this study, five different approaches (Momentum, Adagrad, Adadelta, Rmsprop ve Adam) based on SDA used in updating the theta parameters were investigated. By selecting specific test functions, the advantages and disadvantages of each approach are compared with each other in terms of the number of oscillations, the parameter update rate and the minimum cost reached. The comparison results are shown graphically. | en_US |
| dc.description.sponsorship | IEEE Turkey Sect,Anatolian Sci | en_US |
| dc.identifier.isbn | 978-1-5386-1880-6 | |
| dc.identifier.scopus | 2-s2.0-85039922503 | en_US |
| dc.identifier.scopusquality | N/A | en_US |
| dc.identifier.uri | https://hdl.handle.net/11616/98097 | |
| dc.identifier.wos | WOS:000426868700139 | en_US |
| dc.identifier.wosquality | N/A | en_US |
| dc.indekslendigikaynak | Web of Science | en_US |
| dc.indekslendigikaynak | Scopus | en_US |
| dc.language.iso | tr | en_US |
| dc.publisher | Ieee | en_US |
| dc.relation.ispartof | 2017 International Artificial Intelligence and Data Processing Symposium (Idap) | en_US |
| dc.relation.publicationcategory | Konferans Öğesi - Uluslararası - Kurum Öğretim Elemanı | en_US |
| dc.rights | info:eu-repo/semantics/closedAccess | en_US |
| dc.subject | Gradient Descent | en_US |
| dc.subject | Momentum | en_US |
| dc.subject | Adagrad | en_US |
| dc.subject | Adadelta | en_US |
| dc.subject | Rmsprop | en_US |
| dc.subject | Adam | en_US |
| dc.title | Comparison of the Stochastic Gradient Descent Based Optimization Techniques | en_US |
| dc.type | Conference Object | en_US |
