Penalized regression via the restricted bridge estimator
dc.authorid | Yuzbasi, Bahadir/0000-0002-6196-3201 | |
dc.authorid | Arashi, Mohammad/0000-0002-5881-9241 | |
dc.authorwosid | Yuzbasi, Bahadir/F-6907-2013 | |
dc.authorwosid | Arashi, Mohammad/ABD-3395-2020 | |
dc.contributor.author | Yuzbasi, Bahadir | |
dc.contributor.author | Arashi, Mohammad | |
dc.contributor.author | Akdeniz, Fikri | |
dc.date.accessioned | 2024-08-04T20:50:18Z | |
dc.date.available | 2024-08-04T20:50:18Z | |
dc.date.issued | 2021 | |
dc.department | İnönü Üniversitesi | en_US |
dc.description.abstract | This article is concerned with the bridge regression, which is a special family in penalized regression with penalty function Sigma(p)(j=1) |beta(j) (q) with q > 0, in a linear model with linear restrictions. The proposed restricted bridge (RBRIDGE) estimator simultaneously estimates parameters and selects important variables when a piece of prior information about parameters are available in either low-dimensional or high-dimensional case. Using local quadratic approximation, we approximate the penalty term around a local initial values vector. The RBRIDGE estimator enjoys a closed-form expression that can be solved when q > 0. Special cases of our proposal are the restricted LASSO (q = 1), restricted RIDGE (q = 2), and restricted Elastic Net (1 < q < 2) estimators. We provide some theoretical properties of the RBRIDGE estimator for the low-dimensional case, whereas the computational aspects are given for both low- and high-dimensional cases. An extensive Monte Carlo simulation study is conducted based on different prior pieces of information. The performance of the RBRIDGE estimator is compared with some competitive penalty estimators and the ORACLE. We also consider four real-data examples analysis for comparison sake. The numerical results show that the suggested RBRIDGE estimator outperforms outstandingly when the prior is true or near exact. | en_US |
dc.description.sponsorship | Inonu University Scientific Researches Unit [SUA-2019-1629] | en_US |
dc.description.sponsorship | The authors thank the editor and reviewer for their detailed reading of the manuscript and their valuable comments and suggestions that led to a considerable improvement of the paper. Prof. Yuzba was supported by Inonu University Scientific Researches Unit with the project number SUA-2019-1629 during his visit to the University of British Columbia, Vancouver, Canada. | en_US |
dc.identifier.doi | 10.1007/s00500-021-05763-9 | |
dc.identifier.endpage | 8416 | en_US |
dc.identifier.issn | 1432-7643 | |
dc.identifier.issn | 1433-7479 | |
dc.identifier.issue | 13 | en_US |
dc.identifier.scopus | 2-s2.0-85107873517 | en_US |
dc.identifier.scopusquality | Q2 | en_US |
dc.identifier.startpage | 8401 | en_US |
dc.identifier.uri | https://doi.org/10.1007/s00500-021-05763-9 | |
dc.identifier.uri | https://hdl.handle.net/11616/99985 | |
dc.identifier.volume | 25 | en_US |
dc.identifier.wos | WOS:000641235700004 | en_US |
dc.identifier.wosquality | Q2 | en_US |
dc.indekslendigikaynak | Web of Science | en_US |
dc.indekslendigikaynak | Scopus | en_US |
dc.language.iso | en | en_US |
dc.publisher | Springer | en_US |
dc.relation.ispartof | Soft Computing | en_US |
dc.relation.publicationcategory | Makale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı | en_US |
dc.rights | info:eu-repo/semantics/openAccess | en_US |
dc.subject | Bridge regression | en_US |
dc.subject | Restricted estimation | en_US |
dc.subject | Machine learning | en_US |
dc.subject | Quadratic approximation | en_US |
dc.subject | Newton-Raphson | en_US |
dc.subject | Variable selection | en_US |
dc.subject | Multicollinearity | en_US |
dc.title | Penalized regression via the restricted bridge estimator | en_US |
dc.type | Article | en_US |