Comparing ordinary ridge and generalized ridge regression results obtained using genetic algorithms for ridge parameter selection

Ndabashinze B., Siray G.

COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, cilt.51, sa.10, ss.6159-6169, 2022 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 51 Sayı: 10
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1080/03610918.2020.1797793
  • Dergi Adı: COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Business Source Elite, Business Source Premier, CAB Abstracts, Compendex, Computer & Applied Sciences, Veterinary Science Database, zbMATH, Civil Engineering Abstracts
  • Sayfa Sayıları: ss.6159-6169
  • Anahtar Kelimeler: Dynamic penalty function, Genetic algorithms, Multicollinearity, Ridge regression, Variance Inflation Factor, PERFORMANCE
  • Çukurova Üniversitesi Adresli: Evet

Özet

Ridge regression is an alternative to the ordinary least squares method when multicollinearity presents among the regressor variables in multiple linear regression analysis. The selection of the ridge parameter is an important issue to obtain a good performance of the ridge regression. In this article, a new method is proposed for determining the ridge parameter in ridge regression. This method is based on minimizing the statistic measures, which are mean squared error (MSE), mean absolute error (MAE), mean absolute prediction error (MAPE), by using genetic algorithms with the dynamic penalty function and also managing the values of Variance Inflation Factors to be less than or equal to 10. The ordinary ridge regression (ORR) and generalized ridge regression (GRR) are compared by performing a simulation study with many scenarios and a numerical example. Findings show that the GRR provides better (minimum MSE, MAE, and MAPE) results than the ORR.