Comparison of Liu and two parameter principal component estimator to combat multicollinearity

KAÇIRANLAR S., ÖZBAY N., Ozkan E., GÜLER H.

CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, cilt.34, sa.5, 2022 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 34 Sayı: 5
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1002/cpe.6737
  • Dergi Adı: CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Aerospace Database, Applied Science & Technology Source, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC, Metadex, zbMATH, Civil Engineering Abstracts
  • Anahtar Kelimeler: Liu regression, multicollinearity, principal component regression, ridge regression, two-parameter estimator, BIASED-ESTIMATION, RIDGE-REGRESSION, SELECTION
  • Çukurova Üniversitesi Adresli: Evet

Özet

Biased estimation methods like ridge regression, Liu-type regression, two-parameter regression and principal component regression have become very popular in the analysis of applied researches for health, economics, chemometrics, and social sciences in recent years. A dataset in such applied fields tends to be characterized by many independent variables on relatively fewer observations. In addition, there is a high degree of near collinearity among the explanatory variables. It is common knowledge that under these conditions, ordinary least squares estimations of regression coefficients may be very unstable, leading to very poor prediction accuracy. The aim of this article is to examine the performance of the combination of principal components regression and some biased regression estimators such as ridge, Liu and two-parameter estimators. For this reason, a real-life application is presented in which different selection methods of the biasing parameters are employed.