Comparisons of the unbiased ridge estimation to the other estimations


Ozkale M. R. , Kaciranlar S.

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, cilt.36, ss.707-723, 2007 (SCI İndekslerine Giren Dergi) identifier identifier

  • Cilt numarası: 36
  • Basım Tarihi: 2007
  • Doi Numarası: 10.1080/03610920601033652
  • Dergi Adı: COMMUNICATIONS IN STATISTICS-THEORY AND METHODS
  • Sayfa Sayısı: ss.707-723

Özet

In the presence of multicollinearity, ordinary least squares (OLS) estimation is inadequate. Alternative estimation techniques were proposed. One of which is unbiased ridge regression (URR) estimator given by Crouse et al. (1995). In this article, we introduced the URR estimator in two different ways by following Farebrother (1984) and Troskie et al. (1994). We discuss its properties in some detail, comparing URR estimator to the OLS, the ordinary ridge regression (ORR), and the r - k class estimators in the sense of matrix mean square error (MMSE) and residuals. We also illustrate our findings with a numerical example based on the data generated by Hoerl and Kennard (1981) which is commonly used in literature to study the effect of multicollinearity.

In the presence of multicollinearity, ordinary least squares (OLS) estimation is inadequate. Alternative estimation techniques were proposed. One of which is unbiased ridge regression (URR) estimator given by Crouse et al. (1995). In this article, we introduced the URR estimator in two different ways by following Farebrother (1984) and Troskie et al. (1994). We discuss its properties in some detail, comparing URR estimator to the OLS, the ordinary ridge regression (ORR), and the r − k class estimators in the sense of matrix mean square error (MMSE) and residuals. We also illustrate our findings with a numerical example based on the data generated by Hoerl and Kennard (1981) which is commonly used in literature to study the effect of multicollinearity.