An Enhanced Extreme Learning Machine Based on Liu Regression

Yıldırım H., Özkale M. R.

NEURAL PROCESSING LETTERS, cilt.52, sa.1, ss.421-442, 2020 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 52 Sayı: 1
  • Basım Tarihi: 2020
  • Doi Numarası: 10.1007/s11063-020-10263-2
  • Dergi Adı: NEURAL PROCESSING LETTERS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, PASCAL, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, Information Science and Technology Abstracts, INSPEC, zbMATH, DIALNET
  • Sayfa Sayıları: ss.421-442
  • Anahtar Kelimeler: Extreme learning machine, Neural networks, Liu estimator, Regression, RIDGE-REGRESSION
  • Çukurova Üniversitesi Adresli: Evet

Özet

Extreme learning machine (ELM) is one of the most remarkable machine learning algorithm in consequence of superior properties particularly its speed. ELM algorithm tends to have some drawbacks like instability and poor generalization performance in the presence of perturbation and multicollinearity. This paper introduces a novel algorithm based on Liu regression estimator (L-ELM) to handle these drawbacks. Different selection approaches have been used to determine the appropriate Liu biasing parameter. The new algorithm is tested against the basic ELM, RR-ELM, AUR-ELM and OP-ELM on nine well-known benchmark data sets. Statistical significance tests have been carried out. Experimental results show that L-ELM for at least one Liu biasing parameter generally outperforms basic ELM, RR-ELM, AUR-ELM and OP-ELM in terms of stability and generalization performance with a little lost of speed. Conversely, the training time of L-ELM is generally much slower than RR-ELM, AUR-ELM and OP-ELM. Consequently, the proposed algorithm can be considered a powerful alternative to avoid the loss of performance in regression studies