An Enhanced Extreme Learning Machine Based on Liu Regression

Yıldırım H., Özkale M. R.

NEURAL PROCESSING LETTERS, vol.52, no.1, pp.421-442, 2020 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 52 Issue: 1
  • Publication Date: 2020
  • Doi Number: 10.1007/s11063-020-10263-2
  • Journal Name: NEURAL PROCESSING LETTERS
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, PASCAL, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, Information Science and Technology Abstracts, INSPEC, zbMATH, DIALNET
  • Page Numbers: pp.421-442
  • Keywords: Extreme learning machine, Neural networks, Liu estimator, Regression, RIDGE-REGRESSION
  • Çukurova University Affiliated: Yes

Abstract

Extreme learning machine (ELM) is one of the most remarkable machine learning algorithm in consequence of superior properties particularly its speed. ELM algorithm tends to have some drawbacks like instability and poor generalization performance in the presence of perturbation and multicollinearity. This paper introduces a novel algorithm based on Liu regression estimator (L-ELM) to handle these drawbacks. Different selection approaches have been used to determine the appropriate Liu biasing parameter. The new algorithm is tested against the basic ELM, RR-ELM, AUR-ELM and OP-ELM on nine well-known benchmark data sets. Statistical significance tests have been carried out. Experimental results show that L-ELM for at least one Liu biasing parameter generally outperforms basic ELM, RR-ELM, AUR-ELM and OP-ELM in terms of stability and generalization performance with a little lost of speed. Conversely, the training time of L-ELM is generally much slower than RR-ELM, AUR-ELM and OP-ELM. Consequently, the proposed algorithm can be considered a powerful alternative to avoid the loss of performance in regression studies