Improving Harris hawks optimization algorithm for hyperparameters estimation and feature selection in v-support vector regression based on opposition-based learning

被引:20
|
作者
Ismael, Omar Mohammed [1 ]
Qasim, Omar Saber [1 ]
Algamal, Zakariya Yahya [2 ]
机构
[1] Univ Mosul, Dept Math, Mosul, Iraq
[2] Univ Mosul, Dept Stat & Informat, Mosul, Iraq
关键词
feature selection; Harris hawks optimization algorithm; hyperparameters selection; opposition‐ based learning; v‐ support vector regression; TUNING PARAMETER-ESTIMATION; HYBRID GENETIC ALGORITHM; FIREFLY ALGORITHM; DESIGN OPTIMIZATION; VARIABLE SELECTION; MACHINE; MODELS; SVR;
D O I
10.1002/cem.3311
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many real problems have been solved by support vector regression, especially v-support vector regression (v-SVR), but there are hyperparameters that usually needed to tune. In addition, v-SVR cannot perform feature selection. Nature-inspired algorithms have been used as a feature selection and as hyperparameters estimation procedure. In this paper, the opposition-based learning Harris hawks optimization algorithm (HHOA-OBL) is proposed to optimize the hyperparameters of the v-SVR with embedding the feature selection simultaneously. The experimental results over four datasets show that the HHOA-OBL outperforms the standard Harris hawks optimization algorithm, grid search, and cross-validation methods, in terms of prediction, number of selected features, and running time. Besides, the experimental results of the HHOA-OBL confirm the efficiency of the proposed algorithm in improving the prediction performance and computational time compared with other nature-inspired algorithms, which proves the ability of HHOA-OBL in searching for the best hyperparameters values and selecting the most informative features for prediction tasks. Thus, the experiments and comparisons support the performance of the proposed approach in making predictions in other real applications.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Opposition-based Harris Hawks optimization algorithm for feature selection in breast mass classification
    Hans, Rahul
    Kaur, Harjot
    Kaur, Navreet
    [J]. JOURNAL OF INTERDISCIPLINARY MATHEMATICS, 2020, 23 (01) : 97 - 106
  • [2] Improving grasshopper optimization algorithm for hyperparameters estimation and feature selection in support vector regression
    Algamal, Zakariya Yahya
    Qasim, Maimoonah Khalid
    Lee, Muhammad Hisyam
    Ali, Haithem Taha Mohammad
    [J]. CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2021, 208
  • [3] Improved Harris Hawks Optimization Using Elite Opposition-Based Learning and Novel Search Mechanism for Feature Selection
    Sihwail, Rami
    Omar, Khairuddin
    Ariffin, Khairul Akram Zainol
    Tubishat, Mohammad
    [J]. IEEE ACCESS, 2020, 8 : 121127 - 121145
  • [4] A self-adaptive Harris Hawks optimization algorithm with opposition-based learning and chaotic local search strategy for global optimization and feature selection
    Abdelazim G. Hussien
    Mohamed Amin
    [J]. International Journal of Machine Learning and Cybernetics, 2022, 13 : 309 - 336
  • [5] A self-adaptive Harris Hawks optimization algorithm with opposition-based learning and chaotic local search strategy for global optimization and feature selection
    Hussien, Abdelazim G.
    Amin, Mohamed
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (02) : 309 - 336
  • [6] Opposition-based learning Harris hawks optimization with advanced transition rules: principles and analysis
    Gupta, Shubham
    Deep, Kusum
    Heidari, Ali Asghar
    Moayedi, Hossein
    Wang, Mingjing
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2020, 158
  • [7] Fitness Landscape Approximation by Adaptive Support Vector Regression with Opposition-Based Learning
    Pei, Yan
    Takagi, Hideyuki
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 1329 - 1334
  • [8] An opposition-based social spider optimization for feature selection
    Rehab Ali Ibrahim
    Mohamed Abd Elaziz
    Diego Oliva
    Erik Cuevas
    Songfeng Lu
    [J]. Soft Computing, 2019, 23 : 13547 - 13567
  • [9] Excogitating marine predators algorithm based on random opposition-based learning for feature selection
    Balakrishnan, Kulanthaivel
    Dhanalakshmi, Ramasamy
    Khaire, Utkarsh Mahadeo
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (04):
  • [10] An opposition-based social spider optimization for feature selection
    Ibrahim, Rehab Ali
    Abd Elaziz, Mohamed
    Oliva, Diego
    Cuevas, Erik
    Lu, Songfeng
    [J]. SOFT COMPUTING, 2019, 23 (24) : 13547 - 13567