Optimal Feature Selection Based on Discrete Grasshopper Optimization Algorithm and K-nearest Neighbor Classifier

被引:0
|
作者
Qi, Yu-Liang [1 ]
Wang, Jie-Sheng [1 ]
Song, Yu-Wei [1 ]
Wang, Yu-Cai [1 ]
Song, Hao-Ming [1 ]
Hou, Jia-Ning [1 ]
机构
[1] Univ Sci & Technol Liaoning, Sch Elect & Informat Engn, Anshan 114051, Peoples R China
关键词
Feature selection; Grasshopper Optimization; Algorithm; KNN Classifier; Performance Evaluation;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In the majority of data mining tasks, feature selection serves as an essential pre-processing step. The most important attributes are selected to lower the dimensionality reduction of data set and enhance the precision of classification. Natural heuristic algorithms are extensively employed in the realm of encapsulated feature selection. Based on the wrapper feature selection method, seven natural heuristic algorithms are used to solve feature selection problems and perform performance comparison, which include Slime Mold Algorithm (SMA), Whale Optimization Algorithm (WOA), Harris Hawks Optimization Algorithm (HHO), Marine Predator Algorithm (MPA), Butterfly Optimization Algorithm (BOA), Cuckoo Search (CS) and Firefly Algorithm (FA). At the same time, performance tests are carried out on 21 standard UCI data sets to verily the functionality of various algorithms, and the convergence curves and accuracy boxplots of 7 natural heuristic algorithms on 21 data sets are given. The simulation outcomes were assessed utilizing the mean and standard deviation of fitness, as well as the number of chosen features, and the running time, with the optimal value in bold. By comparing the comprehensive performance indexes, MPA obtained the maximum mean fitness value in most data sets (16 data sets), followed by FA (6 data sets). SMA obtained the best performance and finds the minimum eigenvalues (20 data sets) in multiple data sets and has an advantage in computing time.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 50 条
  • [1] BAOA: Binary Arithmetic Optimization Algorithm With K-Nearest Neighbor Classifier for Feature Selection
    Khodadadi, Nima
    Khodadadi, Ehsan
    Al-Tashi, Qasem
    El-Kenawy, El-Sayed M.
    Abualigah, Laith
    Abdulkadir, Said Jadid
    Alqushaibi, Alawi
    Mirjalili, Seyedali
    [J]. IEEE ACCESS, 2023, 11 : 94094 - 94115
  • [2] Optimization Strategies for the k-Nearest Neighbor Classifier
    Yepdjio Nkouanga H.
    Vajda S.
    [J]. SN Computer Science, 4 (1)
  • [3] Improving performance of the k-nearest neighbor classifier by combining feature selection with feature weighting
    Bao, Yongguang
    Du, Xiaoyong
    Ishii, Naohiro
    [J]. Transactions of the Japanese Society for Artificial Intelligence, 2002, 17 (03) : 209 - 216
  • [4] An Algorithm of Incremental Bayesian Classifier Based on K-Nearest Neighbor
    Wang, Dong
    Xiong, Shi-huan
    [J]. MEMS, NANO AND SMART SYSTEMS, PTS 1-6, 2012, 403-408 : 1455 - 1459
  • [5] Feature-weighted k-nearest neighbor classifier
    Vivencio, Diego P.
    Hruschka, Estevarn R., Jr.
    Nicoletti, M. do Carmo
    dos Santos, Edimilson B.
    Galvao, Sebastian D. C. O.
    [J]. 2007 IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTATIONAL INTELLIGENCE, VOLS 1 AND 2, 2007, : 481 - +
  • [6] K-Nearest Neighbor Classifier for Uncertain Data in Feature Space
    Lim, Sung-Yeon
    Ko, Changwan
    Jeong, Young-Seon
    Baek, Jaeseung
    [J]. INDUSTRIAL ENGINEERING AND MANAGEMENT SYSTEMS, 2023, 22 (04): : 414 - 421
  • [7] Optimal gene selection for cancer classification with partial correlation and k-nearest neighbor classifier
    Yoo, SH
    Cho, SB
    [J]. PRICAI 2004: TRENDS IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 3157 : 713 - 722
  • [8] A New Feature Selection Method Based on K-Nearest Neighbor Approach
    Wang, Xianchang
    Zhang, Lishi
    Ma, Yonggang
    [J]. PROCEEDINGS OF THE 2016 7TH INTERNATIONAL CONFERENCE ON EDUCATION, MANAGEMENT, COMPUTER AND MEDICINE (EMCM 2016), 2017, 59 : 657 - 660
  • [9] Simultaneous feature selection and feature weighting using Hybrid Tabu Search/K-nearest neighbor classifier
    Tahir, Muhammad Atif
    Bouridane, Ahmed
    Kurugollu, Fatih
    [J]. PATTERN RECOGNITION LETTERS, 2007, 28 (04) : 438 - 446
  • [10] Hybrid k-Nearest Neighbor Classifier
    Yu, Zhiwen
    Chen, Hantao
    Liu, Jiming
    You, Jane
    Leung, Hareton
    Han, Guoqiang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (06) : 1263 - 1275