An Evolutionary Algorithm for Large-Scale Sparse Multiobjective Optimization Problems

被引:162
|
作者
Tian, Ye [1 ]
Zhang, Xingyi [2 ]
Wang, Chao [2 ]
Jin, Yaochu [3 ,4 ]
机构
[1] Anhui Univ, Inst Phys Sci & Informat Technol, Minist Educ, Key Lab Intelligent Comp & Signal Proc, Hefei 230601, Peoples R China
[2] Anhui Univ, Sch Comp Sci & Technol, Minist Educ, Key Lab Intelligent Comp & Signal Proc, Hefei 230601, Peoples R China
[3] Univ Surrey, Dept Comp Sci, Guildford GU2 7XH, Surrey, England
[4] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Pareto optimization; Neural networks; Feature extraction; Evolutionary computation; Training; Sociology; Evolutionary algorithm; evolutionary neural network; feature selection; large-scale multiobjective optimization (MOP); sparse Pareto optimal solutions; NEURAL-NETWORKS; FEATURE-SELECTION; DECOMPOSITION; MOEA/D; PERFORMANCE; FRAMEWORK; ENSEMBLE; VERSION; FASTER;
D O I
10.1109/TEVC.2019.2918140
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the last two decades, a variety of different types of multiobjective optimization problems (MOPs) have been extensively investigated in the evolutionary computation community. However, most existing evolutionary algorithms encounter difficulties in dealing with MOPs whose Pareto optimal solutions are sparse (i.e., most decision variables of the optimal solutions are zero), especially when the number of decision variables is large. Such large-scale sparse MOPs exist in a wide range of applications, for example, feature selection that aims to find a small subset of features from a large number of candidate features, or structure optimization of neural networks whose connections are sparse to alleviate overfitting. This paper proposes an evolutionary algorithm for solving large-scale sparse MOPs. The proposed algorithm suggests a new population initialization strategy and genetic operators by taking the sparse nature of the Pareto optimal solutions into consideration, to ensure the sparsity of the generated solutions. Moreover, this paper also designs a test suite to assess the performance of the proposed algorithm for large-scale sparse MOPs. The experimental results on the proposed test suite and four application examples demonstrate the superiority of the proposed algorithm over seven existing algorithms in solving large-scale sparse MOPs.
引用
收藏
页码:380 / 393
页数:14
相关论文
共 50 条
  • [1] A two-stage evolutionary algorithm for large-scale sparse multiobjective optimization problems
    Jiang, Jing
    Han, Fei
    Wang, Jie
    Ling, Qinghua
    Han, Henry
    Wang, Yue
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2022, 72
  • [2] Multiple sparse detection-based evolutionary algorithm for large-scale sparse multiobjective optimization problems
    Jin Ren
    Feiyue Qiu
    Huizhen Hu
    [J]. Complex & Intelligent Systems, 2023, 9 : 4369 - 4388
  • [3] Multiple sparse detection-based evolutionary algorithm for large-scale sparse multiobjective optimization problems
    Ren, Jin
    Qiu, Feiyue
    Hu, Huizhen
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4369 - 4388
  • [4] Improved Evolutionary Operators for Sparse Large-Scale Multiobjective Optimization Problems
    Kropp, Ian
    Nejadhashemi, A. Pouyan
    Deb, Kalyanmoy
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2024, 28 (02) : 460 - 473
  • [5] A Pattern Mining-Based Evolutionary Algorithm for Large-Scale Sparse Multiobjective Optimization Problems
    Tian, Ye
    Lu, Chang
    Zhang, Xingyi
    Cheng, Fan
    Jin, Yaochu
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) : 6784 - 6797
  • [6] Dynamic matrix-based evolutionary algorithm for large-scale sparse multiobjective optimization problems
    Qiu, Feiyue
    Hu, Huizhen
    Ren, Jin
    Wang, Liping
    Pan, Xiaotian
    Qiu, Qicang
    [J]. MEMETIC COMPUTING, 2023, 15 (03) : 301 - 317
  • [7] Dynamic matrix-based evolutionary algorithm for large-scale sparse multiobjective optimization problems
    Feiyue Qiu
    Huizhen Hu
    Jin Ren
    Liping Wang
    Xiaotian Pan
    Qicang Qiu
    [J]. Memetic Computing, 2023, 15 : 301 - 317
  • [8] An adaptive sparse large-scale multiobjective evolutionary algorithm
    Qiu, Feiyue
    Hu, Huizhen
    Ren, Jin
    Wang, Liping
    Qiu, Qicang
    [J]. PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION, GECCO 2023 COMPANION, 2023, : 403 - 406
  • [9] A Multipopulation Evolutionary Algorithm for Solving Large-Scale Multimodal Multiobjective Optimization Problems
    Tian, Ye
    Liu, Ruchen
    Zhang, Xingyi
    Ma, Haiping
    Tan, Kay Chen
    Jin, Yaochu
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2021, 25 (03) : 405 - 418
  • [10] An efficient evolutionary algorithm based on deep reinforcement learning for large-scale sparse multiobjective optimization
    Mengqi Gao
    Xiang Feng
    Huiqun Yu
    Xiuquan Li
    [J]. Applied Intelligence, 2023, 53 : 21116 - 21139