Evolutionary Multitasking for Large-Scale Multiobjective Optimization

被引:20
|
作者
Liu, Songbai [1 ,2 ]
Lin, Qiuzhen [3 ]
Feng, Liang [4 ]
Wong, Ka-Chun [5 ]
Tan, Kay Chen [6 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[4] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[6] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Evolutionary algorithm (EA); large-scale multiobjective optimization; multitasking; transfer learning; ALGORITHM; SEARCH;
D O I
10.1109/TEVC.2022.3166482
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Evolutionary transfer optimization (ETO) has been becoming a hot research topic in the field of evolutionary computation, which is based on the fact that knowledge learning and transfer across the related optimization exercises can improve the efficiency of others. However, rare studies employ ETO to solve large-scale multiobjective optimization problems (LMOPs). To fill this research gap, this article proposes a new multitasking ETO algorithm via a powerful transfer learning model to simultaneously solve multiple LMOPs. In particular, inspired by adversarial domain adaptation in transfer learning, a discriminative reconstruction network (DRN) model (containing an encoder, a decoder, and a classifier) is created for each LMOP. At each generation, the DRN is trained by the currently obtained nondominated solutions for all LMOPs via backpropagation with gradient descent. With this well-trained DRN model, the proposed algorithm can transfer the solutions of source LMOPs directly to the target LMOP for assisting its optimization, can evaluate the correlation between the source and target LMOPs to control the transfer of solutions, and can learn a dimensional-reduced Pareto-optimal subspace of the target LMOP to improve the efficiency of transfer optimization in the large-scale search space. Moreover, we propose a real-world multitasking LMOP suite to simulate the training of deep neural networks (DNNs) on multiple different classification tasks. Finally, the effectiveness of the proposed algorithm has been validated in this real-world problem suite and the other two synthetic problem suites.
引用
收藏
页码:863 / 877
页数:15
相关论文
共 50 条
  • [1] Evolutionary Multitasking with Scale-Adaptive Subspace for Large-Scale Optimization
    Song, Chunxiang
    Wang, Xiaojun
    Cai, Yiqiao
    [J]. 2022 2ND IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND ARTIFICIAL INTELLIGENCE (SEAI 2022), 2022, : 160 - 165
  • [2] Evolutionary Large-Scale Multiobjective Optimization: Benchmarks and Algorithms
    Liu, Songbai
    Lin, Qiuzhen
    Wong, Ka-Chun
    Li, Qing
    Tan, Kay Chen
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2023, 27 (03) : 401 - 415
  • [3] A dual decomposition strategy for large-scale multiobjective evolutionary optimization
    Yang, Cuicui
    Wang, Peike
    Ji, Junzhong
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (05): : 3767 - 3788
  • [4] An Evolutionary Algorithm for Large-Scale Sparse Multiobjective Optimization Problems
    Tian, Ye
    Zhang, Xingyi
    Wang, Chao
    Jin, Yaochu
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (02) : 380 - 393
  • [5] A Multivariation Multifactorial Evolutionary Algorithm for Large-Scale Multiobjective Optimization
    Feng, Yinglan
    Feng, Liang
    Kwong, Sam
    Tan, Kay Chen
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2022, 26 (02) : 248 - 262
  • [6] Iterated Problem Reformulation for Evolutionary Large-Scale Multiobjective Optimization
    He, Cheng
    Cheng, Ran
    Tian, Ye
    Zhang, Xingyi
    [J]. 2020 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2020,
  • [7] Learning to Accelerate Evolutionary Search for Large-Scale Multiobjective Optimization
    Liu, Songbai
    Li, Jun
    Lin, Qiuzhen
    Tian, Ye
    Tan, Kay Chen
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2023, 27 (01) : 67 - 81
  • [8] Large-Scale Evolutionary Multiobjective Optimization Assisted by Directed Sampling
    Qin, Shufen
    Sun, Chaoli
    Jin, Yaochu
    Tan, Ying
    Fieldsend, Jonathan
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2021, 25 (04) : 724 - 738
  • [9] A dual decomposition strategy for large-scale multiobjective evolutionary optimization
    Cuicui Yang
    Peike Wang
    Junzhong Ji
    [J]. Neural Computing and Applications, 2023, 35 : 3767 - 3788
  • [10] Adaptive Offspring Generation for Evolutionary Large-Scale Multiobjective Optimization
    He, Cheng
    Cheng, Ran
    Yazdani, Danial
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (02): : 786 - 798