Adaptive operator selection with dueling deep Q-network for evolutionary multi-objective optimization

被引:5
|
作者
Yin, Shihong [1 ]
Xiang, Zhengrong [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi -objective optimization; Adaptive operator selection; Dueling deep Q -network; Reinforcement learning; Evolutionary algorithm; DIFFERENTIAL EVOLUTION; ALGORITHM; MOEA/D;
D O I
10.1016/j.neucom.2024.127491
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Adaptive operator selection is an online method that automatically adjusts the application rate of different operators based on their actual performance. This paper proposes an adaptive operator selection paradigm based on dueling deep Q -network (DDQN), aiming to improve the training efficiency of the Q -network for solving multi -objective optimization problems. The Q -network is decomposed into state value and action advantage networks, allowing the agent to learn state values more frequently and accurately. A novel state space and reward mechanism are designed to adapt to the characteristics of evolutionary multi -objective optimization. Combining adaptive operator selection with a multi -objective evolutionary algorithm with adaptive weights (AdaW), an AdaW-DDQN algorithm with high adaptability is proposed. Experimental results on three complex benchmark suites demonstrate that the proposed adaptive operator selection paradigm significantly improves the performance of multi -objective optimization algorithms. The AdaW-DDQN algorithm provides an effective and efficient solution for solving multi -objective optimization problems.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based Adaptive Operator Selection for Evolutionary Multi-Objective Optimization
    Tian, Ye
    Li, Xiaopeng
    Ma, Haiping
    Zhang, Xingyi
    Tan, Kay Chen
    Jin, Yaochu
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (04): : 1051 - 1064
  • [2] A Clonal Selection Adaptive Local Search Operator for multi-objective optimization evolutionary algorithm
    Li, Yong
    Wang, Yu
    Zhang, Yuxian
    An, Yuejun
    [J]. PROCEEDINGS OF THE 2012 24TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2012, : 755 - 757
  • [3] Multi-Objective Deep Q-Network Control for Actively Lubricated Bearings
    Shutin, Denis
    Kazakov, Yuri
    [J]. LUBRICANTS, 2024, 12 (07)
  • [4] A Novel Multi-Objective Deep Q-Network: Addressing Immediate and Delayed Rewards in Multi-Objective Q-Learning
    Zhang, Youming
    [J]. IEEE Access, 2024, 12 : 144932 - 144949
  • [5] A decomposition-based multi-objective evolutionary algorithm with Q-learning for adaptive operator selection
    Xue, Fei
    Chen, Yuezheng
    Wang, Peiwen
    Ye, Yunsen
    Dong, Jinda
    Dong, Tingting
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (14): : 21229 - 21283
  • [6] Multi-objective optimization for improving machining benefit based on WOA-BBPN and a Deep Double Q-Network
    Lu, Juan
    Chen, Zhiheng
    Liao, Xiaoping
    Chen, Chaoyi
    Ouyang, Haibin
    Li, Steven
    [J]. APPLIED SOFT COMPUTING, 2023, 142
  • [7] An Improved Selection Operator for Multi-objective Optimization
    Zhao, Hong
    Zhan, Zhi-Hui
    Chen, Wei-Neng
    Luo, Xiao-Nan
    Gu, Tian-Long
    Guan, Ren-Chu
    Huang, Lan
    Zhang, Jun
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2019, PT I, 2019, 11554 : 379 - 388
  • [8] Dynamic constrained evolutionary optimization based on deep Q-network
    Liang, Zhengping
    Yang, Ruitai
    Wang, Jigang
    Liu, Ling
    Ma, Xiaoliang
    Zhu, Zexuan
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249
  • [9] A classification tree and decomposition based multi-objective evolutionary algorithm with adaptive operator selection
    Huantong Geng
    Ke Xu
    Yanqi Zhang
    Zhengli Zhou
    [J]. Complex & Intelligent Systems, 2023, 9 : 579 - 596
  • [10] A classification tree and decomposition based multi-objective evolutionary algorithm with adaptive operator selection
    Geng, Huantong
    Xu, Ke
    Zhang, Yanqi
    Zhou, Zhengli
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (01) : 579 - 596