A Mixture-of-Experts Prediction Framework for Evolutionary Dynamic Multiobjective Optimization

被引:55
|
作者
Rambabu, Rethnaraj [1 ]
Vadakkepat, Prahlad [1 ]
Tan, Kay Chen [2 ]
Jiang, Min [3 ,4 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117576, Singapore
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[3] Xiamen Univ, Dept Cognit Sci & Technol, Xiamen 361005, Peoples R China
[4] Xiamen Univ, Fujian Key Lab Machine Intelligence & Robot, Xiamen 361005, Peoples R China
关键词
Optimization; Sociology; Statistics; Optical fibers; Heuristic algorithms; Shape; Switches; Dynamic multiobjective optimization; evolutionary algorithms (EAs); mixture-of-experts (MoE); ALGORITHMS;
D O I
10.1109/TCYB.2019.2909806
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dynamic multiobjective optimization requires the robust tracking of varying Pareto-optimal solutions (POS) in a changing environment. When a change is detected in the environment, prediction mechanisms estimate the POS by utilizing information from previous populations to accelerate search toward the true POS. To achieve a robust prediction of POS, a mixture-of-experts-based ensemble framework is proposed. Unlike existing approaches, the framework utilizes multiple prediction mechanisms to improve the overall prediction. A gating network is applied to manage switching among the various predictors based on performance of the predictors at different time intervals of the optimization process. The efficacy of the proposed framework is validated through experimental studies based on 13 dynamic multiobjective benchmark optimization problems. The simulation results show that the proposed framework improves the dynamic optimization performance significantly, particularly for: 1) problems with distinct dynamic POS in decision space over time and 2) problems with highly nonlinear decision variable linkages.
引用
收藏
页码:5099 / 5112
页数:14
相关论文
共 50 条
  • [31] A Universal Approximation Theorem for Mixture-of-Experts Models
    Nguyen, Hien D.
    Lloyd-Jones, Luke R.
    McLachlan, Geoffrey J.
    [J]. NEURAL COMPUTATION, 2016, 28 (12) : 2585 - 2593
  • [32] A multipopulation evolutionary framework with Steffensen’s method for dynamic multiobjective optimization problems
    Tianyu Liu
    Lei Cao
    Zhu Wang
    [J]. Memetic Computing, 2021, 13 : 477 - 495
  • [33] A multipopulation evolutionary framework with Steffensen's method for dynamic multiobjective optimization problems
    Liu, Tianyu
    Cao, Lei
    Wang, Zhu
    [J]. MEMETIC COMPUTING, 2021, 13 (04) : 477 - 495
  • [34] Measurement of the probability of insolvency with mixture-of-experts networks
    Baetge, J
    Jerschensky, A
    [J]. CLASSIFICATION IN THE INFORMATION AGE, 1999, : 421 - 429
  • [35] ST-MoE: Spatio-Temporal Mixture-of-Experts for Debiasing in Traffic Prediction
    Li, Shuhao
    Cui, Yue
    Zhao, Yan
    Yang, Weidong
    Zhang, Ruiyuan
    Zhou, Xiaofang
    [J]. PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 1208 - 1217
  • [36] A Correlation-Guided Layered Prediction Approach for Evolutionary Dynamic Multiobjective Optimization
    Yu, Kunjie
    Zhang, Dezheng
    Liang, Jing
    Chen, Ke
    Yue, Caitong
    Qiao, Kangjia
    Wang, Ling
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2023, 27 (05) : 1398 - 1412
  • [37] A similarity-based Bayesian mixture-of-experts model
    Tianfang Zhang
    Rasmus Bokrantz
    Jimmy Olsson
    [J]. Statistics and Computing, 2023, 33
  • [38] Dynamic Mixture of Experts Models for Online Prediction
    Munezero, Parfait
    Villani, Mattias
    Kohn, Robert
    Kohn, Robert
    [J]. TECHNOMETRICS, 2022, : 257 - 268
  • [39] Towards Understanding the Mixture-of-Experts Layer in Deep Learning
    Chen, Zixiang
    Deng, Yihe
    Wu, Yue
    Gu, Quanquan
    Li, Yuanzhi
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [40] Parsimonious mixture-of-experts based on mean mixture of multivariate normal distributions
    Sepahdar, Afsaneh
    Madadi, Mohsen
    Balakrishnan, Narayanaswamy
    Jamalizadeh, Ahad
    [J]. STAT, 2022, 11 (01):