An ensemble knowledge transfer framework for evolutionary multi-task optimization

被引:2
|
作者
Zhou, Jiajun [1 ]
Rao, Shijie [1 ]
Gao, Liang [2 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Evolutionary computation; Multi-task transfer optimization; Domain adaptation; Adaptive knowledge transfer; Ensemble learning; COMPUTATION; ALGORITHM;
D O I
10.1016/j.swevo.2023.101394
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The cognitive capability of learning from past experiences to resolve relevant tasks at hand is a hallmark of humans. The emerging evolutionary multi-task transfer optimization (EMTO) fashion pursues such intelligent behavior by exploring useful knowledge drawn from solving one task to accelerate the optimization process of other related tasks. However, in practical scenario, knowledge drawn from various task domains may not always benefit the solving process of one another, and source-target domain mismatch is likely to induce notorious negative transfer, which is a critical concern in EMTO. Domain adaption aims to narrow the gap between distinct domains so as to curb negative transfer. Generally, different strategies possess distinct advantages in different situations, no one can dominate others in all cases. Taking this cue, we present a novel bandit-mechanism-based ensemble method to determine the proper domain adaption strategy online in the context of EMTO. Besides, the intensity of cross-task knowledge transfer is adapted according to historical experiences of the population. We carry out extensive experiments to examine the performance of proposed approach, demonstrating its superiority in comparison to state-of-the-art peers in multi-task problem-solving scenario. Our work thus sheds light on a new alternative way for automatic domain adaption for knowledge transfer across problems.
引用
下载
收藏
页数:16
相关论文
共 50 条
  • [31] Ensemble Compressed Language Model Based on Knowledge Distillation and Multi-Task Learning
    Xiang, Kun
    Fujii, Akihiro
    2022 7TH INTERNATIONAL CONFERENCE ON BUSINESS AND INDUSTRIAL RESEARCH (ICBIR2022), 2022, : 72 - 77
  • [32] Multi-task Transfer with Practice
    Pattnaik, Upasana
    Lee, Minwoo
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [33] Deep Multi-Task Multi-Agent Reinforcement Learning With Knowledge Transfer
    Mai Y.
    Zang Y.
    Yin Q.
    Ni W.
    Huang K.
    IEEE Transactions on Games, 2024, 16 (03) : 1 - 11
  • [34] Multi-Task Ensemble Learning for Affect Recognition
    Gjoreski, Martin
    Lustrek, Mitja
    Gams, Matjaz
    PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT), 2018, : 553 - 558
  • [35] A Learner-Independent Knowledge Transfer Approach to Multi-task Learning
    Pang, Shaoning
    Liu, Fan
    Kadobayashi, Youki
    Ban, Tao
    Inoue, Daisuke
    COGNITIVE COMPUTATION, 2014, 6 (03) : 304 - 320
  • [36] A Learner-Independent Knowledge Transfer Approach to Multi-task Learning
    Shaoning Pang
    Fan Liu
    Youki Kadobayashi
    Tao Ban
    Daisuke Inoue
    Cognitive Computation, 2014, 6 : 304 - 320
  • [37] Knowledge Transfer in Multi-Task Deep Reinforcement Learning for Continuous Control
    Xu, Zhiyuan
    Wu, Kun
    Che, Zhengping
    Tang, Jian
    Ye, Jieping
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [38] MULTI-TASK DISTILLATION: TOWARDS MITIGATING THE NEGATIVE TRANSFER IN MULTI-TASK LEARNING
    Meng, Ze
    Yao, Xin
    Sun, Lifeng
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 389 - 393
  • [39] Large-Scale Evolutionary Optimization via Multi-Task Random Grouping
    Williams, Phoenix Neale
    Li, Ke
    Min, Geyong
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 778 - 783
  • [40] Multi-task framework of precipitation nowcasting
    Zhang, Zheng
    Luo, Chuyao
    Zhang, Baoquan
    Jiang, Hao
    Zhang, Bowen
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023, 8 (04) : 1350 - 1363