Multi-task convex combination interpolation for meta-learning with fewer tasks

被引:0
|
作者
Tang, Yi [1 ]
Zhang, Liyi [1 ]
Zhang, Wuxia [2 ]
Jiang, Zuo [1 ]
机构
[1] Yunnan Minzu Univ, Sch Math & Comp Sci, Dept One, Kunming 650500, Yunnan, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Dept Two, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Meta-learning; Task diversity; Convex combination; Few tasks;
D O I
10.1016/j.knosys.2024.111839
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning methods try to enhance the generalization of the meta-learning model by various tasks. Diverse tasks can provide sufficient knowledge to assist the model in understanding and capturing different types of information. The sufficient number of meta-training tasks is a crucial factor in ensuring the generalization of meta-learning algorithms. However, obtaining a sufficient number of labeled meta-training tasks is often a challenging endeavor in real -world scenarios. Some scholars have addressed the issue of inadequate tasks only by interpolating between two tasks, but they do not take into account the problem of task diversity. To resolve this concern, we propose a Multi -task Convex Combination Interpolation (MCCI) method that simultaneously considers both task quantity and task diversity issues. First, we increase the number of tasks based on interpolation techniques, which provides the possibility to extend it from 2 -task interpolation to n -task interpolation. Second, we randomly select multiple tasks and perform convex combination interpolation in the n -task space, in order to increase the task diversity. Third, we prove the positive effect of the convex combination interpolation on the generalization ability and noise resistance of meta-learning algorithms in theory. Finally, we verify the generalization ability and noise resistance of the proposed MCCI on seven datasets. The extensive experimental results show the superior performance of the proposed method compared to the state -of -art methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Meta-Learning for Effective Multi-task and Multilingual Modelling
    Tarunesh, Ishan
    Khyalia, Sushil
    Kumar, Vishwajeet
    Ramakrishnan, Ganesh
    Jyothi, Preethi
    16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 3600 - 3612
  • [2] Multi-Task Reinforcement Meta-Learning in Neural Networks
    Shakah, Ghazi
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (07) : 263 - 269
  • [3] Multi-Task and Meta-Learning with Sparse Linear Bandits
    Cella, Leonardo
    Pontil, Massimiliano
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, VOL 161, 2021, 161 : 1692 - 1702
  • [4] Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learning
    Abdollahzadeh, Milad
    Malekzadeh, Touba
    Cheung, Ngai-Man
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [5] Graph Representation Learning for Multi-Task Settings: a Meta-Learning Approach
    Buffelli, Davide
    Vandin, Fabio
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [6] Homomorphisms Between Transfer, Multi-task, and Meta-learning Systems
    Cody, Tyler
    ARTIFICIAL GENERAL INTELLIGENCE, AGI 2022, 2023, 13539 : 199 - 208
  • [7] Multi-task magnetic resonance imaging reconstruction using meta-learning
    Bian, Wanyu
    Jang, Albert
    Liu, Fang
    MAGNETIC RESONANCE IMAGING, 2025, 116
  • [8] Fast adaptation of multi-task meta-learning for optical performance monitoring
    Zhang, Yu
    Zhou, Peng
    Liu, Yan
    Wang, Jixiang
    Li, Chuanqi
    Lu, Ye
    OPTICS EXPRESS, 2023, 31 (14) : 23183 - 23197
  • [9] Convex multi-task feature learning
    Andreas Argyriou
    Theodoros Evgeniou
    Massimiliano Pontil
    Machine Learning, 2008, 73 : 243 - 272
  • [10] Convex Multi-Task Learning by Clustering
    Barzilai, Aviad
    Crammer, Koby
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 65 - 73