Multi-task convex combination interpolation for meta-learning with fewer tasks

被引:0
|
作者
Tang, Yi [1 ]
Zhang, Liyi [1 ]
Zhang, Wuxia [2 ]
Jiang, Zuo [1 ]
机构
[1] Yunnan Minzu Univ, Sch Math & Comp Sci, Dept One, Kunming 650500, Yunnan, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Dept Two, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Meta-learning; Task diversity; Convex combination; Few tasks;
D O I
10.1016/j.knosys.2024.111839
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning methods try to enhance the generalization of the meta-learning model by various tasks. Diverse tasks can provide sufficient knowledge to assist the model in understanding and capturing different types of information. The sufficient number of meta-training tasks is a crucial factor in ensuring the generalization of meta-learning algorithms. However, obtaining a sufficient number of labeled meta-training tasks is often a challenging endeavor in real -world scenarios. Some scholars have addressed the issue of inadequate tasks only by interpolating between two tasks, but they do not take into account the problem of task diversity. To resolve this concern, we propose a Multi -task Convex Combination Interpolation (MCCI) method that simultaneously considers both task quantity and task diversity issues. First, we increase the number of tasks based on interpolation techniques, which provides the possibility to extend it from 2 -task interpolation to n -task interpolation. Second, we randomly select multiple tasks and perform convex combination interpolation in the n -task space, in order to increase the task diversity. Third, we prove the positive effect of the convex combination interpolation on the generalization ability and noise resistance of meta-learning algorithms in theory. Finally, we verify the generalization ability and noise resistance of the proposed MCCI on seven datasets. The extensive experimental results show the superior performance of the proposed method compared to the state -of -art methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Convex Graph Laplacian Multi-Task Learning SVM
    Ruiz, Carlos
    Alaiz, Carlos M.
    Dorronsoro, Jose R.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 142 - 154
  • [22] Multi-task learning regression via convex clustering
    Okazaki, Akira
    Kawano, Shuichi
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2024, 195
  • [23] Multi-Task Learning for Dense Prediction Tasks: A Survey
    Vandenhende, Simon
    Georgoulis, Stamatios
    Van Gansbeke, Wouter
    Proesmans, Marc
    Dai, Dengxin
    Van Gool, Luc
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) : 3614 - 3633
  • [24] Multi-Task Learning for Voice Related Recognition Tasks
    Montalvo, Ana
    Calvo, Jose R.
    Bonastre, Jean-Francois
    INTERSPEECH 2020, 2020, : 2997 - 3001
  • [25] Unveiling Groups of Related Tasks in Multi-Task Learning
    Frecon, Jordan
    Salzo, Saverio
    Pontil, Massimiliano
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7134 - 7141
  • [26] Meta-HFMD: A Hierarchical Feature Fusion Malware Detection Framework via Multi-task Meta-learning
    Liu, Yao
    Bai, Xiaoyu
    Liu, Qiao
    Lan, Tian
    Zhou, Le
    Zhou, Tinghao
    FRONTIERS IN CYBER SECURITY, FCS 2023, 2024, 1992 : 638 - 654
  • [27] Robust Task Grouping with Representative Tasks for Clustered Multi-Task Learning
    Yao, Yaqiang
    Cao, Jie
    Chen, Huanhuan
    KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 1408 - 1417
  • [28] Meta Multi-Task Learning for Sequence Modeling
    Chen, Junkun
    Qiu, Xipeng
    Liu, Pengfei
    Huang, Xuanjing
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5070 - 5077
  • [29] TOOLS AND TASKS FOR LEARNING AND META-LEARNING
    Jaworski, Barbara
    JOURNAL OF MATHEMATICS TEACHER EDUCATION, 2005, 8 (05) : 359 - 361
  • [30] Tools and Tasks for Learning and Meta-learning
    Barbara Jaworski
    Journal of Mathematics Teacher Education, 2005, 8 (5) : 359 - 361