Convolutional Shrinkage Neural Networks Based Model-Agnostic Meta-Learning for Few-Shot Learning

被引:9
|
作者
He, Yunpeng [1 ,2 ,3 ,4 ]
Zang, Chuanzhi [5 ]
Zeng, Peng [1 ,2 ,3 ]
Dong, Qingwei [1 ,2 ,3 ,4 ]
Liu, Ding [1 ,2 ,3 ,4 ]
Liu, Yuqi [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Key Lab Networked Control Syst, Shenyang 110016, Peoples R China
[3] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[4] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[5] Shenyang Univ Technol, Shenyang 110870, Peoples R China
基金
中国国家自然科学基金;
关键词
Meta learning; Few-shot learning; Residual networks; Soft thresholding;
D O I
10.1007/s11063-022-10894-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta Learning (ML) has the ability to quickly learn from a small number of samples, and has become an important research field after reinforcement learning. However, the complexity of sample features severely reduces the performance of few-shot learning, and proper feature selection plays a vital role in the performance of neural networks. To address this problem, this article draws up a new type of convolutional neural network with an attention mechanism, namely, convolutional shrinkage neural networks (CSNNs), using the characteristics of negligible noise to obtain a good optimization parameter model. Moreover, soft thresholding is inserted into the network architectures as nonlinear transformation layers to eliminate nonessential features. In addition, considering that it is difficult to set appropriate values for the thresholds, the developed convolutional shrinkage neural networks integrates some specialized neural networks into trainable modules to automatically set the thresholds. To illustrate the effectiveness of the proposed method, the model-agnostic meta-learning method is considered for testing. The results show that the improved method can significantly improve the accuracy of few-shot images classification and enhance the generalization performance.
引用
收藏
页码:505 / 518
页数:14
相关论文
共 50 条
  • [21] Few-Shot Learning for Medical Image Segmentation Using 3D U-Net and Model-Agnostic Meta-Learning (MAML)
    Alsaleh, Aqilah M.
    Albalawi, Eid
    Algosaibi, Abdulelah
    Albakheet, Salman S.
    Khan, Surbhi Bhatia
    DIAGNOSTICS, 2024, 14 (12)
  • [22] Meta weight learning via model-agnostic meta-learning
    Xu, Zhixiong
    Chen, Xiliang
    Tang, Wei
    Lai, Jun
    Cao, Lei
    NEUROCOMPUTING, 2021, 432 : 124 - 132
  • [23] Mi-maml: classifying few-shot advanced malware using multi-improved model-agnostic meta-learning
    Ji, Yulong
    Zou, Kunjin
    Zou, Bin
    CYBERSECURITY, 2024, 7 (01):
  • [24] Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
    Finn, Chelsea
    Abbeel, Pieter
    Levine, Sergey
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [25] META-LEARNING WITH ATTENTION FOR IMPROVED FEW-SHOT LEARNING
    Hou, Zejiang
    Walid, Anwar
    Kung, Sun-Yuan
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2725 - 2729
  • [26] Knowledge Distillation for Model-Agnostic Meta-Learning
    Zhang, Min
    Wang, Donglin
    Gai, Sibo
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1355 - 1362
  • [27] Few-Shot Model Agnostic Federated Learning
    Huang, Wenke
    Ye, Mang
    Du, Bo
    Gao, Xiang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7309 - 7316
  • [28] Few-Shot Deep Model of Waste classification Based on Model Agnostic Meta Learning
    Feng, Bo
    Ren, Kun
    Tao, Qingyang
    Han, Honggui
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VIII, 2021, 11897
  • [29] Unsupervised descriptor selection based meta-learning networks for few-shot classification
    Hu, Zhengping
    Li, Zijun
    Wang, Xueyu
    Zheng, Saiyue
    PATTERN RECOGNITION, 2022, 122
  • [30] Meta-Learning for Few-Shot NMT Adaptation
    Sharaf, Amr
    Hassan, Hany
    Daume, Hal, III
    NEURAL GENERATION AND TRANSLATION, 2020, : 43 - 53