Convolutional Shrinkage Neural Networks Based Model-Agnostic Meta-Learning for Few-Shot Learning

被引:0
|
作者
Yunpeng He
Chuanzhi Zang
Peng Zeng
Qingwei Dong
Ding Liu
Yuqi Liu
机构
[1] Chinese Academy of Sciences,State Key Laboratory of Robotics, Shenyang Institute of Automation
[2] Chinese Academy of Sciences,Key Laboratory of Networked Control Systems
[3] Chinese Academy of Sciences,Institutes for Robotics and Intelligent Manufacturing
[4] University of Chinese Academy of Sciences,undefined
[5] Shenyang University of Technology,undefined
来源
Neural Processing Letters | 2023年 / 55卷
关键词
Meta learning; Few-shot learning; Residual networks; Soft thresholding;
D O I
暂无
中图分类号
学科分类号
摘要
Meta Learning (ML) has the ability to quickly learn from a small number of samples, and has become an important research field after reinforcement learning. However, the complexity of sample features severely reduces the performance of few-shot learning, and proper feature selection plays a vital role in the performance of neural networks. To address this problem, this article draws up a new type of convolutional neural network with an attention mechanism, namely, convolutional shrinkage neural networks (CSNNs), using the characteristics of negligible noise to obtain a good optimization parameter model. Moreover, soft thresholding is inserted into the network architectures as nonlinear transformation layers to eliminate nonessential features. In addition, considering that it is difficult to set appropriate values for the thresholds, the developed convolutional shrinkage neural networks integrates some specialized neural networks into trainable modules to automatically set the thresholds. To illustrate the effectiveness of the proposed method, the model-agnostic meta-learning method is considered for testing. The results show that the improved method can significantly improve the accuracy of few-shot images classification and enhance the generalization performance.
引用
收藏
页码:505 / 518
页数:13
相关论文
共 50 条
  • [41] Few-shot Node Classification on Attributed Networks with Graph Meta-learning
    Liu, Yonghao
    Li, Mengyu
    Li, Ximing
    Giunchiglia, Fausto
    Feng, Xiaoyue
    Guan, Renchu
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 471 - 481
  • [42] Prior-knowledge and attention based meta-learning for few-shot learning
    Qin, Yunxiao
    Zhang, Weiguo
    Zhao, Chenxu
    Wang, Zezheng
    Zhu, Xiangyu
    Shi, Jingping
    Qi, Guojun
    Lei, Zhen
    KNOWLEDGE-BASED SYSTEMS, 2021, 213
  • [43] PEER-TO-PEER MODEL-AGNOSTIC META-LEARNING
    Qureshi, Muhammad I.
    Khan, Usman A.
    2024 IEEE 13RD SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP, SAM 2024, 2024,
  • [44] Task-Robust Model-Agnostic Meta-Learning
    Collins, Liam
    Mokhtari, Aryan
    Shakkottai, Sanjay
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [45] Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning
    Raymond, Christian
    Chen, Qi
    Xue, Bing
    Zhang, Mengjie
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13699 - 13714
  • [46] Crop Disease Recognition Based on Improved Model-Agnostic Meta-Learning
    Si, Xiuli
    Hong, Biao
    Hu, Yuanhui
    Chu, Lidong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 6101 - 6118
  • [47] Few-shot driver identification via meta-learning
    Lu, Lin
    Xiong, Shengwu
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
  • [48] Few-Shot Directed Meta-Learning for Image Classification
    Ouyang, Jihong
    Duan, Ganghai
    Liu, Siguang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (01)
  • [49] Meta-learning for few-shot time series forecasting
    Xiao, Feng
    Liu, Lu
    Han, Jiayu
    Guo, Degui
    Wang, Shang
    Cui, Hai
    Peng, Tao
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (01) : 325 - 341
  • [50] Few-shot driver identification via meta-learning
    Lu, Lin
    Xiong, Shengwu
    Expert Systems with Applications, 2022, 203