Convolutional Shrinkage Neural Networks Based Model-Agnostic Meta-Learning for Few-Shot Learning

被引:0
|
作者
Yunpeng He
Chuanzhi Zang
Peng Zeng
Qingwei Dong
Ding Liu
Yuqi Liu
机构
[1] Chinese Academy of Sciences,State Key Laboratory of Robotics, Shenyang Institute of Automation
[2] Chinese Academy of Sciences,Key Laboratory of Networked Control Systems
[3] Chinese Academy of Sciences,Institutes for Robotics and Intelligent Manufacturing
[4] University of Chinese Academy of Sciences,undefined
[5] Shenyang University of Technology,undefined
来源
Neural Processing Letters | 2023年 / 55卷
关键词
Meta learning; Few-shot learning; Residual networks; Soft thresholding;
D O I
暂无
中图分类号
学科分类号
摘要
Meta Learning (ML) has the ability to quickly learn from a small number of samples, and has become an important research field after reinforcement learning. However, the complexity of sample features severely reduces the performance of few-shot learning, and proper feature selection plays a vital role in the performance of neural networks. To address this problem, this article draws up a new type of convolutional neural network with an attention mechanism, namely, convolutional shrinkage neural networks (CSNNs), using the characteristics of negligible noise to obtain a good optimization parameter model. Moreover, soft thresholding is inserted into the network architectures as nonlinear transformation layers to eliminate nonessential features. In addition, considering that it is difficult to set appropriate values for the thresholds, the developed convolutional shrinkage neural networks integrates some specialized neural networks into trainable modules to automatically set the thresholds. To illustrate the effectiveness of the proposed method, the model-agnostic meta-learning method is considered for testing. The results show that the improved method can significantly improve the accuracy of few-shot images classification and enhance the generalization performance.
引用
收藏
页码:505 / 518
页数:13
相关论文
共 50 条
  • [1] Convolutional Shrinkage Neural Networks Based Model-Agnostic Meta-Learning for Few-Shot Learning
    He, Yunpeng
    Zang, Chuanzhi
    Zeng, Peng
    Dong, Qingwei
    Liu, Ding
    Liu, Yuqi
    NEURAL PROCESSING LETTERS, 2023, 55 (01) : 505 - 518
  • [2] Dynamic Model-Agnostic Meta-Learning for Incremental Few-Shot Learning
    Domoguen, Jansen Keith L.
    Naval, Prospero C., Jr.
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 4927 - 4933
  • [3] Few-shot RUL estimation based on model-agnostic meta-learning
    Mo, Yu
    Li, Liang
    Huang, Biqing
    Li, Xiu
    JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (05) : 2359 - 2372
  • [4] Few-shot RUL estimation based on model-agnostic meta-learning
    Yu Mo
    Liang Li
    Biqing Huang
    Xiu Li
    Journal of Intelligent Manufacturing, 2023, 34 : 2359 - 2372
  • [5] Few-Shot Bearing Fault Diagnosis Based on Model-Agnostic Meta-Learning
    Zhang, Shen
    Ye, Fei
    Wang, Bingnan
    Habetler, Thomas G.
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2021, 57 (05) : 4754 - 4764
  • [6] Few-Shot Bearing Anomaly Detection via Model-Agnostic Meta-Learning
    Zhang, Shen
    Ye, Fei
    Wang, Bingnan
    Habetler, Thomas G.
    2020 23RD INTERNATIONAL CONFERENCE ON ELECTRICAL MACHINES AND SYSTEMS (ICEMS), 2020, : 1341 - 1346
  • [7] A Few-Shot Malicious Encrypted Traffic Detection Approach Based on Model-Agnostic Meta-Learning
    Wang Z.
    Li M.
    Ou H.
    Pang S.
    Yue Z.
    Security and Communication Networks, 2023, 2023
  • [8] Task Agnostic Meta-Learning for Few-Shot Learning
    Jamal, Muhammad Abdullah
    Qi, Guo-Jun
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11711 - 11719
  • [9] Few-Shot Class-Adaptive Anomaly Detection with Model-Agnostic Meta-Learning
    Feng, Tongtong
    Qi, Qi
    Wang, Jingyu
    Liao, Jianxin
    2021 IFIP NETWORKING CONFERENCE AND WORKSHOPS (IFIP NETWORKING), 2021,
  • [10] Successive model-agnostic meta-learning for few-shot fault time series prognosis ☆
    Su, Hai
    Hu, Jiajun
    Yu, Songsen
    Liu, Juhua
    Qin, Xiangyang
    NEUROCOMPUTING, 2024, 595