Convolutional Shrinkage Neural Networks Based Model-Agnostic Meta-Learning for Few-Shot Learning

被引:8
|
作者
He, Yunpeng [1 ,2 ,3 ,4 ]
Zang, Chuanzhi [5 ]
Zeng, Peng [1 ,2 ,3 ]
Dong, Qingwei [1 ,2 ,3 ,4 ]
Liu, Ding [1 ,2 ,3 ,4 ]
Liu, Yuqi [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Key Lab Networked Control Syst, Shenyang 110016, Peoples R China
[3] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[4] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[5] Shenyang Univ Technol, Shenyang 110870, Peoples R China
基金
中国国家自然科学基金;
关键词
Meta learning; Few-shot learning; Residual networks; Soft thresholding;
D O I
10.1007/s11063-022-10894-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta Learning (ML) has the ability to quickly learn from a small number of samples, and has become an important research field after reinforcement learning. However, the complexity of sample features severely reduces the performance of few-shot learning, and proper feature selection plays a vital role in the performance of neural networks. To address this problem, this article draws up a new type of convolutional neural network with an attention mechanism, namely, convolutional shrinkage neural networks (CSNNs), using the characteristics of negligible noise to obtain a good optimization parameter model. Moreover, soft thresholding is inserted into the network architectures as nonlinear transformation layers to eliminate nonessential features. In addition, considering that it is difficult to set appropriate values for the thresholds, the developed convolutional shrinkage neural networks integrates some specialized neural networks into trainable modules to automatically set the thresholds. To illustrate the effectiveness of the proposed method, the model-agnostic meta-learning method is considered for testing. The results show that the improved method can significantly improve the accuracy of few-shot images classification and enhance the generalization performance.
引用
收藏
页码:505 / 518
页数:14
相关论文
共 50 条
  • [1] Convolutional Shrinkage Neural Networks Based Model-Agnostic Meta-Learning for Few-Shot Learning
    Yunpeng He
    Chuanzhi Zang
    Peng Zeng
    Qingwei Dong
    Ding Liu
    Yuqi Liu
    [J]. Neural Processing Letters, 2023, 55 : 505 - 518
  • [2] Dynamic Model-Agnostic Meta-Learning for Incremental Few-Shot Learning
    Domoguen, Jansen Keith L.
    Naval, Prospero C., Jr.
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 4927 - 4933
  • [3] Few-shot RUL estimation based on model-agnostic meta-learning
    Mo, Yu
    Li, Liang
    Huang, Biqing
    Li, Xiu
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (05) : 2359 - 2372
  • [4] Few-shot RUL estimation based on model-agnostic meta-learning
    Yu Mo
    Liang Li
    Biqing Huang
    Xiu Li
    [J]. Journal of Intelligent Manufacturing, 2023, 34 : 2359 - 2372
  • [5] Few-Shot Bearing Fault Diagnosis Based on Model-Agnostic Meta-Learning
    Zhang, Shen
    Ye, Fei
    Wang, Bingnan
    Habetler, Thomas G.
    [J]. IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2021, 57 (05) : 4754 - 4764
  • [6] Few-Shot Bearing Anomaly Detection via Model-Agnostic Meta-Learning
    Zhang, Shen
    Ye, Fei
    Wang, Bingnan
    Habetler, Thomas G.
    [J]. 2020 23RD INTERNATIONAL CONFERENCE ON ELECTRICAL MACHINES AND SYSTEMS (ICEMS), 2020, : 1341 - 1346
  • [7] A Few-Shot Malicious Encrypted Traffic Detection Approach Based on Model-Agnostic Meta-Learning
    Wang, Zhiqiang
    Li, Man
    Ou, Haiwen
    Pang, Shufang
    Yue, Ziyan
    [J]. Security and Communication Networks, 2023, 2023
  • [8] Task Agnostic Meta-Learning for Few-Shot Learning
    Jamal, Muhammad Abdullah
    Qi, Guo-Jun
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11711 - 11719
  • [9] Few-Shot Class-Adaptive Anomaly Detection with Model-Agnostic Meta-Learning
    Feng, Tongtong
    Qi, Qi
    Wang, Jingyu
    Liao, Jianxin
    [J]. 2021 IFIP NETWORKING CONFERENCE AND WORKSHOPS (IFIP NETWORKING), 2021,
  • [10] Successive model-agnostic meta-learning for few-shot fault time series prognosis ☆
    Su, Hai
    Hu, Jiajun
    Yu, Songsen
    Liu, Juhua
    Qin, Xiangyang
    [J]. NEUROCOMPUTING, 2024, 595