Low-Sample Image Classification Based on Intrinsic Consistency Loss and Uncertainty Weighting Method

被引:0
|
作者
Li, Zhiguo [1 ]
Li, Lingbo [2 ]
Xiao, Xi [3 ]
Chen, Jinpeng [4 ]
Zhang, Nawei [5 ]
Li, Sai [6 ]
机构
[1] Neijiang Normal Univ, Informat Construct & Serv Ctr, Neijiang, Peoples R China
[2] Zhejiang Tech Inst Econ, Lib Informat Ctr, Hangzhou, Peoples R China
[3] Southwest Petr Univ, Sch Comp Sci, Chengdu, Peoples R China
[4] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA USA
[5] China Univ Petr, Coll Informat Sci & Engn, Beijing, Peoples R China
[6] Zaozhuang Univ, Coll Mech & Elect Engn, Zaozhuang, Peoples R China
关键词
Low-sample image classification; deep convolutional neural network; sample intrinsic consistency loss; uncertainty weighting method; image generation model;
D O I
10.1109/ACCESS.2023.3276875
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As is well known, the classification performance of large deep neural networks is closely related to the amount of annotated data. However, in practical applications, the quantity of annotated data is minimal for many computer vision tasks, which poses a considerable challenge for deep convolutional neural networks that aim to achieve ideal classification performance. This paper proposes a new, fully supervised low-sample image classification model to alleviate the problem of limited marked sample quantity in real life. Specifically, this paper presents a new sample intrinsic consistency loss, which can more effectively update model parameters from a "fundamental"perspective by exploring the difference between intrinsic sample features and semantic information contained in sample labels. Secondly, a new uncertainty weighting method is proposed to weigh the original supervised loss. It can more effectively learn sample features by weighting sample losses one by one based on their classification status and help the model autonomously understand the importance of different local information. Finally, a sample generation model generates some artificial samples to supplement the limited quantity of actual training samples. The model adjusts parameters through the combined effect of sample intrinsic consistency loss and weighted supervised loss. This paper uses 25 % of the SVHN dataset and 30 % of the CIFAR-10 dataset as training samples to simulate scenarios with limited sample quantities in real life, achieving accuracies of 94.59 % and 91.27 % respectively, demonstrating the effectiveness of our method on small real datasets.
引用
收藏
页码:49059 / 49070
页数:12
相关论文
共 50 条
  • [21] Experimental Analysis of Feature Selection Stability for High-Dimension and Low-Sample Size Gene Expression Classification Task
    Dernoncourt, David
    Hanczar, Blaise
    Zucker, Jean-Daniel
    IEEE 12TH INTERNATIONAL CONFERENCE ON BIOINFORMATICS & BIOENGINEERING, 2012, : 350 - 355
  • [22] Semantic image classification of a Relief-F feature weighting based SVM method for performance
    Liu, Jie
    Du, Jun-Ping
    Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology), 2011, 42 (SUPPL. 1): : 750 - 754
  • [23] Low-sample performance of reduced-rank power minimization based jammer suppression for GPS
    Myrick, WL
    Zoltowski, MD
    Goldstein, JS
    2000 IEEE SIXTH INTERNATIONAL SYMPOSIUM ON SPREAD SPECTRUM TECHNIQUES AND APPLICATIONS, PROCEEDINGS, VOL 1 AND 2: COMMUNICATIONS FOR A NEW MILLENNIUM, 2000, : 93 - 97
  • [24] Dynamic Attention Loss for Small-Sample Image Classification
    Cao, Jie
    Qiu, Yinping
    Chang, Dongliang
    Li, Xiaoxu
    Ma, Zhanyu
    2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 75 - 79
  • [25] Deep Ensemble CNN Method Based on Sample Expansion for Hyperspectral Image Classification
    Dong, Shuxian
    Feng, Wei
    Quan, Yinghui
    Dauphin, Gabriel
    Gao, Lianru
    Xing, Mengdao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [26] Small sample hyperspectral image classification method based on memory association learning
    Wang C.
    Zhagn J.
    Zhang L.
    Wei W.
    Zhang Y.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (03): : 549 - 557
  • [27] Joint Graph Based Embedding and Feature Weighting for Image Classification
    Zhu, Ruifeng
    Dornaika, Fadi
    Ruichek, Yassine
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [28] Learning a frequency-based weighting for medical image classification
    Gass, Tobias
    Depeursinge, Adrien
    Geissbuhler, Antoine
    Mueller, Henning
    MEDICAL IMAGING AND INFORMATICS, 2008, 4987 : 99 - +
  • [29] Joint graph based embedding and feature weighting for image classification
    Zhu, Ruifeng
    Dornaika, Fadi
    Ruichek, Yassine
    PATTERN RECOGNITION, 2019, 93 : 458 - 469
  • [30] Tensor Based Simultaneous Feature Extraction and Sample Weighting for EEG Classification
    Washizawa, Yoshikazu
    Higashi, Hiroshi
    Rutkowski, Tomasz
    Tanaka, Toshihisa
    Cichocki, Andrzej
    NEURAL INFORMATION PROCESSING: MODELS AND APPLICATIONS, PT II, 2010, 6444 : 26 - 33