Symmetrical irregular local features for fine-grained visual classification

被引:0
|
作者
Yang, Ming [1 ,2 ]
Xu, Yang [1 ,2 ]
Wu, Zebin [1 ,2 ]
Wei, Zhihui [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Jiangsu Key Lab Spectral Imaging & Intelligent Sen, Nanjing, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Fine-grained image classification; Deep learning; Irregular local features; Discriminative feature; Attention mechanism; Bidirectional long short-term memory; IMAGE; DESCRIPTORS; NETWORK;
D O I
10.1016/j.neucom.2022.07.056
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fine-grained visual classification (FGVC) has small inter-class variations and large intra-class variations, therefore, recognizing sub-classes belonging to the same meta-class is a difficult task. Recent studies have primarily addressed this problem by locating the most discriminative image regions, and the extracted image regions have been used to improve the ability to capture subtle differences. Most of these studies used regular anchors to extract local features. However, the local features of the target are mostly irreg-ular geometric shapes. These methods cannot fully extract the features and inevitably include a large amount of irrelevant information, resulting in reduced credibility of the evaluation results. However, the spatial relationship between the features is easily overlooked. This study proposes a novel local fea-ture extraction anchor generator (LFEAG) to simulate the shapes of irregular features. Thus, discrimina-tive features can be fully included in the extracted features. In addition, an effective symmetrized local feature extraction module (SLFEM) based on an attention mechanism is proposed to fully use the spatial relationship between the extracted local features and highlight discriminative features. Experiments on six popular fine-grained benchmark datasets: CUB-200-2011, Stanford Dogs, Food-101, Oxford-IIIT Pets, Aircraft and NA-Birds, are conducted to demonstrate the advantages of our proposed method. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:304 / 314
页数:11
相关论文
共 50 条
  • [1] Leveraging Fine-Grained Labels to Regularize Fine-Grained Visual Classification
    Wu, Junfeng
    Yao, Li
    Liu, Bin
    Ding, Zheyuan
    [J]. PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON COMPUTER MODELING AND SIMULATION (ICCMS 2019) AND 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND APPLICATIONS (ICICA 2019), 2019, : 133 - 136
  • [2] Image local structure information learning for fine-grained visual classification
    Jin Lu
    Weichuan Zhang
    Yali Zhao
    Changming Sun
    [J]. Scientific Reports, 12
  • [3] Image local structure information learning for fine-grained visual classification
    Lu, Jin
    Zhang, Weichuan
    Zhao, Yali
    Sun, Changming
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [4] An Erudite Fine-Grained Visual Classification Model
    Chang, Dongliang
    Tong, Yujun
    Du, Ruoyi
    Hospedales, Timothy
    Song, Yi-Zhe
    Ma, Zhanyu
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7268 - 7277
  • [5] Pairwise Confusion for Fine-Grained Visual Classification
    Dubey, Abhimanyu
    Gupta, Otkrist
    Guo, Pei
    Raskar, Ramesh
    Farrell, Ryan
    Naik, Nikhil
    [J]. COMPUTER VISION - ECCV 2018, PT XII, 2018, 11216 : 71 - 88
  • [6] Fine-Grained Visual Comparisons with Local Learning
    Yu, Aron
    Grauman, Kristen
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 192 - 199
  • [7] Efficient Image Embedding for Fine-Grained Visual Classification
    Payatsuporn, Soranan
    Kijsirikul, Boonserm
    [J]. 2022-14TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST 2022), 2022, : 40 - 45
  • [8] Exploration of Class Center for Fine-Grained Visual Classification
    Yao, Hang
    Miao, Qiguang
    Zhao, Peipei
    Li, Chaoneng
    Li, Xin
    Feng, Guanwen
    Liu, Ruyi
    [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (10) : 9954 - 9966
  • [9] Adaptive Destruction Learning for Fine-grained Visual Classification
    Zhang, Riheng
    Tan, Min
    Mao, Xiaoyang
    Gao, Zhigang
    Gu, Xiaoling
    [J]. 2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 946 - 950
  • [10] A sparse focus framework for visual fine-grained classification
    Wang, YongXiong
    Li, Guangjun
    Ma, Li
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (16) : 25271 - 25289