Exploiting spatial relation for fine-grained image classification

被引:37
|
作者
Qi, Lei [1 ,2 ]
Lu, Xiaoqiang [1 ]
Li, Xuelong [3 ,4 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Ctr OPT Magery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China
[4] Northwestern Polytech Univ, Ctr OPT Magery Anal & Learning OPTIMAL, Xian 710072, Shaanxi, Peoples R China
关键词
Fine-grained image classification; Spatial relation; Convolutional neural network; DEEP CONVOLUTIONAL NETWORKS; REPRESENTATION; RETRIEVAL;
D O I
10.1016/j.patcog.2019.02.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fine-Grained Image Classification (FGIC) aims to distinguish the images within a subordinate category. Recently, many FGIC methods have been proposed and huge progress has been made in the aspects of part detection and feature learning for FGIC. However, FGIC still remains a challenging task due to the large intra-class variance and small inter-class variance. To classify fine-grained images accurately, this paper proposes to exploit spatial relation to capture more discriminative details for FGIC. The proposed method contains two core modules: part selection module and representation module. The part selection module utilizes intrinsic spatial relation between object parts to select object part pairs with high discrimination power. The representation module exploits the interaction between object parts to describe the selected part pairs and construct a semantic image representation for FGIC. The proposed method is evaluated on CUB-200-2011 and FGVC-Aircraft datasets. Experimental results show that the classification accuracy of the proposed method can reach 85.5% on CUB-200-2011 and 86.9% on FGVC-Aircraft respectively, which exceed comparison methods obviously. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:47 / 55
页数:9
相关论文
共 50 条
  • [21] Pre-Processing for Fine-Grained Image Classification
    Ge, Hao
    Yang, Feng
    Tu, Xiaoguang
    Xie, Mei
    Ma, Zheng
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2017, E100D (08): : 1938 - 1942
  • [22] Exploring Misclassification Information for Fine-Grained Image Classification
    Wang, Da-Han
    Zhou, Wei
    Li, Jianmin
    Wu, Yun
    Zhu, Shunzhi
    [J]. SENSORS, 2021, 21 (12)
  • [23] Robust fine-grained image classification with noisy labels
    Xinxing Tan
    Zemin Dong
    Hualing Zhao
    [J]. The Visual Computer, 2023, 39 : 5637 - 5650
  • [24] A Fine-Grained Image Classification Method Built on MobileViT
    Lu, Zhengqiu
    Wang, Haiying
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (06)
  • [25] Improving Fine-Grained Image Classification With Multimodal Information
    Xu, Jie
    Zhang, Xiaoqian
    Zhao, Changming
    Geng, Zili
    Feng, Yuren
    Miao, Ke
    Li, Yunji
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2082 - 2095
  • [26] EXPLOITING FINE-GRAINED SPATIAL OPTIMIZATION FOR HYBRID FILE SYSTEM SPACE
    No, Jaechun
    Park, Sung-Soon
    Lim, Cheol-Su
    [J]. COMPUTING AND INFORMATICS, 2017, 36 (01) : 140 - 168
  • [27] Leveraging Fine-Grained Labels to Regularize Fine-Grained Visual Classification
    Wu, Junfeng
    Yao, Li
    Liu, Bin
    Ding, Zheyuan
    [J]. PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON COMPUTER MODELING AND SIMULATION (ICCMS 2019) AND 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND APPLICATIONS (ICICA 2019), 2019, : 133 - 136
  • [28] Hierarchical Spatial Pyramid Pooling for Fine-Grained Vehicle Classification
    Rachmadi, Reza Fuad
    Uchimura, Keiichi
    Koutaki, Gou
    Ogata, Kohichi
    [J]. 2018 INTERNATIONAL WORKSHOP ON BIG DATA AND INFORMATION SECURITY (IWBIS), 2018, : 19 - 24
  • [29] Weakly Supervised Learning of Part Selection Model with Spatial Constraints for Fine-Grained Image Classification
    He, Xiangteng
    Peng, Yuxin
    [J]. THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 4075 - 4081
  • [30] Recursive Multi-Scale Channel-Spatial Attention for Fine-Grained Image Classification
    Liu, Dichao
    Wang, Yu
    Mase, Kenji
    Kato, Jien
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (03) : 713 - 726