Exploiting spatial relation for fine-grained image classification

被引:37
|
作者
Qi, Lei [1 ,2 ]
Lu, Xiaoqiang [1 ]
Li, Xuelong [3 ,4 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Ctr OPT Magery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China
[4] Northwestern Polytech Univ, Ctr OPT Magery Anal & Learning OPTIMAL, Xian 710072, Shaanxi, Peoples R China
关键词
Fine-grained image classification; Spatial relation; Convolutional neural network; DEEP CONVOLUTIONAL NETWORKS; REPRESENTATION; RETRIEVAL;
D O I
10.1016/j.patcog.2019.02.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fine-Grained Image Classification (FGIC) aims to distinguish the images within a subordinate category. Recently, many FGIC methods have been proposed and huge progress has been made in the aspects of part detection and feature learning for FGIC. However, FGIC still remains a challenging task due to the large intra-class variance and small inter-class variance. To classify fine-grained images accurately, this paper proposes to exploit spatial relation to capture more discriminative details for FGIC. The proposed method contains two core modules: part selection module and representation module. The part selection module utilizes intrinsic spatial relation between object parts to select object part pairs with high discrimination power. The representation module exploits the interaction between object parts to describe the selected part pairs and construct a semantic image representation for FGIC. The proposed method is evaluated on CUB-200-2011 and FGVC-Aircraft datasets. Experimental results show that the classification accuracy of the proposed method can reach 85.5% on CUB-200-2011 and 86.9% on FGVC-Aircraft respectively, which exceed comparison methods obviously. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:47 / 55
页数:9
相关论文
共 50 条
  • [1] Fine-grained Image Classification via Spatial Saliency Extraction
    Zhang, Juntan
    Sun, Feng-Wen
    Song, Jie
    Von Ancken, Adam
    Zhai, Richard
    [J]. 2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 249 - 255
  • [2] Research on the Fine-grained Plant Image Classification
    Hu, Zhifeng
    Zhang, Yin
    Tan, Liang
    [J]. PROCEEDINGS OF THE 2016 4TH INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND INFORMATION TECHNOLOGY APPLICATIONS, 2016, 71 : 1307 - 1311
  • [3] Image Classification With Tailored Fine-Grained Dictionaries
    Shu, Xiangbo
    Tang, Jinhui
    Qi, Guo-Jun
    Li, Zechao
    Jiang, Yu-Gang
    Yan, Shuicheng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (02) : 454 - 467
  • [4] Fine-Grained Fish Image Classification Based on a Bilinear Network with Spatial Transformation
    Ji Z.
    Zhao K.
    Zhang S.
    Li M.
    [J]. Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2019, 52 (05): : 475 - 482
  • [5] Feature relocation network for fine-grained image classification
    Zhao, Peng
    Li, Yi
    Tang, Baowei
    Liu, Huiting
    Yao, Sheng
    [J]. NEURAL NETWORKS, 2023, 161 : 306 - 317
  • [6] DEEP DICTIONARY LEARNING FOR FINE-GRAINED IMAGE CLASSIFICATION
    Srinivas, M.
    Lin, Yen-Yu
    Liao, Hong-Yuan Mark
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 835 - 839
  • [7] Fine-grained Image Classification Combined with Label Description
    Shi, Xiruo
    Xu, Liutong
    Wang, Pengfei
    [J]. 2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1057 - 1064
  • [8] Learning Cascade Attention for fine-grained image classification
    Zhu, Youxiang
    Li, Ruochen
    Yang, Yin
    Ye, Ning
    [J]. NEURAL NETWORKS, 2020, 122 : 174 - 182
  • [9] Evaluation of Output Embeddings for Fine-Grained Image Classification
    Akata, Zeynep
    Reed, Scott
    Walter, Daniel
    Lee, Honglak
    Schiele, Bernt
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2927 - 2936
  • [10] Separated smooth sampling for fine-grained image classification
    Rong, Shenghai
    Wang, Zilei
    Wang, Jie
    [J]. NEUROCOMPUTING, 2021, 461 : 350 - 359