Deep LSAC for Fine-Grained Recognition

被引:7
|
作者
Lin, Di [1 ]
Wang, Yi [2 ]
Liang, Lingyu [3 ]
Li, Ping [4 ]
Chen, C. L. Philip [5 ,6 ,7 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Shenzhen 518060, Peoples R China
[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510641, Guangdong, Peoples R China
[4] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[5] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[6] Dalian Maritime Univ, Nav Coll, Dalian 116026, Peoples R China
[7] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
关键词
Shape; Training; Image segmentation; Task analysis; Neural networks; Adaptation models; Semantics; Convolutional neural network (CNN); fine-grained recognition; object detection; pose alignment; semantic segmentation; SEGMENTATION;
D O I
10.1109/TNNLS.2020.3027603
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fine-grained recognition emphasizes the identification of subtle differences among object categories given objects that appear in different shapes and poses. These variances should be reduced for reliable recognition. We propose a fine-grained recognition system that incorporates localization, segmentation, alignment, and classification in a unified deep neural network. The input to the classification module includes functions that enable backward-propagation (BP) in constructing the solver. Our major contribution is to propose a valve linkage function (VLF) for BP chaining and form our deep localization, segmentation, alignment, and classification (LSAC) system. The VLF can adaptively compromise errors of classification and alignment when training the LSAC model. It in turn helps to update the localization and segmentation. We evaluate our framework on two widely used fine-grained object data sets. The performance confirms the effectiveness of our LSAC system.
引用
收藏
页码:200 / 214
页数:15
相关论文
共 50 条
  • [1] Fine-Grained Crowdsourcing for Fine-Grained Recognition
    Jia Deng
    Krause, Jonathan
    Li Fei-Fei
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 580 - 587
  • [2] Deep LAC: Deep Localization, Alignment and Classification for Fine-grained Recognition
    Lin, Di
    Shen, Xiaoyong
    Lu, Cewu
    Jia, Jiaya
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 1666 - 1674
  • [3] Deep convolutional feature aggregation for fine-grained cultivar recognition
    Wu, Hao
    Fang, Lincong
    Yu, Qian
    Yang, Chengzhuan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 275
  • [4] Fine-grained Vehicle Recognition by Deep Convolutional Neural Network
    Huang, Kun
    Zhang, Bailing
    [J]. 2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 465 - 470
  • [5] Fine-grained Early Frequency Attention for Deep Speaker Recognition
    Hajavi, Amirhossein
    Etemad, Ali
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [6] Picking Deep Filter Responses for Fine-grained Image Recognition
    Zhang, Xiaopeng
    Xiong, Hongkai
    Zhou, Wengang
    Lin, Weiyao
    Tian, Qi
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1134 - 1142
  • [7] Fine-grained Cars Recognition using Deep Convolutional Neural Networks
    Oliveira, Franklin
    Macena, Arianne
    Kamel, Otavio
    Souza, Wesley
    Freitas, Nicksson
    Vinuto, Tiago
    [J]. 2022 35TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2022), 2022, : 240 - 245
  • [8] DEEP MULTI-CONTEXT NETWORK FOR FINE-GRAINED VISUAL RECOGNITION
    Ou, Xinyu
    Wei, Zhen
    Ling, Hefei
    Liu, Si
    Cao, Xiaochun
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2016,
  • [9] Hierarchical Deep Click Feature Prediction for Fine-Grained Image Recognition
    Yu, Jun
    Tan, Min
    Zhang, Hongyuan
    Tao, Dacheng
    Rui, Yong
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) : 563 - 578
  • [10] Human Action Recognition Using Deep Data: A Fine-Grained Study
    Rao, D. Surendra
    Potturu, Sudharsana Rao
    Bhagyaraju, V
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2022, 22 (06): : 97 - 108