TBE-Net: A Three-Branch Embedding Network With Part-Aware Ability and Feature Complementary Learning for Vehicle Re-Identification

被引:101
|
作者
Sun, Wei [1 ,2 ]
Dai, Guangzhao [1 ]
Zhang, Xiaorui [3 ,4 ,5 ]
He, Xiaozheng [6 ]
Chen, Xuan [7 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Minist Educ, Sch Comp & Software, Nanjing 210044, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Minist Educ, Engn Res Ctr Digital Forens, Nanjing 210044, Peoples R China
[5] Nanjing Univ Informat Sci & Technol, Wuxi Res Inst, Wuxi 214100, Jiangsu, Peoples R China
[6] Rensselaer Polytech Inst, Dept Civil & Environm Engn, Troy, NY 12180 USA
[7] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Cameras; Image color analysis; Information science; Sun; Training; Technological innovation; Vehicle re-identification; attention mechanism; multi-granularity features learning; embedding;
D O I
10.1109/TITS.2021.3130403
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Vehicle re-identification (Re-ID) is one of the promising applications in the field of computer vision. Existing vehicle Re-ID methods mainly focus on global appearance features or pre-defined local region features, which have difficulties in handling inter-class similarities and intra-class differences among vehicles in various traffic scenarios. This paper proposes a novel end-to-end three-branch embedding network (TBE-Net) with feature complementary learning and part-aware ability. The proposed TBE-Net integrates complementary features, global appearance, and local region features into a unified framework for subtle feature learning, thereby obtaining more integral and diverse vehicle features to re-identify the vehicle from similar ones. The local region feature branch in the proposed TBE-Net contains an attention module that highlights the major differences among local regions by adaptively assigning large weights to the critical local regions and small weights to insignificant local regions, thereby enhancing the perception sensitivity of the network to subtle discrepancies. The complementary branch in the proposed TBE-Net exploits different pooling operations to obtain more comprehensive structural features and multi-granularity features as a supplement to the global appearance and local region features. The abundant features help accommodate the ever-changing critical local regions in vehicles' images due to the sensors' settings, such as the position and shooting angle of surveillance cameras. The extensive experiments on VehicleID and VeRi-776 datasets show that the proposed TBE-Net outperforms the state-of-the-art methods.
引用
收藏
页码:14557 / 14569
页数:13
相关论文
共 22 条
  • [1] Discriminative feature and dictionary learning with part-aware model for vehicle re-identification
    Wang, Huibing
    Peng, Jinjia
    Jiang, Guangqi
    Xu, Fengqiang
    Fu, Xianping
    NEUROCOMPUTING, 2021, 438 : 55 - 62
  • [2] Batch Coherence-Driven Network for Part-Aware Person Re-Identification
    Wang, Kan
    Wang, Pengfei
    Ding, Changxing
    Tao, Dacheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3405 - 3418
  • [3] Disentangled Feature Learning Network for Vehicle Re-Identification
    Bai, Yan
    Lou, Yihang
    Dai, Yongxing
    Liu, Jun
    Chen, Ziqian
    Duan, Ling-Yu
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 474 - 480
  • [4] Multi-Task Learning With Coarse Priors for Robust Part-Aware Person Re-Identification
    Ding, Changxing
    Wang, Kan
    Wang, Pengfei
    Tao, Dacheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) : 1474 - 1488
  • [5] Learning Coarse-to-Fine Structured Feature Embedding for Vehicle Re-Identification
    Guo, Haiyun
    Zhao, Chaoyang
    Liu, Zhiwei
    Wang, Jinqiao
    Lu, Hanqing
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 6853 - 6860
  • [6] Parsing-based View-aware Embedding Network for Vehicle Re-Identification
    Meng, Dechao
    Li, Liang
    Liu, Xuejing
    Li, Yadong
    Yang, Shijie
    Zha, Zheng-Jun
    Gao, Xingyu
    Wang, Shuhui
    Huang, Qingming
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7101 - 7110
  • [7] Part-Relation-Aware Feature Fusion Network for Person Re-Identification
    Hou, Yanke
    Lian, Sicheng
    Hu, Haifeng
    Chen, Dihu
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 743 - 747
  • [8] Disentangled Feature Learning Network and a Comprehensive Benchmark for Vehicle Re-Identification
    Bai, Yan
    Liu, Jun
    Lou, Yihang
    Wang, Ce
    Duan, Ling-yu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6854 - 6871
  • [9] Vehicle Re-identification with a Pose-Aware Discriminative Part Learning Model
    Sun, Ya
    Lu, Jianfeng
    Li, Minxian
    Ren, Gang
    Ma, Jingfeng
    PATTERN RECOGNITION AND COMPUTER VISION, PT XIII, PRCV 2024, 2025, 15043 : 251 - 265
  • [10] PFNet: Part-guided feature-combination network for vehicle re-identification
    Qian, Jiahe
    Zhao, Jiandong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (32) : 78641 - 78658