GiT: Graph Interactive Transformer for Vehicle Re-Identification

被引:58
|
作者
Shen, Fei [1 ,2 ]
Xie, Yi [1 ]
Zhu, Jianqing [1 ]
Zhu, Xiaobin [3 ]
Zeng, Huanqiang [1 ]
机构
[1] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Convolutional neural networks; Representation learning; Correlation; Annotations; Transforms; Graph network; transformer layer; interactive; vehicle re-identification;
D O I
10.1109/TIP.2023.3238642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transformers are more and more popular in computer vision, which treat an image as a sequence of patches and learn robust global features from the sequence. However, pure transformers are not entirely suitable for vehicle re-identification because vehicle re-identification requires both robust global features and discriminative local features. For that, a graph interactive transformer (GiT) is proposed in this paper. In the macro view, a list of GiT blocks are stacked to build a vehicle re-identification model, in where graphs are to extract discriminative local features within patches and transformers are to extract robust global features among patches. In the micro view, graphs and transformers are in an interactive status, bringing effective cooperation between local and global features. Specifically, one current graph is embedded after the former level's graph and transformer, while the current transform is embedded after the current graph and the former level's transformer. In addition to the interaction between graphs and transforms, the graph is a newly-designed local correction graph, which learns discriminative local features within a patch by exploring nodes' relationships. Extensive experiments on three large-scale vehicle re-identification datasets demonstrate that our GiT method is superior to state-of-the-art vehicle re-identification approaches.
引用
收藏
页码:1039 / 1051
页数:13
相关论文
共 50 条
  • [41] MSFFT: Multi-Scale Feature Fusion Transformer for cross platform vehicle re-identification
    Holla, B. Ashutosh
    Pai, M. M. Manohara
    Verma, Ujjwal
    Pai, Radhika M.
    NEUROCOMPUTING, 2024, 582
  • [42] A New Symmetry-Based Transformer for Text Spotting in Person and Vehicle Re-Identification Images
    Choudhury, Aritro Pal
    Palaiahnakote, Shivakumara
    Pal, Umapada
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (15)
  • [43] Stripe-Assisted Global Transformer and Spatial-Temporal Enhancement for Vehicle Re-Identification
    An, Yasong
    Zhang, Xiaofei
    Shi, Bodong
    Tan, Xiaojun
    APPLIED SCIENCES-BASEL, 2024, 14 (10):
  • [44] Semantic-Oriented Feature Coupling Transformer for Vehicle Re-Identification in Intelligent Transportation System
    Yu, Zhi
    Huang, Zhiyong
    Pei, Jiaming
    Tahsin, Lamia
    Sun, Daming
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (03) : 2803 - 2813
  • [45] H-ViT: Hybrid Vision Transformer for Multi-modal Vehicle Re-identification
    Pan, Wenjie
    Wu, Hanxiao
    Zhu, Jianqing
    Zeng, Huanqiang
    Zhu, Xiaobin
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT I, 2022, 13604 : 255 - 267
  • [46] GRAPH CONVOLUTION FOR RE-RANKING IN PERSON RE-IDENTIFICATION
    Zhang, Yuqi
    Qian, Qi
    Liu, Chong
    Chen, Weihua
    Wang, Fan
    Li, Hao
    Jin, Rong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2704 - 2708
  • [47] Dual Embedding Expansion for Vehicle Re-identification
    Sebastian, Clint
    Imbriaco, Raffaele
    Bondarev, Egor
    de With, Peter H. N.
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2475 - 2484
  • [48] Advances in vehicle re-identification techniques: A survey
    Yi, Xiaoying
    Wang, Qi
    Liu, Qi
    Rui, Yikang
    Ran, Bin
    NEUROCOMPUTING, 2025, 614
  • [49] Deep Domain Adaptation on Vehicle Re-identification
    Wang, Yifeng
    Zeng, Dan
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 416 - 420
  • [50] Part alignment network for vehicle re-identification
    Chen, Yucheng
    Ma, Bingpeng
    Chang, Hong
    NEUROCOMPUTING, 2020, 418 : 114 - 125