GiT: Graph Interactive Transformer for Vehicle Re-Identification

被引:58
|
作者
Shen, Fei [1 ,2 ]
Xie, Yi [1 ]
Zhu, Jianqing [1 ]
Zhu, Xiaobin [3 ]
Zeng, Huanqiang [1 ]
机构
[1] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Convolutional neural networks; Representation learning; Correlation; Annotations; Transforms; Graph network; transformer layer; interactive; vehicle re-identification;
D O I
10.1109/TIP.2023.3238642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transformers are more and more popular in computer vision, which treat an image as a sequence of patches and learn robust global features from the sequence. However, pure transformers are not entirely suitable for vehicle re-identification because vehicle re-identification requires both robust global features and discriminative local features. For that, a graph interactive transformer (GiT) is proposed in this paper. In the macro view, a list of GiT blocks are stacked to build a vehicle re-identification model, in where graphs are to extract discriminative local features within patches and transformers are to extract robust global features among patches. In the micro view, graphs and transformers are in an interactive status, bringing effective cooperation between local and global features. Specifically, one current graph is embedded after the former level's graph and transformer, while the current transform is embedded after the current graph and the former level's transformer. In addition to the interaction between graphs and transforms, the graph is a newly-designed local correction graph, which learns discriminative local features within a patch by exploring nodes' relationships. Extensive experiments on three large-scale vehicle re-identification datasets demonstrate that our GiT method is superior to state-of-the-art vehicle re-identification approaches.
引用
收藏
页码:1039 / 1051
页数:13
相关论文
共 50 条
  • [1] TVG-ReID: Transformer-Based Vehicle-Graph Re-Identification
    Li, Zhiwei
    Zhang, Xinyu
    Tian, Chi
    Gao, Xin
    Gong, Yan
    Wu, Jiani
    Zhang, Guoying
    Li, Jun
    Liu, Huaping
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (11): : 4644 - 4652
  • [2] Camera Topology Graph Guided Vehicle Re-Identification
    Li, Hongchao
    Zheng, Aihua
    Sun, Liping
    Luo, Yonglong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1565 - 1577
  • [3] A Structured Graph Attention Network for Vehicle Re-Identification
    Zhu, Yangchun
    Zha, Zheng-Jun
    Zhang, Tianzhu
    Liu, Jiawei
    Luo, Jiebo
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 646 - 654
  • [4] Transformer-Based Attention Network for Vehicle Re-Identification
    Lian, Jiawei
    Wang, Dahan
    Zhu, Shunzhi
    Wu, Yun
    Li, Caixia
    ELECTRONICS, 2022, 11 (07)
  • [5] Part Сouрled Transformer Network for Vehicle Re-Identification
    Sun W.
    Hu Y.
    Dai G.
    Zhang X.
    Xu F.
    Zhao Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (08): : 1289 - 1298
  • [6] PATReId: Pose Apprise Transformer Network for Vehicle Re-Identification
    Kishore, Rishi
    Aslam, Nazia
    Kolekar, Maheshkumar H.
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (05): : 1 - 12
  • [7] Vehicle Re-identification method based on Swin-Transformer network
    Li J.
    Yu C.
    Shi J.
    Zhang C.
    Ke T.
    Array, 2022, 16
  • [8] MART: Mask-Aware Reasoning Transformer for Vehicle Re-Identification
    Lu, Zefeng
    Lin, Ronghao
    Hu, Haifeng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (02) : 1994 - 2009
  • [9] Progressively Hybrid Transformer for Multi-Modal Vehicle Re-Identification
    Pan, Wenjie
    Huang, Linhan
    Liang, Jianbao
    Hong, Lan
    Zhu, Jianqing
    SENSORS, 2023, 23 (09)
  • [10] Frequency transformer with local feature enhancement for improved vehicle re-identification
    Xiang, Honglin
    Wang, Jiahao
    Sun, Yulong
    Ye, Ming
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (04):