GiT: Graph Interactive Transformer for Vehicle Re-Identification

被引:58
|
作者
Shen, Fei [1 ,2 ]
Xie, Yi [1 ]
Zhu, Jianqing [1 ]
Zhu, Xiaobin [3 ]
Zeng, Huanqiang [1 ]
机构
[1] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Convolutional neural networks; Representation learning; Correlation; Annotations; Transforms; Graph network; transformer layer; interactive; vehicle re-identification;
D O I
10.1109/TIP.2023.3238642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transformers are more and more popular in computer vision, which treat an image as a sequence of patches and learn robust global features from the sequence. However, pure transformers are not entirely suitable for vehicle re-identification because vehicle re-identification requires both robust global features and discriminative local features. For that, a graph interactive transformer (GiT) is proposed in this paper. In the macro view, a list of GiT blocks are stacked to build a vehicle re-identification model, in where graphs are to extract discriminative local features within patches and transformers are to extract robust global features among patches. In the micro view, graphs and transformers are in an interactive status, bringing effective cooperation between local and global features. Specifically, one current graph is embedded after the former level's graph and transformer, while the current transform is embedded after the current graph and the former level's transformer. In addition to the interaction between graphs and transforms, the graph is a newly-designed local correction graph, which learns discriminative local features within a patch by exploring nodes' relationships. Extensive experiments on three large-scale vehicle re-identification datasets demonstrate that our GiT method is superior to state-of-the-art vehicle re-identification approaches.
引用
收藏
页码:1039 / 1051
页数:13
相关论文
共 50 条
  • [21] MsKAT: Multi-Scale Knowledge-Aware Transformer for Vehicle Re-Identification
    Li, Hongchao
    Li, Chenglong
    Zheng, Aihua
    Tang, Jin
    Luo, Bin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19557 - 19568
  • [22] Transformer vehicle re-identification of intelligent transportation system under carbon neutral target
    Liang, Yiwei
    Gao, Yafei
    Shen, Z. Y.
    COMPUTERS & INDUSTRIAL ENGINEERING, 2023, 185
  • [23] Multimodality Adaptive Transformer and Mutual Learning for Unsupervised Domain Adaptation Vehicle Re-Identification
    Zhang, Xin
    Ling, Yunan
    Li, Kaige
    Shi, Weimin
    Zhou, Zhong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (12) : 20215 - 20226
  • [24] Instance interactive association graph convolutional network for domain adaptive person re-identification
    Yang, Qingyuan
    Hou, Chunping
    Huang, Meiyan
    Wang, Zhipeng
    APPLIED INTELLIGENCE, 2022, 52 (07) : 7747 - 7760
  • [25] Instance interactive association graph convolutional network for domain adaptive person re-identification
    Qingyuan Yang
    Chunping Hou
    Meiyan Huang
    Zhipeng Wang
    Applied Intelligence, 2022, 52 : 7747 - 7760
  • [26] Completed Part Transformer for Person Re-Identification
    Zhang, Zhong
    He, Di
    Liu, Shuang
    Xiao, Baihua
    Durrani, Tariq S.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2303 - 2313
  • [27] Hierarchical Walking Transformer for Object Re-Identification
    Tian, Xudong
    Liu, Jun
    Zhang, Zhizhong
    Wang, Chengjie
    Qu, Yanyun
    Xie, Yuan
    Ma, Lizhuang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4224 - 4232
  • [28] Vision-language constraint graph representation learning for unsupervised vehicle re-identification
    Wang, Dong
    Wang, Qi
    Tu, Zhiwei
    Min, Weidong
    Xiong, Xin
    Zhong, Yuling
    Gai, Di
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [29] LABNet: Local graph aggregation network with class balanced loss for vehicle re-identification
    Taufique, Abu Md Niamul
    Savakis, Andreas
    NEUROCOMPUTING, 2021, 463 : 122 - 132
  • [30] Exploring Spatial Significance via Hybrid Pyramidal Graph Network for Vehicle Re-Identification
    Shen, Fei
    Zhu, Jianqing
    Zhu, Xiaobin
    Xie, Yi
    Huang, Jingchang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 8793 - 8804