GiT: Graph Interactive Transformer for Vehicle Re-Identification

被引:58
|
作者
Shen, Fei [1 ,2 ]
Xie, Yi [1 ]
Zhu, Jianqing [1 ]
Zhu, Xiaobin [3 ]
Zeng, Huanqiang [1 ]
机构
[1] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Convolutional neural networks; Representation learning; Correlation; Annotations; Transforms; Graph network; transformer layer; interactive; vehicle re-identification;
D O I
10.1109/TIP.2023.3238642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transformers are more and more popular in computer vision, which treat an image as a sequence of patches and learn robust global features from the sequence. However, pure transformers are not entirely suitable for vehicle re-identification because vehicle re-identification requires both robust global features and discriminative local features. For that, a graph interactive transformer (GiT) is proposed in this paper. In the macro view, a list of GiT blocks are stacked to build a vehicle re-identification model, in where graphs are to extract discriminative local features within patches and transformers are to extract robust global features among patches. In the micro view, graphs and transformers are in an interactive status, bringing effective cooperation between local and global features. Specifically, one current graph is embedded after the former level's graph and transformer, while the current transform is embedded after the current graph and the former level's transformer. In addition to the interaction between graphs and transforms, the graph is a newly-designed local correction graph, which learns discriminative local features within a patch by exploring nodes' relationships. Extensive experiments on three large-scale vehicle re-identification datasets demonstrate that our GiT method is superior to state-of-the-art vehicle re-identification approaches.
引用
收藏
页码:1039 / 1051
页数:13
相关论文
共 50 条
  • [31] An Interactive Design for Visualizable Person Re-Identification
    Ren, Haolin
    Wang, Zheng
    Wang, Zhixiang
    Chen, Lixiong
    Satoh, Shin'ichi
    Hu, Daning
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4536 - 4538
  • [32] Interactive information module for person re-identification
    Liu, Xudong
    Kong, Jun
    Jiang, Min
    Li, Sha
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 75
  • [33] A Multi-Scale Graph Attention-Based Transformer for Occluded Person Re-Identification
    Ma, Ming
    Wang, Jianming
    Zhao, Bohan
    APPLIED SCIENCES-BASEL, 2024, 14 (18):
  • [34] An adaptive cross-scale transformer based on graph signal processing for person re-identification
    Zhou, Wei
    Hou, Yi
    Xu, Shijun
    Zhou, Shilin
    IET IMAGE PROCESSING, 2023, 17 (08) : 2321 - 2335
  • [35] People Re-identification by graph kernels methods
    Brun L.
    Conte D.
    Foggia P.
    Vento M.
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011, 6658 LNCS : 285 - 294
  • [36] People Re-identification by Graph Kernels Methods
    Brun, Luc
    Conte, Donatello
    Foggia, Pasquale
    Vento, Mario
    GRAPH-BASED REPRESENTATIONS IN PATTERN RECOGNITION, 2011, 6658 : 285 - 294
  • [37] Unsupervised Graph Association for Person Re-identification
    Wu, Jinlin
    Yang, Yang
    Liu, Hao
    Liao, Shengcai
    Lei, Zhen
    Li, Stan Z.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8320 - 8329
  • [38] Graph Correspondence Transfer for Person Re-Identification
    Zhou, Qin
    Fan, Heng
    Zheng, Shibao
    Su, Hang
    Li, Xinzhe
    Wu, Shuang
    Ling, Haibin
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7599 - 7606
  • [39] A Graph-Kernel Method for Re-identification
    Brun, Luc
    Conte, Donatello
    Foggia, Pasquale
    Vento, Mario
    IMAGE ANALYSIS AND RECOGNITION: 8TH INTERNATIONAL CONFERENCE, ICIAR 2011, PT I, 2011, 6753 : 173 - 182
  • [40] Parallelism Network with Partial-aware and Cross-correlated Transformer for Vehicle Re-identification
    Jiang, Guangqi
    Wang, Huibing
    Peng, Jinjia
    Fu, Xianping
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2022, 2022, : 594 - 600