VAC-Net: Visual Attention Consistency Network for Person Re-identification

被引:1
|
作者
Shi, Weidong [1 ]
Zhang, Yunzhou [1 ]
Zhu, Shangdong [1 ]
Liu, Yixiu [1 ]
Coleman, Sonya [2 ]
Kerr, Dermot [2 ]
机构
[1] Northeastern Univ, Shenyang, Liaoning, Peoples R China
[2] Univ Ulster, York St, Belfast, Antrim, North Ireland
基金
中国国家自然科学基金;
关键词
Person re-identification; Viewpoint change; Scale variations; Visual attention;
D O I
10.1145/3512527.3531409
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Person re-identification (ReID) is a crucial aspect of recognising pedestrians across multiple surveillance cameras. Even though significant progress has been made in recent years, the viewpoint change and scale variations still affect model performance. In this paper, we observe that it is beneficial for the model to handle the above issues when boost the consistent feature extraction capability among different transforms (e.g., flipping and scaling) of the same image. To this end, we propose a visual attention consistency network (VAC-Net). Specifically, we propose Embedding Spatial Consistency (ESC) architecture with flipping, scaling and original forms of the same image as inputs to learn a consistent embedding space. Furthermore, we design an Input-Wise visual attention consistent loss (IW-loss) so that the class activation maps(CAMs) from the three transforms are aligned with each other to enforce their advanced semantic information remains consistent. Finally, we propose a Layer-Wise visual attention consistent loss (LW-loss) to further enforce the semantic information among different stages to be consistent with the CAMs within each branch. These two losses can effectively improve the model to address the viewpoint and scale variations. Experiments on the challenging Market-1501, DukeMTMC-reID, and MSMT17 datasets demonstrate the effectiveness of the proposed VAC-Net.
引用
收藏
页码:571 / 578
页数:8
相关论文
共 50 条
  • [1] PERSON RE-IDENTIFICATION USING VISUAL ATTENTION
    Rahimpour, Alireza
    Liu, Liu
    Taalimi, Ali
    Song, Yang
    Qi, Hairong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 4242 - 4246
  • [2] CASCADE ATTENTION NETWORK FOR PERSON RE-IDENTIFICATION
    Guo, Haiyun
    Wu, Huiyao
    Zhao, Chaoyang
    Zhang, Huichen
    Wang, Jinqiao
    Lu, Hanqing
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2264 - 2268
  • [3] Related Attention Network for Person Re-identification
    Liang, Jiali
    Zeng, Dan
    Chen, Shuaijun
    Tian, Qi
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 366 - 372
  • [4] MIX-Net: Hybrid Attention/Diversity Network for Person Re-Identification
    Li, Minglang
    Tao, Zhiyong
    Lin, Sen
    Feng, Kaihao
    ELECTRONICS, 2024, 13 (05)
  • [5] PMA-Net: A parallelly mixed attention network for person re-identification
    Qu, Junsuo
    Zhang, Yanghai
    Zhang, Zhenguo
    DISPLAYS, 2023, 78
  • [6] Harmonious Attention Network for Person Re-Identification
    Li, Wei
    Zhu, Xiatian
    Gong, Shaogang
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2285 - 2294
  • [7] S2-Net:Semantic and Saliency Attention Network for Person Re-Identification
    Ren, Xuena
    Zhang, Dongming
    Bao, Xiuguo
    Zhang, Yongdong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4387 - 4399
  • [8] Self and Channel Attention Network for Person Re-Identification
    Munir, Asad
    Martinel, Niki
    Micheloni, Christian
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4025 - 4031
  • [9] Dual Branch Attention Network for Person Re-Identification
    Fan, Denghua
    Wang, Liejun
    Cheng, Shuli
    Li, Yongming
    SENSORS, 2021, 21 (17)
  • [10] Masked Graph Attention Network for Person Re-identification
    Bao, Liqiang
    Ma, Bingpeng
    Chang, Hong
    Chen, Xilin
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1496 - 1505