Effective person re-identification by self-attention model guided feature learning

被引:28
|
作者
Li, Yang [1 ]
Jiang, Xiaoyan [1 ]
Hwang, Jenq-Neng [2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai, Peoples R China
[2] Univ Washington, Dept Elect & Comp Engn, Box 352500, Seattle, WA 98195 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Feature extraction; Self-attention; Cross-entropy loss; Triplet loss;
D O I
10.1016/j.knosys.2019.07.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (re-ID), of which the goal is to recognize person identities of images captured by non-overlapping cameras, is a challenging topic in computer vision. Most existing person re-ID methods conduct directly on detected objects, which ignore the space misalignment caused by detectors, human pose variation, and occlusion problems. To tackle the above mentioned difficulties, we propose a self-attention model guided deep convolutional neural network(DCNN) to learn robust features from image shots. Kernels of the self-attention model evaluate weights for the importance of different person regions. To solve the local feature dependence problem of feature extraction, the non-local feature map generated by the self-attention model is fused with the original feature map generated from the resnet-50. Furthermore, the loss function considers both the cross-entropy loss and the triplet loss in the training process, which enables the network to capture common characteristics within the same individuals and significant differences between distinct persons. Extensive experiments and comparative evaluations show that our proposed strategy outperforms most of the state-of-the-art methods on standard datasets: Market-1501, DukeMTMC-relD, and CUHK03. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] A Dual Self-Attention mechanism for vehicle re-Identification
    Zhu, Wenqian
    Wang, Zhongyuan
    Wang, Xiaochen
    Hu, Ruimin
    Liu, Huikai
    Liu, Cheng
    Wang, Chao
    Li, Dengshi
    PATTERN RECOGNITION, 2023, 137
  • [32] Self and Channel Attention Network for Person Re-Identification
    Munir, Asad
    Martinel, Niki
    Micheloni, Christian
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4025 - 4031
  • [33] An efficient feature pyramid attention network for person re-identification
    Luo, Qian
    Shao, Jie
    Dang, Wanli
    Wang, Chao
    Cao, Libo
    Zhang, Tao
    IMAGE AND VISION COMPUTING, 2024, 145
  • [34] Feature attention fusion network for occluded person re-identification
    Zhuang, Xuyao
    Wei, Dan
    Liang, Danyang
    Jiang, Lei
    IMAGE AND VISION COMPUTING, 2024, 143
  • [35] Object Quality Guided Feature Fusion for Person Re-identification
    Zhang, Lei
    Jiang, Na
    Diao, Qishuai
    Huang, Danyang
    Zhou, Zhong
    Wu, Wei
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 1083 - 1087
  • [36] Camera Style Guided Feature Generation for Person Re-identification
    Hu, Hantao
    Liu, Yang
    Lv, Kai
    Zheng, Yanwei
    Zhang, Wei
    Ke, Wei
    Sheng, Hao
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, PT I, 2020, 12384 : 158 - 169
  • [37] View Confusion Feature Learning for Person Re-identification
    Liu, Fangyi
    Zhang, Lei
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6638 - 6647
  • [38] Discriminative Spatial Feature Learning for Person Re-Identification
    Peng, Peixi
    Tian, Yonghong
    Huang, Yangru
    Wang, Xiangqian
    An, Huilong
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 274 - 283
  • [39] Multi-level self attention for unsupervised learning person re-identification
    Zheng Y.
    Zhao J.
    Zhou Y.
    Liu F.
    Yao R.
    Zhu H.
    El Saddik A.
    Multimedia Tools and Applications, 83 (26) : 68855 - 68874
  • [40] Learning Spatial-Temporal Graphs with Self-Attention Intensified Conditional Random Field for Video Person Re-identification
    Fang, Wen-Hsien
    Pramono, Rizard Renanda Adhi
    Chen, Yie-Tarng
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,