Effective person re-identification by self-attention model guided feature learning

被引:28
|
作者
Li, Yang [1 ]
Jiang, Xiaoyan [1 ]
Hwang, Jenq-Neng [2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai, Peoples R China
[2] Univ Washington, Dept Elect & Comp Engn, Box 352500, Seattle, WA 98195 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Feature extraction; Self-attention; Cross-entropy loss; Triplet loss;
D O I
10.1016/j.knosys.2019.07.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (re-ID), of which the goal is to recognize person identities of images captured by non-overlapping cameras, is a challenging topic in computer vision. Most existing person re-ID methods conduct directly on detected objects, which ignore the space misalignment caused by detectors, human pose variation, and occlusion problems. To tackle the above mentioned difficulties, we propose a self-attention model guided deep convolutional neural network(DCNN) to learn robust features from image shots. Kernels of the self-attention model evaluate weights for the importance of different person regions. To solve the local feature dependence problem of feature extraction, the non-local feature map generated by the self-attention model is fused with the original feature map generated from the resnet-50. Furthermore, the loss function considers both the cross-entropy loss and the triplet loss in the training process, which enables the network to capture common characteristics within the same individuals and significant differences between distinct persons. Extensive experiments and comparative evaluations show that our proposed strategy outperforms most of the state-of-the-art methods on standard datasets: Market-1501, DukeMTMC-relD, and CUHK03. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Learning Pairwise Feature Dissimilarities for Person Re-Identification
    Martinel, Niki
    Micheloni, Christian
    Piciarelli, Claudio
    2013 SEVENTH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS (ICDSC), 2013,
  • [42] Central Feature Learning for Unsupervised Person Re-identification
    Wang, Binquan
    Asim, Muhammad
    Ma, Guoqi
    Zhu, Ming
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (08)
  • [43] SliceNet: Mask Guided Efficient Feature Augmentation for Attention-Aware Person Re-Identification
    Liu, Zhipu
    Zhang, Lei
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: VISUAL DATA ENGINEERING, PT I, 2019, 11935 : 91 - 102
  • [44] Pose-Guided Attention Learning for Cloth-Changing Person Re-Identification
    Liu, Xiangzeng
    Liu, Kunpeng
    Guo, Jianfeng
    Zhao, Peipei
    Quan, Yining
    Miao, Qiguang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5490 - 5498
  • [45] Learning dual attention enhancement feature for visible-infrared person re-identification
    Zhang, Guoqing
    Zhang, Yinyin
    Zhang, Hongwei
    Chen, Yuhao
    Zheng, Yuhui
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 99
  • [46] Multi Feature Fusion Attention Learning for Clothing-Changing Person Re-Identification
    Wang, Liwei
    Zhang, Yanduo
    Lu, Tao
    Fang, Wenhua
    Wang, Yu
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2022, E105 (08) : 1170 - 1174
  • [47] Information complementary attention-based multidimension feature learning for person re-identification
    Wang, Mingyang
    Ma, Hui
    Huang, Yiwei
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [48] Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification
    Zheng, Kecheng
    Lan, Cuiling
    Zeng, Wenjun
    Liu, Jiawei
    Zhang, Zhizheng
    Zha, Zheng-Jun
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4537 - 4545
  • [49] Interpretable Attention Part Model for Person Re-identification
    Zhou Y.
    Wang H.-Z.
    Zhao J.-Q.
    Chen Y.
    Yao R.
    Chen S.-L.
    Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (10): : 2159 - 2171
  • [50] An Improved Deep Mutual-Attention Learning Model for Person Re-Identification
    Jamal, Miftah Bedru
    Jiang Zhengang
    Ming, Fang
    SYMMETRY-BASEL, 2020, 12 (03):