Cross-modal pedestrian re-recognition based on attention mechanism

被引:1
|
作者
Zhao, Yuyao [1 ]
Zhou, Hang [1 ]
Cheng, Hai [1 ]
Huang, Chunguang [1 ]
机构
[1] Heilongjiang Univ, Coll Elect & Engn, Harbin, Heilongjiang, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 04期
基金
中国国家自然科学基金;
关键词
Person re-identification; Cross-modality; Attention mechanisms; Data integration;
D O I
10.1007/s00371-023-02926-7
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Person re-identification, as an essential research direction in intelligent security, has gained the focus of researchers and scholars. In practical scenarios, visible light cameras depend highly on lighting conditions and have limited detection capability in poor light. Therefore, many scholars have gradually shifted their research goals to cross-modality person re-identification. However, there are few relevant studies, and challenges remain in resolving the differences in the images of different modalities. In order to solve these problems, this paper will use the research method based on the attention mechanism to narrow the difference between the two modes and guide the network in a more appropriate direction to improve the recognition performance of the network. Aiming at the problem of using the attention mechanism method can improve training efficiency. However, it is easy to cause the model training instability. This paper proposes a cross-modal pedestrian re-recognition method based on the attention mechanism. A new attention mechanism module is designed to allow the network to use less time to focus on more critical features of a person. In addition, a cross-modality hard center triplet loss is designed to supervise the model training better. The paper has conducted extensive experiments on the above two methods on two publicly available datasets, which obtained better performance than similar current methods and verified the effectiveness and feasibility of the proposed methods in this paper.
引用
收藏
页码:2405 / 2418
页数:14
相关论文
共 50 条
  • [1] Cross-modal pedestrian re-recognition based on attention mechanism
    Yuyao Zhao
    Hang Zhou
    Hai Cheng
    Chunguang Huang
    The Visual Computer, 2024, 40 : 2405 - 2418
  • [2] Lightweight Cross-Modal Multispectral Pedestrian Detection Based on Spatial Reweighted Attention Mechanism
    Deng, Lujuan
    Fu, Ruochong
    Li, Zuhe
    Liu, Boyi
    Xue, Mengze
    Cui, Yuhao
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (03): : 4071 - 4089
  • [3] Cross-modal attention and letter recognition
    Wesner, Michael
    Miller, Lisa
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2008, 43 (3-4) : 343 - 343
  • [4] Research on Re-recognition Method of Multi-branch Fusion Attention Mechanism for Occluded Pedestrian
    Zhao, Haiyan
    Xu, Yan
    2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA, 2023, : 477 - 480
  • [5] Cross-Modal Person Re-Identification Based on Channel Reorganization and Attention Mechanism
    Huo Dongdong
    Du Haishuns
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (14)
  • [6] GCANet: A Cross-Modal Pedestrian Detection Method Based on Gaussian Cross Attention Network
    Peng, Peiran
    Mu, Feng
    Yan, Peilin
    Song, Liqiang
    Li, Hui
    Chen, Yu
    Li, Jianan
    Xu, Tingfa
    INTELLIGENT COMPUTING, VOL 2, 2022, 507 : 520 - 530
  • [7] Multimodal Sentiment Analysis Based on a Cross-Modal Multihead Attention Mechanism
    Deng, Lujuan
    Liu, Boyi
    Li, Zuhe
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (01): : 1157 - 1170
  • [8] Truncated attention mechanism and cascade loss for cross-modal person re-identification
    Shi, Shuo
    Huo, Changwei
    Guo, Yingchun
    Lean, Stephen
    Yan, Gang
    Yu, Ming
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 41 (06) : 6575 - 6587
  • [9] A cross-modal pedestrian Re-ID algorithm based on dual attribute information
    Chen L.
    Gao Z.
    Song X.
    Wang Y.
    Nie L.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2022, 48 (04): : 647 - 656
  • [10] IMPLICIT ATTENTION-BASED CROSS-MODAL COLLABORATIVE LEARNING FOR ACTION RECOGNITION
    Zhang, Jianghao
    Zhong, Xian
    Liu, Wenxuan
    Jiang, Kui
    Yang, Zhengwei
    Wang, Zheng
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3020 - 3024