A Text-Based Dual-Branch Person Re-Identification Algorithm Based on the Deep Attribute Information Mining Network

被引:0
|
作者
Han, Ke [1 ]
Zhang, Xiyan [1 ]
Xu, Wenlong [1 ]
Jin, Long [1 ]
机构
[1] North China Univ Water Resources & Elect Power, Sch Informat Engn, Zhengzhou 450046, Peoples R China
来源
SYMMETRY-BASEL | 2025年 / 17卷 / 01期
基金
中国国家自然科学基金;
关键词
person re-identification; implicit relational prompts; cross-feature fusion; text-image retrieval; symmetry;
D O I
10.3390/sym17010064
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Text-based person re-identification enables the retrieval of specific pedestrians from a large image library using textual descriptions, effectively addressing the issue of missing pedestrian images. The main challenges in this task are to learn discriminative image-text features and achieve accurate cross-modal matching. Despite the potential of leveraging semantic information from pedestrian attributes, current methods have not yet fully harnessed this resource. To this end, we introduce a novel Text-based Dual-branch Person Re-identification Algorithm based on the Deep Attribute Information Mining (DAIM) network. Our approach employs a Masked Language Modeling (MLM) module to learn cross-modal attribute alignments through mask language modeling, and an Implicit Relational Prompt (IRP) module to extract relational cues between pedestrian attributes using tailored prompt templates. Furthermore, drawing inspiration from feature fusion techniques, we developed a Symmetry Semantic Feature Fusion (SSF) module that utilizes symmetric relationships between attributes to enhance the integration of information from different modes, aiming to capture comprehensive features and facilitate efficient cross-modal interactions. We evaluated our method using three benchmark datasets, CUHK-PEDES, ICFG-PEDES, and RSTPReid, and the results demonstrated Rank-1 accuracy rates of 78.17%, 69.47%, and 68.30%, respectively. These results indicate a significant enhancement in pedestrian retrieval accuracy, thereby validating the efficacy of our proposed approach.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Dual-Branch Person Re-Identification Algorithm Based on Multi-Feature Representation
    Cui, Xinyu
    Liang, Yu
    Zhang, Wei
    ELECTRONICS, 2023, 12 (08)
  • [2] Self-attention-Based Dual-Branch Person Re-identification
    Gao, Peng
    Yue, Xiao
    Chen, Wei
    Chen, Dufeng
    Wang, Li
    Zhang, Tingxiu
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IV, ICIC 2024, 2024, 14865 : 210 - 219
  • [3] MINING FALSE POSITIVE EXAMPLES FOR TEXT-BASED PERSON RE-IDENTIFICATION
    Xu, Wenhao
    Shao, Zhiyin
    Ding, Changxing
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1680 - 1684
  • [4] Low Resolution Person Re-identification by an Adaptive Dual-Branch Network
    Feng, Zhanxiang
    Zhang, Wenxiao
    Lai, Jianhuang
    Xie, Xiaohua
    IMAGE AND GRAPHICS, ICIG 2019, PT I, 2019, 11901 : 735 - 746
  • [5] Weakly Supervised Text-based Person Re-Identification
    Zhao, Shizhen
    Gao, Changxin
    Shao, Yuanjie
    Zheng, Wei-Shi
    Sang, Nong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 11375 - 11384
  • [6] Parallel Data Augmentation for Text-based Person Re-identification
    Cai, Han-Qing
    Li, Xin
    Ji, Yi
    Li, Ying
    Liu, Chun-Ping
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] Dual-branch adaptive attention transformer for occluded person re-identification
    Lu, Yunhua
    Jiang, Mingzi
    Liu, Zhi
    Mu, Xinyu
    IMAGE AND VISION COMPUTING, 2023, 131
  • [8] Dual Branch Attention Network for Person Re-Identification
    Fan, Denghua
    Wang, Liejun
    Cheng, Shuli
    Li, Yongming
    SENSORS, 2021, 21 (17)
  • [9] Dual-path CNN with Max Gated block for text-based person re-identification
    Ma, Tinghuai
    Yang, Mingming
    Rong, Huan
    Qian, Yurong
    Tian, Yuan
    Al-Nabhan, Najla
    IMAGE AND VISION COMPUTING, 2021, 111
  • [10] Cluster-based Dual-branch Contrastive Learning for unsupervised domain adaptation person re-identification
    Tian, Qing
    Sun, Jixin
    KNOWLEDGE-BASED SYSTEMS, 2023, 280