A Text-Based Dual-Branch Person Re-Identification Algorithm Based on the Deep Attribute Information Mining Network

被引:0
|
作者
Han, Ke [1 ]
Zhang, Xiyan [1 ]
Xu, Wenlong [1 ]
Jin, Long [1 ]
机构
[1] North China Univ Water Resources & Elect Power, Sch Informat Engn, Zhengzhou 450046, Peoples R China
来源
SYMMETRY-BASEL | 2025年 / 17卷 / 01期
基金
中国国家自然科学基金;
关键词
person re-identification; implicit relational prompts; cross-feature fusion; text-image retrieval; symmetry;
D O I
10.3390/sym17010064
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Text-based person re-identification enables the retrieval of specific pedestrians from a large image library using textual descriptions, effectively addressing the issue of missing pedestrian images. The main challenges in this task are to learn discriminative image-text features and achieve accurate cross-modal matching. Despite the potential of leveraging semantic information from pedestrian attributes, current methods have not yet fully harnessed this resource. To this end, we introduce a novel Text-based Dual-branch Person Re-identification Algorithm based on the Deep Attribute Information Mining (DAIM) network. Our approach employs a Masked Language Modeling (MLM) module to learn cross-modal attribute alignments through mask language modeling, and an Implicit Relational Prompt (IRP) module to extract relational cues between pedestrian attributes using tailored prompt templates. Furthermore, drawing inspiration from feature fusion techniques, we developed a Symmetry Semantic Feature Fusion (SSF) module that utilizes symmetric relationships between attributes to enhance the integration of information from different modes, aiming to capture comprehensive features and facilitate efficient cross-modal interactions. We evaluated our method using three benchmark datasets, CUHK-PEDES, ICFG-PEDES, and RSTPReid, and the results demonstrated Rank-1 accuracy rates of 78.17%, 69.47%, and 68.30%, respectively. These results indicate a significant enhancement in pedestrian retrieval accuracy, thereby validating the efficacy of our proposed approach.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Person Re-identification Algorithm Based on the Fusion of Deep Feature and LOMO Feature
    Liang, Zi
    Chi, Jianning
    Hua, Ruzhao
    Zhang, Yue
    Wang, Wenhao
    ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2019), 2019, 11179
  • [42] Person Re-identification Method Based on Dual Feature Attention Backbone Network
    Sun, Zhiwei
    Wu, Guangqun
    Pan, Qin
    Li, Yufeng
    Liu, Yuliang
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VI, ICIC 2024, 2024, 14867 : 484 - 495
  • [43] Dual Network Fusion for Person Re-Identification
    Du, Lin
    Tian, Chang
    Zeng, Mingyong
    Wang, Jiabao
    Jiao, Shanshan
    Shen, Qing
    Wu, Guodong
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2020, E103A (03) : 643 - 648
  • [44] A survey of person re-identification based on deep learning
    Li Q.
    Hu W.-Y.
    Li J.-Y.
    Liu Y.
    Li M.-X.
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2022, 44 (05): : 920 - 932
  • [45] PoolNet deep feature based person re-identification
    Rani, J. Stella Janci
    Augasta, M. Gethsiyal
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (16) : 24967 - 24989
  • [46] Survey on person re-identification based on deep learning
    Wang, Kejun
    Wang, Haolin
    Liu, Meichen
    Xing, Xianglei
    Han, Tian
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2018, 3 (04) : 219 - 227
  • [47] A Survey on Deep Learning Based Person Re-identification
    Luo H.
    Jiang W.
    Fan X.
    Zhang S.-P.
    Zidonghua Xuebao/Acta Automatica Sinica, 2019, 45 (11): : 2032 - 2049
  • [48] PoolNet deep feature based person re-identification
    J. Stella Janci Rani
    M. Gethsiyal Augasta
    Multimedia Tools and Applications, 2023, 82 : 24967 - 24989
  • [49] Research of Person Re-identification Based on Deep Learning
    Wang, Haoying
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2150 - 2157
  • [50] Person re-identification based on deep learning — An overview
    Wei, Wenyu
    Yang, Wenzhong
    Zuo, Enguang
    Qian, Yunyun
    Wang, Lihua
    Journal of Visual Communication and Image Representation, 2022, 82