A Text-Based Dual-Branch Person Re-Identification Algorithm Based on the Deep Attribute Information Mining Network

被引:0
|
作者
Han, Ke [1 ]
Zhang, Xiyan [1 ]
Xu, Wenlong [1 ]
Jin, Long [1 ]
机构
[1] North China Univ Water Resources & Elect Power, Sch Informat Engn, Zhengzhou 450046, Peoples R China
来源
SYMMETRY-BASEL | 2025年 / 17卷 / 01期
基金
中国国家自然科学基金;
关键词
person re-identification; implicit relational prompts; cross-feature fusion; text-image retrieval; symmetry;
D O I
10.3390/sym17010064
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Text-based person re-identification enables the retrieval of specific pedestrians from a large image library using textual descriptions, effectively addressing the issue of missing pedestrian images. The main challenges in this task are to learn discriminative image-text features and achieve accurate cross-modal matching. Despite the potential of leveraging semantic information from pedestrian attributes, current methods have not yet fully harnessed this resource. To this end, we introduce a novel Text-based Dual-branch Person Re-identification Algorithm based on the Deep Attribute Information Mining (DAIM) network. Our approach employs a Masked Language Modeling (MLM) module to learn cross-modal attribute alignments through mask language modeling, and an Implicit Relational Prompt (IRP) module to extract relational cues between pedestrian attributes using tailored prompt templates. Furthermore, drawing inspiration from feature fusion techniques, we developed a Symmetry Semantic Feature Fusion (SSF) module that utilizes symmetric relationships between attributes to enhance the integration of information from different modes, aiming to capture comprehensive features and facilitate efficient cross-modal interactions. We evaluated our method using three benchmark datasets, CUHK-PEDES, ICFG-PEDES, and RSTPReid, and the results demonstrated Rank-1 accuracy rates of 78.17%, 69.47%, and 68.30%, respectively. These results indicate a significant enhancement in pedestrian retrieval accuracy, thereby validating the efficacy of our proposed approach.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] PMG-Pyramidal Multi-Granular Matching for Text-Based Person Re-Identification
    Liu, Chao
    Xue, Jingyi
    Wang, Zijie
    Zhu, Aichun
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [32] Dual-Branch Network Fused With Two-Level Attention Mechanism for Clothes-Changing Person Re-Identification
    Lu, Yong
    Jin, Ming Zhe
    INTERNATIONAL JOURNAL OF WEB SERVICES RESEARCH, 2023, 20 (01)
  • [33] Deep and low-level feature based attribute learning for person re-identification
    Chen, Yiqiang
    Duffner, Stefan
    Stoian, Andrei
    Dufour, Jean-Yves
    Baskurt, Atilla
    IMAGE AND VISION COMPUTING, 2018, 79 : 25 - 34
  • [34] Cross domain knowledge learning with dual-branch adversarial network for vehicle re-identification
    Peng, Jinjia
    Wang, Huibing
    Xu, Fengqiang
    Fu, Xianping
    NEUROCOMPUTING, 2020, 401 : 133 - 144
  • [35] Person Re-Identification: Attribute-Based Feature Evaluation
    Riachy, Chirine
    Bouridane, Ahmed
    2018 IEEE 16TH WORLD SYMPOSIUM ON APPLIED MACHINE INTELLIGENCE AND INFORMATICS (SAMI 2018): DEDICATED TO THE MEMORY OF PIONEER OF ROBOTICS ANTAL (TONY) K. BEJCZY, 2018, : 85 - 90
  • [36] APNET: ATTRIBUTE PARSING NETWORK FOR PERSON RE-IDENTIFICATION
    Tay, Chiat-Pin
    Yap, Kim-Hui
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1144 - 1148
  • [37] Person Re-Identification Method Based on the Construction of Graph Convolutional Network with Attribute Feature
    Hu, Xiuhua
    Liang, Yingyu
    Hui, Yan
    Wu, Xi
    Liu, Huan
    Hu, Xuyang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (12)
  • [38] Cross-Modality Person Re-Identification Based on Dual-Path Multi-Branch Network
    Xiang, Xuezhi
    Lv, Ning
    Yu, Zeting
    Zhai, Mingliang
    El Saddik, Abdulmotaleb
    IEEE SENSORS JOURNAL, 2019, 19 (23) : 11706 - 11713
  • [39] A dual-branch fracture attribute fusion network based on prior knowledge
    Jiang, Wenbin
    Zhang, Dongmei
    Hui, Gang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [40] MULTI BRANCH SIAMESE NETWORK FOR PERSON RE-IDENTIFICATION
    Munir, Asad
    Martinel, Niki
    Micheloni, Christian
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2351 - 2355