Cross-Modality Person Re-Identification Method with Joint-Modality Generation and Feature Enhancement

被引:0
|
作者
Bi, Yihan [1 ]
Wang, Rong [1 ,2 ]
Zhou, Qianli [3 ]
Zeng, Zhaolong [1 ]
Lin, Ronghui [1 ]
Wang, Mingjie [1 ]
机构
[1] Peoples Publ Secur Univ China, Sch Informat & Cyber Secur, Beijing 100038, Peoples R China
[2] Minist Publ Secur, Key Lab Secur Prevent Technol & Risk Assessment, Beijing 100038, Peoples R China
[3] Beijing Publ Secur Bur, Beijing 100038, Peoples R China
关键词
person re-identification; visible-infrared image; modality generation; feature enhancement; gradient centralization;
D O I
10.3390/e26080681
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In order to minimize the disparity between visible and infrared modalities and enhance pedestrian feature representation, a cross-modality person re-identification method is proposed, which integrates modality generation and feature enhancement. Specifically, a lightweight network is used for dimension reduction and augmentation of visible images, and intermediate modalities are generated to bridge the gap between visible images and infrared images. The Convolutional Block Attention Module is embedded into the ResNet50 backbone network to selectively emphasize key features sequentially from both channel and spatial dimensions. Additionally, the Gradient Centralization algorithm is introduced into the Stochastic Gradient Descent optimizer to accelerate convergence speed and improve generalization capability of the network model. Experimental results on SYSU-MM01 and RegDB datasets demonstrate that our improved network model achieves significant performance gains, with an increase in Rank-1 accuracy of 7.12% and 6.34%, as well as an improvement in mAP of 4.00% and 6.05%, respectively.
引用
下载
收藏
页数:14
相关论文
共 50 条
  • [1] Unbiased feature enhancement framework for cross-modality person re-identification
    Yuan, Bowen
    Chen, Bairu
    Tan, Zhiyi
    Shao, Xi
    Bao, Bing-Kun
    MULTIMEDIA SYSTEMS, 2022, 28 (03) : 749 - 759
  • [2] Unbiased feature enhancement framework for cross-modality person re-identification
    Bowen Yuan
    Bairu Chen
    Zhiyi Tan
    Xi Shao
    Bing-Kun Bao
    Multimedia Systems, 2022, 28 : 749 - 759
  • [3] Cross-modality Person Re-identification Based on Joint Constraints of Image and Feature
    Zhang Y.-K.
    Tan L.
    Chen J.-Y.
    Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (08): : 1943 - 1950
  • [4] A Cross-Modality Person Re-Identification Method Based on Joint Middle Modality and Representation Learning
    Ma, Li
    Guan, Zhibin
    Dai, Xinguan
    Gao, Hangbiao
    Lu, Yuanmeng
    ELECTRONICS, 2023, 12 (12)
  • [5] Hierarchical Feature Fusion for Cross-Modality Person Re-identification
    Fu, Wen
    Lim, Monghao
    International Journal of Pattern Recognition and Artificial Intelligence, 2024, 38 (16)
  • [6] Dynamic feature weakening for cross-modality person re-identification*
    Lu, Jian
    Chen, Mengdie
    Wang, Hangying
    Pang, Feifei
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 109
  • [7] Modality interactive attention for cross-modality person re-identification
    Zou, Zilin
    Chen, Ying
    IMAGE AND VISION COMPUTING, 2024, 148
  • [8] Efficient Shared Feature Learning for Cross-modality Person Re-identification
    Song, Wanru
    Wang, Xinyi
    Liu, Feng
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 100 - 105
  • [9] Global and Part Feature Fusion for Cross-Modality Person Re-Identification
    Wang, Xianju
    Cordova, Ronald S.
    IEEE ACCESS, 2022, 10 : 122038 - 122046
  • [10] HPILN: a feature learning framework for cross-modality person re-identification
    Zhao, Yun-Bo
    Lin, Jian-Wu
    Xuan, Qi
    Xi, Xugang
    IET IMAGE PROCESSING, 2019, 13 (14) : 2897 - 2904