Multi-Scale Attention Network Based on Multi-Feature Fusion for Person Re-Identification

被引:0
|
作者
Li, Minghao [1 ,2 ,3 ]
Yuan, Liming [1 ,2 ,3 ]
Wen, Xianbin [1 ,2 ,3 ]
Wang, Jianchen [1 ,2 ,3 ]
Xie, Gengsheng [1 ,2 ,3 ]
Jia, Yansong [1 ,2 ,3 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
[2] Minist Educ, Key Lab Comp Vis & Syst, Tianjin 300384, Peoples R China
[3] Tianjin Key Lab Intelligence Comp & Novel Softwar, Tianjin 300384, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; global clues; local clues; multi-scale features; attention mechanism;
D O I
10.1109/IJCNN52387.2021.9534272
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a challenging and high practical research topic in public safety, person re-identification (Re-ID) technology has attracted increasing attention in the field of computer vision. Due to the success of deep learning, Convolutional Neural Networks (CNNs) have become the main techniques to extract discriminative features for person Re-ID. However, there are many problems in the real scene of pedestrian images, such as pedestrian posture changes, inconsistent shooting perspective and object occlusion, etc. The global features extracted from images by CNNs are easily disturbed by these problems, resulting in the lack of robustness and discrimination, which further leads to low recognition accuracy. To solve these issues, we propose a multi-scale attention network based on multi-feature fusion (MSAN), which adopts a multi-branch deep network structure consisting of a global feature learning branch, two local feature learning branches and a shallow-level feature learning branch. It can sample the features of different depth of the network and get discriminative feature embedding by combining global and local cues, and then the sampled features are fused to predict the pedestrians. We also use the attention mechanism to make the network to focus on the key information of different scale feature maps thus enhance the learning of key parts of the human body and alleviate the interference caused by image changes. Experimental results on three mainstream benchmark datasets Market-1501, DukeMTMC-reID and CUHK03 show that our method can significantly improve the performances and outperform most mainstream methods.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] A Person Re-Identification Method with Multi-Scale and Multi-Feature Fusion
    Liu, Li
    Li, Xi
    Lei, Xuemei
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (12): : 1868 - 1876
  • [2] Person Re-identification Based on Multi-scale Network Attention Fusion
    Wang Fenhua
    Zhao Bo
    Huang Chao
    Yan Youqi
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (12) : 3045 - 3052
  • [3] Multi-scale feature fusion network for person re-identification
    Wang, Yongjie
    Zhang, Wei
    Liu, Yanyan
    [J]. IET IMAGE PROCESSING, 2020, 14 (17) : 4614 - 4620
  • [4] Person re-identification based on multi-scale feature fusion and multi-attention mechanism
    Jiacheng Pu
    Wei Zou
    [J]. Signal, Image and Video Processing, 2024, 18 : 243 - 253
  • [5] Person re-identification based on multi-scale feature fusion and multi-attention mechanism
    Pu, Jiacheng
    Zou, Wei
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 243 - 253
  • [6] Person re-identification based on multi-level and multi-feature fusion
    Tan Feigang
    Liu Kaiyuan
    Zhao Xiaoju
    [J]. 2017 INTERNATIONAL CONFERENCE ON SMART CITY AND SYSTEMS ENGINEERING (ICSCSE 2017), 2017, : 184 - 187
  • [7] A Double Stream Person Re-Identification Method Based on Attention Mechanism and Multi-Scale Feature Fusion
    Ma, Xiao
    Lv, Wenqi
    Zhao, Meng
    [J]. IEEE ACCESS, 2023, 11 : 14612 - 14620
  • [8] MULTI-FEATURE FUSION BASED RE-RANKING FOR PERSON RE-IDENTIFICATION
    Rehman, Saeed Ur
    Chen, Zonghai
    Shah, Jamal Hussain
    Raza, Mudassar
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2016, : 213 - 216
  • [9] Person re-identification based on multi-scale feature learning
    Li, Yueying
    Liu, Li
    Zhu, Lei
    Zhang, Huaxiang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 228
  • [10] Improved Occluded Person Re-Identification with Multi-feature Fusion
    Yang, Jing
    Zhang, Canlong
    Li, Zhixin
    Tang, Yanping
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT IV, 2021, 12894 : 308 - 319