Person re-identification based on random occlusion and multi-granularity feature fusion

被引:0
|
作者
Zhang N. [1 ]
Cheng D. [1 ]
Kou Q. [2 ]
Ma H. [1 ]
Qian J. [1 ]
机构
[1] School of Information and Control Engineering, China University of Mining and Technology, Xuzhou
[2] School of Computer Science and Technology, China University of Mining and Technology, Xuzhou
基金
中国国家自然科学基金;
关键词
global features; joint loss; local feature fusion; person re-identification; random occlusion;
D O I
10.13700/j.bh.1001-5965.2022.0091
中图分类号
学科分类号
摘要
Aiming at the problems of occlusion and monotony of pedestrian discriminative feature hierarchy in person re-identification, this paper proposes a method combining random occlusion and multi-granularity feature fusion based on the IBN-Net50-a network. First, in order to enhance the robustness against occlusion, random occlusion processing is performed on the input images to simulate the real scene of pedestrians being occluded. Secondly, the network includes a global branch, a local coarse-grained fusion branch and a local fine-grained fusion branch, which can extract global salient features while supplementing local multi-grained deep features, enriching the hierarchy of pedestrian discrimination features. Furthermore, further mining the correlation between local multi-granularity features for deeper fusion. Finally, the label smoothing loss and triplet loss jointly train the network. Comparing the proposed method with current state-of-the-art person re-identification algorithms on three standard public datasets and one occlusion dataset. The experimental results show that the Rank-1 of the proposed algorithm on Market1501, DukeMTMC-reID and CUHK03 is 95.2%, 89.2% and 80.1%, respectively. In Occluded-Duke dataset, Rank-1 and mAP achieved 60.6% and 51.6%. The experimental results are better than those of the compared methods, which fully confirm the effectiveness of the proposed method. © 2023 Beijing University of Aeronautics and Astronautics (BUAA). All rights reserved.
引用
收藏
页码:3520 / 3527
页数:7
相关论文
共 47 条
  • [1] LI J H, CHENG D Q, LIU R H, Et al., Unsupervised person re-identification based on measurement axis, IEEE Signal Processing Letters, 28, pp. 379-383, (2021)
  • [2] XIE P Y, XU X., Multi-scale joint learning for person re-identification, Journal of Beijing University of Aeronautics and Astronautics, 47, 3, pp. 613-622, (2021)
  • [3] LIAO S C, HU Y, ZHU X Y, Et al., Person re-identification by local maximal occurrence representation and metric learning, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2197-2206, (2015)
  • [4] ZHAO R, OUYANG W L, WANG X G, Et al., Person re-identification by salience matching, Proceedings of the IEEE International Conference on Computer Vision, pp. 2528-2535, (2014)
  • [5] ZHAO R, OUYANG W L, WANG X G, Et al., Unsupervised salience learning for person re-identification, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3586-3593, (2013)
  • [6] GE Y X, LI Z W, ZHAO H Y, Et al., FD-GAN: Pose-guided feature distilling GAN for robust person re-identification
  • [7] FAN H H, ZHENG L A, YAN C G, Et al., Unsupervised person re-identification: Clustering and fine-tuning, ACM Transactions on Multimedia Computing Communications and Applications, 14, 4, pp. 1-18, (2018)
  • [8] ZHENG L, YANG Y, HAUPTMANN A G., Person re-identification: Past, present and future
  • [9] SUN Y F, ZHENG L, DENG W J, Et al., SVDNet for pedestrian retrieval, Proceedings of the IEEE International Conference on Computer Vision, pp. 3820-3828, (2017)
  • [10] SU C, LI J N, ZHANG S L, Et al., Pose-driven deep convolutional model for person re-identification, Proceedings of the IEEE International Conference on Computer Vision, pp. 3980-3989, (2017)