Deep feature learning with attributes for cross-modality person re-identification

被引:10
|
作者
Zhang, Shikun [1 ]
Chen, Changhong [1 ]
Song, Wanru [1 ]
Gan, Zongliang [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Telecommun & Informat Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
cross-modality person re-identification; attributes; modality invariant; feature extraction;
D O I
10.1117/1.JEI.29.3.033017
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cross-modality person re-identification (Re-ID) between RGB and infrared domains is a hot and challenging problem, which aims to retrieve pedestrian images cross-modality and cross-camera views. Since there is a huge gap between two modalities, the difficulty of solving the problem is how to bridge the cross-modality gap with images. However, most approaches solve this issue mainly by increasing interclass discrepancy between features, and few research studies focus on decreasing intraclass cross-modality discrepancy, which is crucial for cross-modality Re-ID. Moreover, we find that despite the huge gap, the attribute representations of the pedestrian are generally unchanged. We provide a different view of the cross-modality person Re-ID problem, which uses additional attribute labels as auxiliary information to increase intraclass cross-modality similarity. First, we manually annotate attribute labels for a large-scale cross-modality Re-ID dataset. Second, we propose an end-to-end network to learn modality-invariant and identity-specific local features with the joint supervision of attribute classification loss and identity classification loss. The experimental results on a large-scale cross-modality Re-ID benchmarks show that our model achieves competitive Re-ID performance compared with the state-of-the-art methods. To demonstrate the versatility of the model, we report the results of our model on the Market-1501 dataset. (C) 2020 SPIE and IS&T
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Deep learning for visible-infrared cross-modality person re-identification: A comprehensive review
    Huang, Nianchang
    Liu, Jianan
    Miao, Yunqi
    Zhang, Qiang
    Han, Jungong
    [J]. INFORMATION FUSION, 2023, 91 : 396 - 411
  • [22] Learning Identity-Consistent Feature for Cross-Modality Person Re-Identification via Pixel and Feature Alignment
    Chan, Sixian
    Du, Feng
    Lei, Yanjing
    Lai, Zhounian
    Mao, Jiafa
    Li, Chao
    [J]. MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [23] Cross-Modality Person Re-Identification Method with Joint-Modality Generation and Feature Enhancement
    Bi, Yihan
    Wang, Rong
    Zhou, Qianli
    Zeng, Zhaolong
    Lin, Ronghui
    Wang, Mingjie
    [J]. ENTROPY, 2024, 26 (08)
  • [24] Deep Cross-Modality Alignment for Multi-Shot Person Re-IDentification
    Song, Zhichao
    Ni, Bingbing
    Yan, Yichao
    Ren, Zhe
    Xu, Yi
    Yang, Xiaokang
    [J]. PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 645 - 653
  • [25] Cross-modality person re-identification via multi-task learning
    Huang, Nianchang
    Liu, Kunlong
    Liu, Yang
    Zhang, Qiang
    Han, Jungong
    [J]. Pattern Recognition, 2022, 128
  • [26] Cross-modality person re-identification via multi-task learning
    Huang, Nianchang
    Liu, Kunlong
    Liu, Yang
    Zhang, Qiang
    Han, Jungong
    [J]. PATTERN RECOGNITION, 2022, 128
  • [27] Cross-modality consistency learning for visible-infrared person re-identification
    Shao, Jie
    Tang, Lei
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (06)
  • [28] Two-stage Metric Learning for Cross-Modality Person Re-Identification
    Wang, Jiabao
    Jiao, ShanShan
    Li, Yang
    Miao, Zhuang
    [J]. PROCEEDINGS OF 2020 5TH INTERNATIONAL CONFERENCE ON MULTIMEDIA AND IMAGE PROCESSING (ICMIP 2020), 2020, : 28 - 32
  • [29] Self-attention Cross-modality Fusion Network for Cross-modality Person Re-identification
    Du P.
    Song Y.-H.
    Zhang X.-Y.
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (06): : 1457 - 1468
  • [30] Channel decoupling network for cross-modality person re-identification
    Chen, Jingying
    Chen, Chang
    Tan, Lei
    Peng, Shixin
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (09) : 14091 - 14105