Illumination Unification for Person Re-Identification

被引:42
|
作者
Zhang, Guoqing [1 ,2 ]
Luo, Zhiyuan [1 ]
Chen, Yuhao [1 ]
Zheng, Yuhui [1 ]
Lin, Weisi [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Engn Res Ctr Digital Forens, Minist Educ, Nanjing 210044, Peoples R China
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Lighting; Training; Image restoration; Testing; Cameras; Task analysis; Image reconstruction; Person re-identification; generative adversarial network; illumination-adaptive; FEATURES; NETWORK;
D O I
10.1109/TCSVT.2022.3169422
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The performance of person re-identification (re-ID) is easily affected by illumination variations caused by different shooting times, places and cameras. Existing illumination-adaptive methods usually require annotating cross-camera pedestrians on each illumination scale, which is unaffordable for a long-term person retrieval system. The cross-illumination person retrieval problem presents a great challenge for accurate person matching. In this paper, we propose a novel method to tackle this task, which only needs to annotate pedestrians on one illumination scale. Specifically, (i) we propose a novel Illumination Estimation and Restoring framework (IER) to estimate the illumination scale of testing images taken at different illumination conditions and restore them to the illumination scale of training images, such that the disparities between training images with uniform illumination and testing images with varying illuminations are reduced. IER achieves promising results on illumination-adaptive dataset and proving itself a proper baseline for cross-illumination person re-ID. (ii) we propose a Mixed Training strategy using both Original and Reconstructed images (MTOR) to further improve model performance. We generate reconstructed images that are consistent with the original training images in content but more similar to the restored images in style. The reconstructed images are combined with the original training images for supervised training to further reduce the domain gap between original training images and restored testing images. To verify the effectiveness of our method, some simulated illumination-adaptive datasets are constructed with various illumination conditions. Extensive experimental results on the simulated datasets validate the effectiveness of the proposed method. The source code is available at https://github.com/FadeOrigin/IUReId.
引用
收藏
页码:6766 / 6777
页数:12
相关论文
共 50 条
  • [1] Low illumination person re-identification
    Fei Ma
    Xiaoke Zhu
    Xinyu Zhang
    Liang Yang
    Mei Zuo
    Xiao-Yuan Jing
    Multimedia Tools and Applications, 2019, 78 : 337 - 362
  • [2] Low illumination person re-identification
    Ma, Fei
    Zhu, Xiaoke
    Zhang, Xinyu
    Yang, Liang
    Zuo, Mei
    Jing, Xiao-Yuan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (01) : 337 - 362
  • [3] Illumination-Invariant Person Re-Identification
    Huang, Yukun
    Zha, Zheng-Jun
    Fu, Xueyang
    Zhang, Wei
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 365 - 373
  • [4] ILLUMINATION CORRECTION FOR UNSUPERVISED PERSON RE-IDENTIFICATION
    Guo, Jiaqi
    Reibman, Amy R.
    Delp, Edward J.
    2024 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION, SSIAI, 2024, : 105 - 108
  • [5] Illumination-Adaptive Person Re-Identification
    Zeng, Zelong
    Wang, Zhixiang
    Wang, Zheng
    Zheng, Yinqiang
    Chuang, Yung-Yu
    Satoh, Shin'ichi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (12) : 3064 - 3074
  • [6] Rethinking Illumination for Person Re-Identification: A Unified View
    Xiang, Suncheng
    You, Guanjie
    Li, Leqi
    Guan, Mengyuan
    Liu, Ting
    Qian, Dahong
    Fu, Yuzhuo
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4730 - 4738
  • [7] Person Re-identification
    Bak, Slawomir
    Bremond, Francois
    ERCIM NEWS, 2013, (95): : 33 - 34
  • [8] Illumination Distillation Framework for Nighttime Person Re-Identification and a New Benchmark
    Lu, Andong
    Zhang, Zhang
    Huang, Yan
    Zhang, Yifan
    Li, Chenglong
    Tang, Jin
    Wang, Liang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 406 - 419
  • [9] Person Re-identification in the Wild
    Zheng, Liang
    Zhang, Hengheng
    Sun, Shaoyan
    Chandraker, Manmohan
    Yang, Yi
    Tian, Qi
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3346 - 3355
  • [10] OCCLUDED PERSON RE-IDENTIFICATION
    Zhuo, Jiaxuan
    Chen, Zeyu
    Lai, Jianhuang
    Wang, Guangcong
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,