Pedestrian search in surveillance videos by learning discriminative deep features

被引:14
|
作者
Zhang, Shizhou [1 ,2 ]
Cheng, De [3 ]
Gong, Yihong [3 ]
Shi, Dahu [3 ]
Qiu, Xi [3 ]
Xia, Yong [1 ,2 ]
Zhang, Yanning [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Shaanxi Key Lab Speech & Image Informat Proc SAII, Xian 710072, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci & Engn, CMCC, Xian 710072, Shaanxi, Peoples R China
[3] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Person search; Re-identification; Discriminative; CNN; Deep feature;
D O I
10.1016/j.neucom.2017.12.042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Searching for a target person in videos captured by many non-overlapped cameras is an important yet challenging problem in the fields of intelligent video surveillance. Person re-identification is a key technique in the person searching task. In this paper, we propose a discriminative objective function to learn deep CNN features for person re-id. Specially, the proposed objective function reduces distances between instances belonging to the same person, and enlarges distances between instances belonging to different persons at the same time. With the goal of inter-class dispersion and intra-class compactness, the obtained deep features can be more discriminative than many traditional training objectives, e.g. softmax, contrastive and triplet objective functions. Extensive experiments on person re-id benchmarks validated the superiority of the proposed objective function. Based on the proposed person re-identification algorithm, we implement a pedestrian search system by integrating three components: pedestrian detection, multi-person tracking and person re-identification together. The whole system is evaluated on a Cross-Camera Pedestrian Search Challenge and achieves superior performances on the evaluation set. (c) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:120 / 128
页数:9
相关论文
共 50 条
  • [1] Multiple deep features learning for object retrieval in surveillance videos
    Guo, Haiyun
    Wang, Jinqiao
    Lu, Hanqing
    [J]. IET COMPUTER VISION, 2016, 10 (04) : 268 - 272
  • [2] Learning Deep Features for Discriminative Localization
    Zhou, Bolei
    Khosla, Aditya
    Lapedriza, Agata
    Oliva, Aude
    Torralba, Antonio
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2921 - 2929
  • [3] Mining Deep Part Features for Pedestrian Search
    Zhang, Jin
    Yang, Xuequan
    Zhao, Yan
    Shen, Shjie
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 2061 - 2064
  • [4] Part-based Deep Network for Pedestrian Detection in Surveillance Videos
    Chen, Qi
    Jiang, Wenhui
    Zhao, Yanyun
    Zhao, Zhicheng
    [J]. 2015 VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2015,
  • [5] Pedestrian tracking by learning deep features
    Huang, Honghe
    Xu, Yi
    Huang, Yanjie
    Yang, Qian
    Zhou, Zhiguo
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 57 : 172 - 175
  • [6] VIDEOWHISPER: TOWARDS UNSUPERVISED LEARNING OF DISCRIMINATIVE FEATURES OF VIDEOS WITH RNN
    Zhao, Na
    Zhang, Hanwang
    Zhang, Mingxing
    Hong, Richang
    Wang, Meng
    Chua, Tat-seng
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 277 - 282
  • [7] Learning discriminative shape statistics distribution features for pedestrian detection
    Shen, Jifeng
    Zuo, Xin
    Yang, Wankou
    Yu, Hualong
    Liu, Guohai
    [J]. NEUROCOMPUTING, 2016, 184 : 66 - 77
  • [8] Application of Deep Learning for Weapons Detection in Surveillance Videos
    Hashmi, Tufail Sajjad Shah
    Ul Haq, Nazeef
    Fraz, Muhammad Moazam
    Shahzad, Muhammad
    [J]. 2021 INTERNATIONAL CONFERENCE ON DIGITAL FUTURES AND TRANSFORMATIVE TECHNOLOGIES (ICODT2), 2021,
  • [9] Multiscale blur detection by learning discriminative deep features
    Huang, Rui
    Feng, Wei
    Fan, Mingyuan
    Wan, Liang
    Sun, Jizhou
    [J]. NEUROCOMPUTING, 2018, 285 : 154 - 166
  • [10] Pedestrian Detection and Tracking in Challenging Surveillance Videos
    Van Beeck, Kristof
    Goedeme, Toon
    [J]. COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, 2016, 598 : 356 - 373