Attribute-Aware Pedestrian Detection in a Crowd

被引:43
|
作者
Zhang, Jialiang [1 ]
Lin, Lixiang [1 ]
Zhu, Jianke [1 ,2 ]
Li, Yang [1 ]
Chen, Yun-chen [3 ]
Hu, Yao [4 ]
Hoi, Steven C. H. [3 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
[2] Alibaba Zhejiang Univ Joint Res Inst Frontier Tec, Hangzhou 310027, Peoples R China
[3] Singapore Management Univ, Sch Informat Syst, Singapore 178902, Singapore
[4] Co Alibaba, Youku Cognit & Intelligent Lab, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Detectors; Semantics; Feature extraction; Proposals; Object detection; Task analysis; Training; Attribute-aware; non-maximum suppression (nms); pedestrian detection;
D O I
10.1109/TMM.2020.3020691
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Pedestrian detection is an initial step to perform outdoor scene analysis, which plays an essential role in many real-world applications. Although having enjoyed the merits of deep learning frameworks from the generic object detectors, pedestrian detection is still a very challenging task due to heavy occlusions, and highly crowded group. Generally, the conventional detectors are unable to differentiate individuals from each other effectively under such a dense environment. To tackle this critical problem, we propose an attribute-aware pedestrian detector to explicitly model people's semantic attributes in a high-level feature detection fashion. Besides the typical semantic features, center position, target's scale, and offset, we introduce a pedestrian-oriented attribute feature to encode the high-level semantic differences among the crowd. Moreover, a novel attribute-feature-based Non-Maximum Suppression (NMS) is proposed to distinguish the person from a highly overlapped group by adaptively rejecting the false-positive results in a very crowd settings. Furthermore, an enhanced ground truth target is designed to alleviate the difficulties caused by the attribute configuration, and to ease the class imbalance issue during training. Finally, we evaluate our proposed attribute-aware pedestrian detector on three benchmark datasets including CityPerson, CrowdHuman, and EuroCityPerson, and achieves the state-of-the-art results.
引用
收藏
页码:3085 / 3097
页数:13
相关论文
共 50 条
  • [1] Attribute-Aware Pedestrian Image Editing
    Yin, Xiaoyi
    Gu, Xinqian
    Chang, Hong
    Ma, Bingpeng
    Chen, Xilin
    IMAGE AND GRAPHICS, ICIG 2019, PT I, 2019, 11901 : 44 - 56
  • [2] ABNORMAL CROWD BEHAVIOR DETECTION BASED ON SOCIAL ATTRIBUTE-AWARE FORCE MODEL
    Zhang, Yanhao
    Qin, Lei
    Yao, Hongxun
    Huang, Qingming
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 2689 - 2692
  • [3] Social Attribute-Aware Force Model: Exploiting Richness of Interaction for Abnormal Crowd Detection
    Zhang, Yanhao
    Qin, Lei
    Ji, Rongrong
    Yao, Hongxun
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2015, 25 (07) : 1231 - 1245
  • [4] Attribute-aware Semantic Segmentation of Road Scenes for Understanding Pedestrian Orientations
    Sulistiyo, M. D.
    Kawanishi, Y.
    Deguchi, D.
    Hirayama, T.
    Ide, I.
    Zheng, J. Y.
    Murase, H.
    2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 2698 - 2703
  • [5] Attribute-Aware Loss Function for Accurate Semantic Segmentation Considering the Pedestrian Orientations
    Sulistiyo, Mahmud Dwi
    Kawanishi, Yasutomo
    Deguchi, Daisuke
    Ide, Ichiro
    Hirayama, Takatsugu
    Zheng, Jiang-Yu
    Murase, Hiroshi
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2020, E103A (01) : 231 - 242
  • [6] Attribute-aware collaborative filtering
    Tso, K
    Schmidt-Thieme, L
    FROM DATA AND INFORMATION ANALYSIS TO KNOWLEDGE ENGINEERING, 2006, : 614 - +
  • [7] Eva: Attribute-Aware Network Segmentation
    Citraro, Salvatore
    Rossetti, Giulio
    COMPLEX NETWORKS AND THEIR APPLICATIONS VIII, VOL 1, 2020, 881 : 141 - 151
  • [8] Attribute-aware deep attentive recommendation
    Xiaoxin Sun
    Lisa Zhang
    Yuling Wang
    Mengying Yu
    Minghao Yin
    Bangzuo Zhang
    The Journal of Supercomputing, 2021, 77 : 5510 - 5527
  • [9] Attribute-aware deep attentive recommendation
    Sun, Xiaoxin
    Zhang, Lisa
    Wang, Yuling
    Yu, Mengying
    Yin, Minghao
    Zhang, Bangzuo
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (06): : 5510 - 5527
  • [10] An Attribute-Aware Attentive GCN Model for Attribute Missing in Recommendation
    Liu, Fan
    Cheng, Zhiyong
    Zhu, Lei
    Liu, Chenghao
    Nie, Liqiang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (09) : 4077 - 4088