Attribute-Aware Pedestrian Detection in a Crowd

被引:43
|
作者
Zhang, Jialiang [1 ]
Lin, Lixiang [1 ]
Zhu, Jianke [1 ,2 ]
Li, Yang [1 ]
Chen, Yun-chen [3 ]
Hu, Yao [4 ]
Hoi, Steven C. H. [3 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
[2] Alibaba Zhejiang Univ Joint Res Inst Frontier Tec, Hangzhou 310027, Peoples R China
[3] Singapore Management Univ, Sch Informat Syst, Singapore 178902, Singapore
[4] Co Alibaba, Youku Cognit & Intelligent Lab, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Detectors; Semantics; Feature extraction; Proposals; Object detection; Task analysis; Training; Attribute-aware; non-maximum suppression (nms); pedestrian detection;
D O I
10.1109/TMM.2020.3020691
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Pedestrian detection is an initial step to perform outdoor scene analysis, which plays an essential role in many real-world applications. Although having enjoyed the merits of deep learning frameworks from the generic object detectors, pedestrian detection is still a very challenging task due to heavy occlusions, and highly crowded group. Generally, the conventional detectors are unable to differentiate individuals from each other effectively under such a dense environment. To tackle this critical problem, we propose an attribute-aware pedestrian detector to explicitly model people's semantic attributes in a high-level feature detection fashion. Besides the typical semantic features, center position, target's scale, and offset, we introduce a pedestrian-oriented attribute feature to encode the high-level semantic differences among the crowd. Moreover, a novel attribute-feature-based Non-Maximum Suppression (NMS) is proposed to distinguish the person from a highly overlapped group by adaptively rejecting the false-positive results in a very crowd settings. Furthermore, an enhanced ground truth target is designed to alleviate the difficulties caused by the attribute configuration, and to ease the class imbalance issue during training. Finally, we evaluate our proposed attribute-aware pedestrian detector on three benchmark datasets including CityPerson, CrowdHuman, and EuroCityPerson, and achieves the state-of-the-art results.
引用
收藏
页码:3085 / 3097
页数:13
相关论文
共 50 条
  • [41] Attribute-Aware Convolutional Neural Networks for Facial Beauty Prediction
    Lin, Luojun
    Liang, Lingyu
    Jin, Lianwen
    Chen, Weijie
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 847 - 853
  • [42] Learning attentive attribute-aware node embeddings in dynamic environments
    Nourhan Ahmed
    Ahmed Rashed
    Lars Schmidt-Thieme
    International Journal of Data Science and Analytics, 2024, 17 : 189 - 201
  • [43] Attribute-aware style adaptation for person re-identification
    Qu, Xiaofeng
    Liu, Li
    Zhu, Lei
    Zhang, Huaxiang
    MULTIMEDIA SYSTEMS, 2023, 29 (02) : 469 - 485
  • [44] AERM: An Attribute-Aware Economic Robust Spectrum Auction Mechanism
    Zhu, Zhuoming
    Wang, Shengling
    Bie, Rongfang
    Cheng, Xiuzhen
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT III, 2021, 12939 : 142 - 153
  • [45] Generating Evolving Property Graphs with Attribute-Aware Preferential Attachment
    Aghasadeghi, Amir
    Stoyanovich, Julia
    DBTEST'18: PROCEEDINGS OF THE WORKSHOP ON TESTING DATABASE SYSTEMS, 2018,
  • [46] An Attribute-aware Neural Attentive Model for Next Basket Recommendation
    Bai, Ting
    Nie, Jian-Yun
    Zhao, Wayne Xin
    Zhu, Yutao
    Du, Pan
    Wen, Ji-Rong
    ACM/SIGIR PROCEEDINGS 2018, 2018, : 1201 - 1204
  • [47] ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models
    Zhang, Yuxin
    Dong, Weiming
    Tang, Fan
    Huang, Nisha
    Huang, Haibin
    Ma, Chongyang
    Lee, Tong-Yee
    Deussen, Oliver
    Xu, Changsheng
    ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (06):
  • [48] Privileged multi-task learning for attribute-aware aesthetic assessment
    Shu, Yangyang
    Li, Qian
    Liu, Lingqiao
    Xu, Guandong
    PATTERN RECOGNITION, 2022, 132
  • [49] Improving singing voice separation using attribute-aware deep network
    Swaminathan, Rupak Vignesh
    Lerch, Alexander
    2019 INTERNATIONAL WORKSHOP ON MULTILAYER MUSIC REPRESENTATION AND PROCESSING (MMRP 2019), 2019, : 60 - 65
  • [50] Cross-view hypergraph contrastive learning for attribute-aware recommendation
    Ma, Ang
    Yu, Yanhua
    Shi, Chuan
    Guo, Zirui
    Chua, Tat-Seng
    INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (04)