Attribute-Aware Pedestrian Detection in a Crowd

被引:43
|
作者
Zhang, Jialiang [1 ]
Lin, Lixiang [1 ]
Zhu, Jianke [1 ,2 ]
Li, Yang [1 ]
Chen, Yun-chen [3 ]
Hu, Yao [4 ]
Hoi, Steven C. H. [3 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
[2] Alibaba Zhejiang Univ Joint Res Inst Frontier Tec, Hangzhou 310027, Peoples R China
[3] Singapore Management Univ, Sch Informat Syst, Singapore 178902, Singapore
[4] Co Alibaba, Youku Cognit & Intelligent Lab, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Detectors; Semantics; Feature extraction; Proposals; Object detection; Task analysis; Training; Attribute-aware; non-maximum suppression (nms); pedestrian detection;
D O I
10.1109/TMM.2020.3020691
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Pedestrian detection is an initial step to perform outdoor scene analysis, which plays an essential role in many real-world applications. Although having enjoyed the merits of deep learning frameworks from the generic object detectors, pedestrian detection is still a very challenging task due to heavy occlusions, and highly crowded group. Generally, the conventional detectors are unable to differentiate individuals from each other effectively under such a dense environment. To tackle this critical problem, we propose an attribute-aware pedestrian detector to explicitly model people's semantic attributes in a high-level feature detection fashion. Besides the typical semantic features, center position, target's scale, and offset, we introduce a pedestrian-oriented attribute feature to encode the high-level semantic differences among the crowd. Moreover, a novel attribute-feature-based Non-Maximum Suppression (NMS) is proposed to distinguish the person from a highly overlapped group by adaptively rejecting the false-positive results in a very crowd settings. Furthermore, an enhanced ground truth target is designed to alleviate the difficulties caused by the attribute configuration, and to ease the class imbalance issue during training. Finally, we evaluate our proposed attribute-aware pedestrian detector on three benchmark datasets including CityPerson, CrowdHuman, and EuroCityPerson, and achieves the state-of-the-art results.
引用
收藏
页码:3085 / 3097
页数:13
相关论文
共 50 条
  • [21] Circle & Search: Attribute-Aware Shoe Retrieval
    Huang, Junshi
    Liu, Si
    Xing, Junliang
    Mei, Tao
    Yan, Shuicheng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2014, 11 (01)
  • [22] Attribute-aware multi-task recommendation
    Wang, Suhua
    Zhang, Lisa
    Yu, Mengying
    Wang, Yuling
    Ma, Zhiqiang
    Zhao, Yu
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (05): : 4419 - 4437
  • [23] Sensitivity of attributes on the performance of attribute-aware collaborative filtering
    Tso, Karen H. L.
    Schmidt-Thieme, Lars
    DATA ANALYSIS, CLASSIFICATION AND THE FORWARD SEARCH, 2006, : 279 - +
  • [24] Finding Attribute-aware Similar Regions for Data Analysis
    Feng, Kaiyu
    Cong, Gao
    Jensen, Christian S.
    Guo, Tao
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2019, 12 (11): : 1414 - 1426
  • [25] AAFACE: ATTRIBUTE-AWARE ATTENTIONAL NETWORK FOR FACE RECOGNITION
    Talemi, Niloufar Alipour
    Kashiani, Hossein
    Malakshan, Sahar Rahimi
    Saadabadi, Mohammad Saeed Ebrahimi
    Najafzadeh, Nima
    Akyash, Mohammad
    Nasrabadi, Nasser M.
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1940 - 1944
  • [26] RadViz Deluxe: An Attribute-Aware Display for Multivariate Data
    Cheng, Shenghui
    Xu, Wei
    Mueller, Klaus
    PROCESSES, 2017, 5 (04)
  • [27] Item Attribute-Aware Contrastive Learning for Sequential Recommendation
    Yan, Bing
    Wang, Huaxing
    Ouyang, Zijie
    Chen, Chao
    Xia, Yang
    IEEE ACCESS, 2023, 11 (70795-70804): : 70795 - 70804
  • [28] Attribute Aware Pooling for Pedestrian Attribute Recognition
    Han, Kai
    Wang, Yunhe
    Shu, Han
    Liu, Chuanjian
    Xu, Chunjing
    Xu, Chang
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2456 - 2462
  • [29] Attribute-aware interpretation learning for thyroid ultrasound diagnosis
    Kong, Ming
    Guo, Qing
    Zhou, Shuowen
    Li, Mengze
    Kuang, Kun
    Huang, Zhengxing
    Wu, Fei
    Chen, Xiaohong
    Zhu, Qiang
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2022, 131
  • [30] Attribute-Aware Feature Encoding for Object Recognition and Segmentation
    Yang, Shu
    Wang, Yaowei
    Chen, Ke
    Zeng, Wei
    Fei, Zesong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 24 : 3611 - 3623