OAF-Net: An Occlusion-Aware Anchor-Free Network for Pedestrian Detection in a Crowd

被引:18
|
作者
Li, Qiming [1 ,2 ]
Su, Yijing [1 ,2 ]
Gao, Yin [1 ,2 ]
Xie, Feng [3 ]
Li, Jun [1 ,2 ]
机构
[1] Chinese Acad Sci, Quanzhou Inst Equipment Mfg, Haixi Inst, Lab Robot & Intelligent Syst, Quanzhou 362216, Fujian, Peoples R China
[2] Fujian Sci & Technol, Innovat Lab Optoelect Informat China, Fuzhou 350108, Fujian, Peoples R China
[3] Inst Automat & Commun, Dept Traff & Assistance, D-39106 Magdeburg, Germany
基金
中国国家自然科学基金;
关键词
Detectors; Training; Feature extraction; Proposals; Avalanche photodiodes; Head; Benchmark testing; Pedestrian detection; occlusion-aware; anchor-free; crowd scenes; VEHICLE;
D O I
10.1109/TITS.2022.3171250
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Although pedestrian detection has achieved promising performance with the development of deep learning techniques, it remains a great challenge to detect heavily occluded pedestrians in crowd scenes. Therefore, to make the anchor-free network pay more attention to learning the hard examples of occluded pedestrians, we propose a simple but effective Occlusion-aware Anchor-Free Network (namely OAF-Net) for pedestrian detection in crowd scenes. Specifically, we first design a novel occlusion-aware detection head, which includes three separate center prediction branches combining with the scale and offset prediction branches. In the detection head of OAF-Net, occluded pedestrian instances are assigned to the most suitable center prediction branch according to the occlusion level of human body. To optimize the center prediction, we accordingly propose a novel weighted Focal Loss where pedestrian instances are assigned with different weights according to their visibility ratios, so that the occluded pedestrians are up-weighted during the training process. Our OAF-Net is able to model different occlusion levels of pedestrian instances effectively, and can be optimized towards catching a high-level understanding of the hard training samples of occluded pedestrians. Experiments on the challenging CityPersons, Caltech, and CrowdHuman benchmarks sufficiently validate the efficacy of our OAF-Net for pedestrian detection in crowd scenes.
引用
收藏
页码:21291 / 21300
页数:10
相关论文
共 50 条
  • [1] Occlusion-aware Pedestrian Detection
    Apostolopoulos, Christos
    Nasrollahi, Kamal
    Yang, M. -Hsuan
    Jahromi, Mohammad N. S.
    Moeslund, Thomas B.
    ELEVENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2018), 2019, 11041
  • [2] CFRLA-Net: A Context-Aware Feature Representation Learning Anchor-Free Network for Pedestrian Detection
    Li, Jun
    Bi, Yuquan
    Wang, Sumei
    Li, Qiming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4948 - 4961
  • [3] OADB-Net: An Occlusion-Aware Dual-Branch Network for Pedestrian Detection
    Li, Jun
    Chen, Tong
    Ji, Kangyou
    Li, Qiming
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (02) : 1617 - 1630
  • [4] Multiscale Anchor-Free Region Proposal Network for Pedestrian Detection
    Cao, Zhiwei
    Yang, Huihua
    Xu, Weijin
    Zhao, Juan
    Li, Lingqiao
    Pan, Xipeng
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [5] Anchor-free scale adaptive pedestrian detection algorithm
    Zou Y.-Q.
    Xiao Z.-H.
    Tang X.-F.
    Lai P.-J.
    Tang S.-L.
    Zhang Y.-X.
    Tang J.
    Kongzhi yu Juece/Control and Decision, 2021, 36 (02): : 295 - 302
  • [6] Occlusion-aware pedestrian detection combined with dual attention mechanism
    Zhou D.
    Song R.
    Yang X.
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2021, 53 (09): : 156 - 163
  • [7] Occluded pedestrian detection through bi-center prediction in anchor-free network
    Li, Qiming
    Bi, Yuquan
    Cai, Rongsheng
    Li, Jun
    NEUROCOMPUTING, 2022, 507 : 199 - 207
  • [8] CONet: Crowd and occlusion-aware network for occluded human pose estimation
    Bai, Xiuxiu
    Wei, Xing
    Wang, Zengying
    Zhang, Miao
    NEURAL NETWORKS, 2024, 172
  • [9] Towards Enforcing Social Distancing Regulations with Occlusion-Aware Crowd Detection
    Cong, Cong
    Yang, Zhichao
    Song, Yang
    Pagnucco, Maurice
    16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 297 - 302
  • [10] HDNet: A lightweight anchor-free pedestrian head detection algorithm
    Lin W.
    Shao J.
    Zhang N.
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2022, 52 (06): : 1152 - 1160