Multi-density map fusion network for crowd counting

被引:7
|
作者
Wang, Yongjie [1 ,3 ]
Zhang, Wei [1 ]
Liu, Yanyan [2 ]
Zhu, Jianghua [3 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin 300072, Peoples R China
[2] Nankai Univ, Key Lab Photoelect Thin Film Devices & Technol Ti, Tianjin 300350, Peoples R China
[3] China Elect Technol Grp Corp, Res Inst 54, Shijiazhuang 050081, Hebei, Peoples R China
关键词
Multi-density map; Multi-branch; Relative weights; Crowd counting;
D O I
10.1016/j.neucom.2020.02.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In crowed scene, its hard to get the exact number of people due to the distorted perspectives, complex backgrounds, and scale changes. People in different locations have different sizes and dimensions in an image. To deal with this problem, we propose a new multi-density map fusion method to learn the mapping from the input image to the density map. Different form previous methods, our method mainly focuses on fusing different density maps information instead of fusing multi-scale feature of the same images. The major contributions are three paralleled branches and dynamic weighting strategy. First, our network employs the first ten layers of VGG16, and the network is combined with three paralleled branches. Each branch of our network extracts image information at different scales and each branch outputs a density map. Second, to ensure the quality of the final density map, we employ learnable relative weights to fuse the three density maps. Our method has been proved more robust than many state-of-art methods. Lots of experiments have been done in the ShanghaiTech, WorldExpo10, UCSD and UCF_CC_50 dataset to show the effectiveness of our proposed method. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:31 / 38
页数:8
相关论文
共 50 条
  • [1] Two-branch fusion network with attention map for crowd counting
    Wang, Yongjie
    Zhang, Wei
    Liu, Yanyan
    Zhu, Jianghua
    [J]. NEUROCOMPUTING, 2020, 411 (411) : 1 - 8
  • [2] Multi-level feature fusion network for crowd counting
    Wang, Luyang
    Li, Yun
    Peng, Sifan
    Tang, Xiao
    Yin, Baoqun
    [J]. IET COMPUTER VISION, 2021, 15 (01) : 60 - 72
  • [3] Crowd Counting and Localization Beyond Density Map
    Khan, Akbar
    Kadir, Kushsairy
    Nasir, Haidawati
    Shah, Jawad Ali
    Albattah, Waleed
    Khan, Sheroz
    Kakakhel, Muhammad Haris
    [J]. IEEE ACCESS, 2022, 10 : 133142 - 133151
  • [4] Adaptive Density Map Generation for Crowd Counting
    Wan, Jia
    Chan, Antoni
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1130 - 1139
  • [5] Double multi-scale feature fusion network for crowd counting
    Liu, Qian
    Fang, Jiongtao
    Zhong, Yixiong
    Wang, Cunbao
    Qi, Youwei
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 34 (81831-81855)
  • [6] Crowd counting method via a dynamic-refined density map network
    Cao, Guo
    Liu, Yanbo
    Ge, Zixian
    Hu, Yingxiang
    [J]. NEUROCOMPUTING, 2022, 497 : 191 - 203
  • [7] Fully Convolutional Network for Crowd Size Estimation by Density Map and Counting Regression
    Wu, Bing-Fei
    Lin, Chun-Hsien
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 2170 - 2175
  • [8] A crowd counting method via density map and counting residual estimation
    Li Yang
    Yanqun Guo
    Jun Sang
    Weiqun Wu
    Zhongyuan Wu
    Qi Liu
    Xiaofeng Xia
    [J]. Multimedia Tools and Applications, 2022, 81 : 43503 - 43512
  • [9] A crowd counting method via density map and counting residual estimation
    Yang, Li
    Guo, Yanqun
    Sang, Jun
    Wu, Weiqun
    Wu, Zhongyuan
    Liu, Qi
    Xia, Xiaofeng
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) : 43503 - 43512
  • [10] Context Attention Fusion Network for crowd counting
    Wang, Tao
    Zhang, Ting
    Zhang, Kaibing
    Wang, Huake
    Li, Minqi
    Lu, Jian
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 271