Crowd counting via Multi-Scale Adversarial Convolutional Neural Networks

被引:3
|
作者
Zhu, Liping [1 ]
Zhang, Hong [1 ]
Ali, Sikandar [1 ]
Yang, Baoli [1 ]
Li, Chengyang [1 ]
机构
[1] China Univ Petr, Beijing Key Lab Petr Data Min, Beijing 10224, Peoples R China
关键词
Crowd counting; Multi-Scale; Crowd density estimation; Density map;
D O I
10.1515/jisys-2019-0157
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of crowd counting is to estimate the number of pedestrians in crowd images. Crowd counting or density estimation is an extremely challenging task in computer vision, due to large scale variations and dense scene. Current methods solve these issues by compounding multi-scale Convolutional Neural Network with different receptive fields. In this paper, a novel end-to-end architecture based on Multi-Scale Adversarial Convolutional Neural Network (MSA-CNN) is proposed to generate crowd density and estimate the amount of crowd. Firstly, a multi-scale network is used to extract the globally relevant features in the crowd image, and then fractionally-strided convolutional layers are designed for up-sampling the output to recover the loss of crucial details caused by the earlier max pooling layers. An adversarial loss is directly employed to shrink the estimated value into the realistic subspace to reduce the blurring effect of density estimation. Joint training is performed in an end-to-end fashion using a combination of Adversarial loss and Euclidean loss. The two losses are integrated via a joint training scheme to improve density estimation performance. We conduct some extensive experiments on available datasets to show the significant improvements and supremacy of the proposed approach over the available state-of-the-art approaches.
引用
收藏
页码:180 / 191
页数:12
相关论文
共 50 条
  • [1] MULTI-SCALE CONVOLUTIONAL NEURAL NETWORKS FOR CROWD COUNTING
    Zeng, Lingke
    Xu, Xiangmin
    Cai, Bolun
    Qiu, Suo
    Zhang, Tong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 465 - 469
  • [2] Crowd Counting via Residual Multi-scale Convolutional Neural Network
    Lu, Jingang
    Zhang, Li
    2019 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2019, : 315 - 320
  • [3] Multi-scale Generative Adversarial Networks for Crowd Counting
    Yang, Jianxing
    Zhou, Yuan
    Kung, Sun-Yuan
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 3244 - 3249
  • [4] Multi-scale dilated convolution of convolutional neural network for crowd counting
    Yanjie Wang
    Shiyu Hu
    Guodong Wang
    Chenglizhao Chen
    Zhenkuan Pan
    Multimedia Tools and Applications, 2020, 79 : 1057 - 1073
  • [5] End to End Multi-Scale Convolutional Neural Network for Crowd Counting
    Ji, Deyi
    Lu, Hongtao
    Zhang, Tongzhen
    ELEVENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2018), 2019, 11041
  • [6] Multi-scale dilated convolution of convolutional neural network for crowd counting
    Wang, Yanjie
    Hu, Shiyu
    Wang, Guodong
    Chen, Chenglizhao
    Pan, Zhenkuan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (1-2) : 1057 - 1073
  • [7] Improving Crowd Counting with Multi-task Multi-scale Convolutional Neural Network
    Tang, Siqi
    Wu, Yijia
    Bai, Wei
    Pan, Zhisong
    2018 EIGHTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC 2018), 2018, : 468 - 473
  • [8] Encoding-Decoding Multi-Scale Convolutional Neural Network for Crowd Counting
    Meng Y.
    Ji T.
    Liu G.
    Xu S.
    Li T.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2020, 54 (05): : 149 - 157
  • [9] LigMSANet: Lightweight multi-scale adaptive convolutional neural network for dense crowd counting
    Jiang, Guoquan
    Wu, Rui
    Huo, Zhanqiang
    Zhao, Cuijun
    Luo, Junwei
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 197
  • [10] Redesigning Multi-Scale Neural Network for Crowd Counting
    Du, Zhipeng
    Shi, Miaojing
    Deng, Jiankang
    Zafeiriou, Stefanos
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 3664 - 3678