Vehicle counting in drone images: An adaptive method with spatial attention and multiscale receptive fields

被引:0
|
作者
Liu, Yu [1 ]
Shen, Hang [1 ]
Wang, Tianjing [1 ]
Bai, Guangwei [1 ]
机构
[1] Nanjing Tech Univ, Coll Artificial Intelligence, Coll Comp & Informat Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
attention mechanism; distribution awareness; multiscale receptive field; UAV imagery; vehicle counting;
D O I
10.4218/etrij.2023-0426
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose an altitude-adaptive vehicle counting method with an attention mechanism and multiscale receptive fields that optimizes the measurement accuracy and inference latency of unmanned aerial vehicle (UAV) images. An attention mechanism is used to aggregate horizontal and vertical feature weights to enhance spatial information and suppress background noise. The UAV flight altitude and shooting depression angle are considered for scale division and image segmentation to avoid acquiring distance measurements. Based on the dilation rate, we introduce a receptive field selection strategy for the trained model to exhibit scale generalization without redundant calculations. A distribution-aware block loss is optimized via k$$ k $$ roots to balance the loss of sparse and crowded regions by dividing the density map. Experiments on three authoritative datasets demonstrate that compared with CSRNet, the proposed method improves the mean absolute error by 29.4%-54.0% and mean squared error by 28.6%-41.2% while reducing the inference latency. The proposed method exhibits higher counting accuracy than lightweight models including MCNN and MobileCount.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] MASFF: Multiscale Adaptive Spatial Feature Fusion Method for Vehicle Recognition
    Zhang, Jiefei
    Journal of Computers (Taiwan), 2022, 33 (01) : 1 - 11
  • [2] Multiscale Receptive Fields Graph Attention Network for Point Cloud Classification
    Li, Xi-An
    Wang, Li-Yan
    Lu, Jian
    COMPLEXITY, 2021, 2021
  • [3] Adaptive changes in cortical receptive fields induced by attention to complex sounds
    Fritz, Jonathan B.
    Elhilali, Mounya
    Shamma, Shihab A.
    JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (04) : 2337 - 2346
  • [4] Spatial structure of complex cell receptive fields measured with natural images
    Touryan, J
    Felsen, G
    Dan, Y
    NEURON, 2005, 45 (05) : 781 - 791
  • [5] Dynamic shifts of visual receptive fields in cortical area MT by spatial attention
    Womelsdorf, Thilo
    Anton-Erxleben, Katharina
    Pieper, Florian
    Treue, Stefan
    NATURE NEUROSCIENCE, 2006, 9 (09) : 1156 - 1160
  • [6] BARNet: Bilinear Attention Network with Adaptive Receptive Fields for Surgical Instrument Segmentation
    Ni, Zhen-Liang
    Bian, Gui-Bin
    Wang, Guan-An
    Zhou, Xiao-Hu
    Hou, Zeng-Guang
    Xie, Xiao-Liang
    Li, Zhen
    Wang, Yu-Han
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 832 - 838
  • [7] Attentional attraction of receptive fields can explain spatial and temporal effects of attention
    Baruch, Orit
    Yeshurun, Yaffa
    VISUAL COGNITION, 2014, 22 (05) : 704 - 736
  • [8] Dynamic shifts of visual receptive fields in cortical area MT by spatial attention
    Thilo Womelsdorf
    Katharina Anton-Erxleben
    Florian Pieper
    Stefan Treue
    Nature Neuroscience, 2006, 9 : 1156 - 1160
  • [9] Entorhinal cortex receptive fields are modulated by spatial attention, even without movement
    Wilming, Niklas
    Koenig, Peter
    Koenig, Seth
    Buffalo, Elizabeth A.
    ELIFE, 2018, 7
  • [10] Water Retrieval Embedded Attention Network With Multiscale Receptive Fields for Hyperspectral Image Refined Classification
    Liang, Xuejian
    Zhang, Ye
    Zhang, Junping
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60