Object Detection Algorithm Based on Context Information and Self-Attention Mechanism

被引:6
|
作者
Liang, Hong [1 ]
Zhou, Hui [1 ]
Zhang, Qian [1 ]
Wu, Ting [1 ]
机构
[1] China Univ Petr, Sch Comp Sci & Technol, Qingdao 266580, Peoples R China
来源
SYMMETRY-BASEL | 2022年 / 14卷 / 05期
关键词
object detection; self-attention; context; anchor-free; NETWORKS;
D O I
10.3390/sym14050904
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Pursuing an object detector with good detection accuracy while ensuring detection speed has always been a challenging problem in object detection. This paper proposes a multi-scale context information fusion model combined with a self-attention block (CSA-Net). First, an improved backbone network ResNet-SA is designed with self-attention to reduce the interference of the image background area and focus on the object region. Second, this work introduces a receptive field feature enhancement module (RFFE) to combine local and global features while increasing the receptive field. Then this work adopts a spatial feature fusion pyramid with a symmetrical structure, which fuses and transfers semantic information and feature information. Finally, a sibling detection head using an anchor-free detection mechanism is applied to increase the accuracy and speed of detection at the end of the model. A large number of experiments support the above analysis and conclusions. Our model achieves an average accuracy of 46.8% on the COCO 2017 test set.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] UAV image object detection based on self-attention guidance and global feature fusion
    Bai, Jing
    Hu, Haiyang
    Liu, Xiaojing
    Zhuang, Shanna
    Wang, Zhengyou
    [J]. Image and Vision Computing, 2024, 151
  • [32] A small object detection architecture with concatenated detection heads and multi-head mixed self-attention mechanism
    Mu, Jianhong
    Su, Qinghua
    Wang, Xiyu
    Liang, Wenhui
    Xu, Sheng
    Wan, Kaizheng
    [J]. Journal of Real-Time Image Processing, 2024, 21 (06)
  • [33] Pyramid self-attention mechanism-based change detection in hyperspectral imagery
    Wang, Guanghui
    Peng, Yaoyao
    Zhang, Shubi
    Wang, Geng
    Zhang, Tao
    Qi, Jianwei
    Zheng, Shulei
    Liu, Yu
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2021, 15 (04)
  • [34] Object Detection Model Based on Scene-Level Region Proposal Self-Attention
    Quan, Yu
    Li, Zhixin
    Zhang, Canlong
    Ma, Huifang
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 954 - 961
  • [35] Dual-Mode Serial Night Road Object Detection Model Based on Depthwise Separable and Self-Attention Mechanism
    Yang, Qin
    Ma, Yahong
    Li, Linsen
    Zhao, Zeyu
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 9
  • [36] A feature detection network based on self-attention mechanism for underwater image processing
    Wu, Di
    Su, Boxun
    Hao, Lichao
    Wang, Ye
    Zhang, Liukun
    Yan, Zheping
    [J]. OCEAN ENGINEERING, 2024, 311
  • [37] An Image Change Detection Algorithm Based on Multi-Feature Self-Attention Fusion Mechanism UNet Network
    Alimjan, Gulnaz
    Jiaermuhamaiti, Yiliyaer
    Jumahong, Huxidan
    Zhu, Shuangling
    Nurmamat, Pazilat
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (14)
  • [38] A Self-Attention Mechanism-Based Model for Early Detection of Fake News
    Jamshidi, Bahman
    Hakak, Saqib
    Lu, Rongxing
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04) : 5241 - 5252
  • [39] Feature Envy Detection based on Bi-LSTM with Self-Attention Mechanism
    Wang, Hongze
    Liu, Jing
    Kang, JieXiang
    Yin, Wei
    Sun, Haiying
    Wang, Hui
    [J]. 2020 IEEE INTL SYMP ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, INTL CONF ON BIG DATA & CLOUD COMPUTING, INTL SYMP SOCIAL COMPUTING & NETWORKING, INTL CONF ON SUSTAINABLE COMPUTING & COMMUNICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2020), 2020, : 448 - 457
  • [40] SA-Det3D: Self-Attention Based Context-Aware 3D Object Detection
    Bhattacharyya, Prarthana
    Huang, Chengjie
    Czarnecki, Krzysztof
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 3022 - 3031