YOLO-AMM: A Real-Time Classroom Behavior Detection Algorithm Based on Multi-Dimensional Feature Optimization

被引:0
|
作者
Cao, Yi [1 ]
Cao, Qian [2 ]
Qian, Chengshan [1 ,2 ]
Chen, Deji [1 ,3 ]
机构
[1] Wuxi Univ, Sch Internet Things Engn, Wuxi 214105, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[3] Jiangsu Foreign Expert Lab, Wuxi 214105, Peoples R China
关键词
YOLOv8; classroom behavior detection; AEFF; MFFN;
D O I
10.3390/s25041142
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Classroom behavior detection is a key task in constructing intelligent educational environments. However, the existing models are still deficient in detail feature capture capability, multi-layer feature correlation, and multi-scale target adaptability, making it challenging to realize high-precision real-time detection in complex scenes. This paper proposes an improved classroom behavior detection algorithm, YOLO-AMM, to solve these problems. Firstly, we constructed the Adaptive Efficient Feature Fusion (AEFF) module to enhance the fusion of semantic information between different features and improve the model's ability to capture detailed features. Then, we designed a Multi-dimensional Feature Flow Network (MFFN), which fuses multi-dimensional features and enhances the correlation information between features through the multi-scale feature aggregation module and contextual information diffusion mechanism. Finally, we proposed a Multi-Scale Perception and Fusion Detection Head (MSPF-Head), which significantly improves the adaptability of the head to different scale targets by introducing multi-scale feature perception, feature interaction, and fusion mechanisms. The experimental results showed that compared with the YOLOv8n model, YOLO-AMM improved the mAP0.5 and mAP0.5-0.95 by 3.1% and 4.0%, significantly improving the detection accuracy. Meanwhile, YOLO-AMM increased the detection speed (FPS) by 12.9 frames per second to 169.1 frames per second, which meets the requirement for real-time detection of classroom behavior.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Real-time airplane detection using multi-dimensional attention and feature fusion
    Li, Li
    Peng, Na
    Li, Bingxue
    Liu, Hao
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [2] Csb-yolo: a rapid and efficient real-time algorithm for classroom student behavior detection
    Zhu, Wenqi
    Yang, Zhijun
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (04)
  • [3] Real-time airplane detection using multi-dimensional attention and feature fusion
    Li L.
    Peng N.
    Li B.
    Liu H.
    PeerJ Computer Science, 2023, 9 : 1 - 20
  • [4] Real-Time Multi-Class Disturbance Detection for Φ-OTDR Based on YOLO Algorithm
    Xu, Weijie
    Yu, Feihong
    Liu, Shuaiqi
    Xiao, Dongrui
    Hu, Jie
    Zhao, Fang
    Lin, Weihao
    Wang, Guoqing
    Shen, Xingliang
    Wang, Weizhi
    Wang, Feng
    Liu, Huanhuan
    Shum, Perry Ping
    Shao, Liyang
    SENSORS, 2022, 22 (05)
  • [5] Research on Student Classroom Behavior Detection Based on the Real-Time Detection Transformer Algorithm
    Lin, Lihua
    Yang, Haodong
    Xu, Qingchuan
    Xue, Yanan
    Li, Dan
    APPLIED SCIENCES-BASEL, 2024, 14 (14):
  • [6] Real-time face detection based on YOLO
    Wang Yang
    Zheng Jiachun
    PROCEEDINGS OF THE 2018 1ST IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE INNOVATION AND INVENTION (ICKII 2018), 2018, : 221 - 224
  • [7] YOLO-V3 based real-time drone detection algorithm
    Hamid R. Alsanad
    Amin Z Sadik
    Osman N. Ucan
    Muhammad Ilyas
    Oguz Bayat
    Multimedia Tools and Applications, 2022, 81 : 26185 - 26198
  • [8] YOLO-V3 based real-time drone detection algorithm
    Alsanad, Hamid R.
    Sadik, Amin Z.
    Ucan, Osman N.
    Ilyas, Muhammad
    Bayat, Oguz
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (18) : 26185 - 26198
  • [9] The Real-Time Detection of Traffic Participants Using YOLO Algorithm
    Corovic, Aleksa
    Ilic, Velibor
    Duric, Sinisa
    Marijan, Malisa
    Pavkovic, Bogdan
    2018 26TH TELECOMMUNICATIONS FORUM (TELFOR), 2018, : 731 - 734
  • [10] Region Boosting for Real-Time Object Detection Using Multi-Dimensional Attention
    Chen, Jinlong
    Xu, Kejian
    Ning, Yi
    Xu, Zhi
    IEEE ACCESS, 2024, 12 : 171634 - 171643