YOLO-AMM: A Real-Time Classroom Behavior Detection Algorithm Based on Multi-Dimensional Feature Optimization

被引:0
|
作者
Cao, Yi [1 ]
Cao, Qian [2 ]
Qian, Chengshan [1 ,2 ]
Chen, Deji [1 ,3 ]
机构
[1] Wuxi Univ, Sch Internet Things Engn, Wuxi 214105, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[3] Jiangsu Foreign Expert Lab, Wuxi 214105, Peoples R China
关键词
YOLOv8; classroom behavior detection; AEFF; MFFN;
D O I
10.3390/s25041142
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Classroom behavior detection is a key task in constructing intelligent educational environments. However, the existing models are still deficient in detail feature capture capability, multi-layer feature correlation, and multi-scale target adaptability, making it challenging to realize high-precision real-time detection in complex scenes. This paper proposes an improved classroom behavior detection algorithm, YOLO-AMM, to solve these problems. Firstly, we constructed the Adaptive Efficient Feature Fusion (AEFF) module to enhance the fusion of semantic information between different features and improve the model's ability to capture detailed features. Then, we designed a Multi-dimensional Feature Flow Network (MFFN), which fuses multi-dimensional features and enhances the correlation information between features through the multi-scale feature aggregation module and contextual information diffusion mechanism. Finally, we proposed a Multi-Scale Perception and Fusion Detection Head (MSPF-Head), which significantly improves the adaptability of the head to different scale targets by introducing multi-scale feature perception, feature interaction, and fusion mechanisms. The experimental results showed that compared with the YOLOv8n model, YOLO-AMM improved the mAP0.5 and mAP0.5-0.95 by 3.1% and 4.0%, significantly improving the detection accuracy. Meanwhile, YOLO-AMM increased the detection speed (FPS) by 12.9 frames per second to 169.1 frames per second, which meets the requirement for real-time detection of classroom behavior.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Multi-Dimensional Scheduling for Real-Time Tasks on Heterogeneous Clusters
    Zhu, Xiao-Min
    Lu, Pei-Zhong
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2009, 24 (03) : 434 - 446
  • [32] A Real-Time Video Flame Detection Algorithm Based on Improved Yolo-v3
    Zhao Y.
    Zhu J.
    Xie Y.
    Li W.
    Guo Y.
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2021, 46 (03): : 326 - 334
  • [33] Real-time behavior detection and judgment of egg breeders based on YOLO v3
    Juan Wang
    Nan Wang
    Lihua Li
    Zhenhui Ren
    Neural Computing and Applications, 2020, 32 : 5471 - 5481
  • [34] Real-time behavior detection and judgment of egg breeders based on YOLO v3
    Wang, Juan
    Wang, Nan
    Li, Lihua
    Ren, Zhenhui
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (10): : 5471 - 5481
  • [35] Time Series Classification Based on Multi-Dimensional Feature Fusion
    Quan, Shuo
    Sun, Mengyu
    Zeng, Xiangyu
    Wang, Xuliang
    Zhu, Zeya
    IEEE ACCESS, 2023, 11 : 11066 - 11077
  • [36] Real-time multi-feature based fire flame detection in video
    Chi, Rui
    Lu, Zhe-Ming
    Ji, Qing-Ge
    IET IMAGE PROCESSING, 2017, 11 (01) : 31 - 37
  • [37] Analyzing Real-Time Object Detection with YOLO Algorithm in Automotive Applications: A Review
    Gheorghe, Carmen
    Duguleana, Mihai
    Boboc, Razvan Gabriel
    Postelnicu, Cristian Cezar
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 141 (03): : 1939 - 1981
  • [38] Real-Time Conveyor Belt Deviation Detection Algorithm Based on Multi-Scale Feature Fusion Network
    Zeng, Chan
    Zheng, Junfeng
    Li, Jiangyun
    ALGORITHMS, 2019, 12 (10)
  • [39] YOLO-MPAM: Efficient real-time neural networks based on multi-channel feature fusion
    Yu, Boyang
    Li, Zixuan
    Cao, Yue
    Wu, Celimuge
    Qi, Jin
    Wu, Libing
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [40] Real-time sewer defect detection based on YOLO network, transfer learning, and channel pruning algorithm
    Zuxiang Situ
    Shuai Teng
    Xiaoting Liao
    Gongfa Chen
    Qianqian Zhou
    Journal of Civil Structural Health Monitoring, 2024, 14 : 41 - 57