YOLO-AMM: A Real-Time Classroom Behavior Detection Algorithm Based on Multi-Dimensional Feature Optimization

被引:0
|
作者
Cao, Yi [1 ]
Cao, Qian [2 ]
Qian, Chengshan [1 ,2 ]
Chen, Deji [1 ,3 ]
机构
[1] Wuxi Univ, Sch Internet Things Engn, Wuxi 214105, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[3] Jiangsu Foreign Expert Lab, Wuxi 214105, Peoples R China
关键词
YOLOv8; classroom behavior detection; AEFF; MFFN;
D O I
10.3390/s25041142
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Classroom behavior detection is a key task in constructing intelligent educational environments. However, the existing models are still deficient in detail feature capture capability, multi-layer feature correlation, and multi-scale target adaptability, making it challenging to realize high-precision real-time detection in complex scenes. This paper proposes an improved classroom behavior detection algorithm, YOLO-AMM, to solve these problems. Firstly, we constructed the Adaptive Efficient Feature Fusion (AEFF) module to enhance the fusion of semantic information between different features and improve the model's ability to capture detailed features. Then, we designed a Multi-dimensional Feature Flow Network (MFFN), which fuses multi-dimensional features and enhances the correlation information between features through the multi-scale feature aggregation module and contextual information diffusion mechanism. Finally, we proposed a Multi-Scale Perception and Fusion Detection Head (MSPF-Head), which significantly improves the adaptability of the head to different scale targets by introducing multi-scale feature perception, feature interaction, and fusion mechanisms. The experimental results showed that compared with the YOLOv8n model, YOLO-AMM improved the mAP0.5 and mAP0.5-0.95 by 3.1% and 4.0%, significantly improving the detection accuracy. Meanwhile, YOLO-AMM increased the detection speed (FPS) by 12.9 frames per second to 169.1 frames per second, which meets the requirement for real-time detection of classroom behavior.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Pest-YOLO: Deep Image Mining and Multi-Feature Fusion for Real-Time Agriculture Pest Detection
    Tang, Zhe
    Chen, Zhengyun
    Qi, Fang
    Zhang, Lingyan
    Chen, Shuhong
    2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, : 1348 - 1353
  • [42] Real-time sewer defect detection based on YOLO network, transfer learning, and channel pruning algorithm
    Situ, Zuxiang
    Teng, Shuai
    Liao, Xiaoting
    Chen, Gongfa
    Zhou, Qianqian
    JOURNAL OF CIVIL STRUCTURAL HEALTH MONITORING, 2024, 14 (01) : 41 - 57
  • [43] TTD-YOLO: A Real-Time Traffic Target Detection Algorithm Based on YOLOV5
    Xia, Wenjun
    Li, Peiqing
    Huang, Heyu
    Li, Qipeng
    Yang, Taiping
    Li, Zhuoran
    IEEE ACCESS, 2024, 12 : 66419 - 66431
  • [44] Real-Time Detection based on Modified YOLO for Herniated Intervertebral Discs
    Zhong, Zhenxiao
    Deng, Jianzhi
    2019 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION PROCESSING (ICIIP 2019), 2019, : 467 - 471
  • [45] Real-Time Human Ear Detection Based on the Joint of Yolo and RetinaFace
    Huy Nguyen Quoc
    Vinh Truong Hoang
    COMPLEXITY, 2021, 2021 (2021)
  • [46] Real-time monitoring and visualization of the multi-dimensional motion of an anisotropic nanoparticle
    Gi-Hyun Go
    Seungjin Heo
    Jong-Hoi Cho
    Yang-Seok Yoo
    MinKwan Kim
    Chung-Hyun Park
    Yong-Hoon Cho
    Scientific Reports, 7
  • [47] A Real-Time Multi-Dimensional Visualization Framework For Critical And Complex Environments
    Kamaleswaran, Rishikesan
    McGregor, Carolyn
    2014 IEEE 27TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2014, : 325 - 328
  • [48] Real-time detection algorithm for non-motorized vehicles based on D-YOLO model
    Li, Yushan
    Ding, Hongwei
    Hu, Peng
    Yang, Zhijun
    Wang, Guanbo
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (22) : 61673 - 61696
  • [49] Real-Time Image Based Weapon Detection Using YOLO Algorithms
    Gali, Manoj
    Dhavale, Sunita
    Kumar, Suresh
    ADVANCES IN COMPUTING AND DATA SCIENCES (ICACDS 2022), PT II, 2022, 1614 : 173 - 185
  • [50] Framework for Stochastic Modelling of Multi-Dimensional Real-time Sensor Data
    Mohaar, Gurpreet
    Maleque, Muhtasim
    Singh, Ramanpreet
    2015 10TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND KNOWLEDGE ENGINEERING (ISKE), 2015, : 244 - 251