Hybrid Deep Learning for Human Fall Detection: A Synergistic Approach Using YOLOv8 and Time-Space Transformers

被引:0
|
作者
Sanjalawe, Yousef [1 ]
Fraihat, Salam [2 ]
Abualhaj, Mosleh [3 ]
Al-E'Mari, Salam R. [4 ]
Alzubi, Emran [5 ]
机构
[1] Univ Jordan JU, King Abdullah II Sch Informat Technol, Dept Informat Technol, Amman 11942, Jordan
[2] Ajman Univ, Coll Engn & Informat Technol, Artificial Intelligence Res Ctr AIRC, Ajman, U Arab Emirates
[3] Al Ahliyya Amman Univ, Fac Informat Technol, Dept Networks & Informat Secur, Amman 19328, Jordan
[4] Univ Petra, Fac Informat Technol, Informat Secur Dept, Amman 11196, Jordan
[5] Northern Border Univ NBU, Coll Business Adm, Ar Ar 91431, Saudi Arabia
来源
IEEE ACCESS | 2025年 / 13卷
关键词
Fall detection; Transformers; Real-time systems; Adaptation models; Monitoring; Lighting; Feature extraction; Deep learning; Computational modeling; Accuracy; Deep fall detection; CUCAFall; DiverseFALL10500; human detection; time-space transformers; YOLOv8; VISION;
D O I
10.1109/ACCESS.2025.3547914
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Falls are a major concern, particularly for elderly individuals and vulnerable populations, often leading to severe injuries if not detected promptly. Traditional sensor-based fall detection methods suffer from limitations such as discomfort, maintenance challenges, and susceptibility to false readings. To address these issues, we propose a hybrid deep learning-based system that leverages video-based techniques for accurate and efficient fall detection. Our approach integrates YOLOv8 for real-time human detection with Time-Space Transformers for temporal motion analysis, ensuring robust recognition of fall incidents while minimizing false positives and negatives. The proposed system is evaluated on two benchmark datasets, CUCAFall and DiverseFALL10500, which contain diverse and challenging environmental scenarios. Experimental results demonstrate that our model outperforms existing state-of-the-art methods, achieving a mean Average Precision (mAP) of 0.9955 on CUCAFall and 0.950 on DiverseFALL10500, along with F1-scores exceeding 0.998 for all classes in certain configurations. These results confirm the model's ability to distinguish fall events from normal activities accurately. Furthermore, the system maintains computational efficiency, making it suitable for real-time deployment in healthcare and smart home environments. By enhancing spatial and temporal awareness, our hybrid approach significantly improves fall detection reliability, ensuring timely intervention and enhancing safety for at-risk individuals.
引用
收藏
页码:41336 / 41366
页数:31
相关论文
共 50 条
  • [31] Real-Time Farm Surveillance Using IoT and YOLOv8 for Animal Intrusion Detection
    Delwar, Tahesin Samira
    Mukhopadhyay, Sayak
    Kumar, Akshay
    Singh, Mangal
    Lee, Yang-won
    Ryu, Jee-Youl
    Hosen, A. S. M. Sanwar
    FUTURE INTERNET, 2025, 17 (02)
  • [32] Real-Time Obstacle Detection with YOLOv8 in a WSN Using UAV Aerial Photography
    Rahman, Shakila
    Rony, Jahid Hasan
    Uddin, Jia
    Samad, Md Abdus
    JOURNAL OF IMAGING, 2023, 9 (10)
  • [33] A hybrid human fall detection method based on modified YOLOv8s and AlphaPose
    Liu, Lei
    Sun, Yeguo
    Li, Yinyin
    Liu, Yihong
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [34] Knife Detection using YOLOv5: A Deep Learning Approach
    Sinh Huynh Phuoc Truong
    Thang Dang Quoc
    Hien Nguyen Duc
    Phuc Tran Nguyen Huu
    Nguyen Nguyen Quang Vinh
    PROCEEDINGS OF THE 2024 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION TECHNOLOGY, ICIIT 2024, 2024, : 7 - 12
  • [35] Drowsiness Detection of Construction Workers: Accident Prevention Leveraging Yolov8 Deep Learning and Computer Vision Techniques
    Onososen, Adetayo Olugbenga
    Musonda, Innocent
    Onatayo, Damilola
    Saka, Abdullahi Babatunde
    Adekunle, Samuel Adeniyi
    Onatayo, Eniola
    BUILDINGS, 2025, 15 (03)
  • [36] A Deep Learning Approach for Robust Detection of Bots in Twitter Using Transformers
    Martin-Gutierrez, David
    Hernandez-Penaloza, Gustavo
    Belmonte Hernandez, Alberto
    Lozano-Diez, Alicia
    Alvarez, Federico
    IEEE ACCESS, 2021, 9 : 54591 - 54601
  • [37] A Deep Learning Approach for Robust Detection of Bots in Twitter Using Transformers
    Martin-Gutierrez, David
    Hernandez-Penaloza, Gustavo
    Hernandez, Alberto Belmonte
    Lozano-Diez, Alicia
    Alvarez, Federico
    IEEE Access, 2021, 9 : 54591 - 54601
  • [38] A real-time traffic sign detection in intelligent transportation system using YOLOv8-based deep learning approach
    Tang, Mingdeng
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (8-9) : 6103 - 6113
  • [39] Performance evaluation of YOLOv8 and YOLOv9 on custom dataset with color space augmentation for Real-time Wildlife detection at the Edge
    Asdikian, Jean Pierre H.
    Li, Mengyao
    Maier, Guido
    2024 IEEE 10TH INTERNATIONAL CONFERENCE ON NETWORK SOFTWARIZATION, NETSOFT 2024, 2024, : 55 - 60
  • [40] An enhanced framework for real-time dense crowd abnormal behavior detection using YOLOv8
    Rabia Nasir
    Zakia Jalil
    Muhammad Nasir
    Tahani Alsubait
    Maria Ashraf
    Sadia Saleem
    Artificial Intelligence Review, 58 (7)