Deep BiLSTM Attention Model for Spatial and Temporal Anomaly Detection in Video Surveillance

被引:0
|
作者
Natha, Sarfaraz [1 ,2 ]
Ahmed, Fareed [1 ]
Siraj, Mohammad [3 ]
Lagari, Mehwish [1 ]
Altamimi, Majid [3 ]
Chandio, Asghar Ali [1 ]
机构
[1] Quaid E Awam Univ, Dept Informat Technol, Nawabshah 67450, Pakistan
[2] Sir Syed Univ Engn & Technol, Dept Software Engn, Karachi 75300, Pakistan
[3] King Saud Univ, Coll Engn, Dept Elect Engn, Riyadh 11543, Saudi Arabia
关键词
convolutional neural network; recurrent neural network; BiLSTM; multi-attention layer; anomaly detection;
D O I
10.3390/s25010251
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Detection of anomalies in video surveillance plays a key role in ensuring the safety and security of public spaces. The number of surveillance cameras is growing, making it harder to monitor them manually. So, automated systems are needed. This change increases the demand for automated systems that detect abnormal events or anomalies, such as road accidents, fighting, snatching, car fires, and explosions in real-time. These systems improve detection accuracy, minimize human error, and make security operations more efficient. In this study, we proposed the Composite Recurrent Bi-Attention (CRBA) model for detecting anomalies in surveillance videos. The CRBA model combines DenseNet201 for robust spatial feature extraction with BiLSTM networks that capture temporal dependencies across video frames. A multi-attention mechanism was also incorporated to direct the model's focus to critical spatiotemporal regions. This improves the system's ability to distinguish between normal and abnormal behaviors. By integrating these methodologies, the CRBA model improves the detection and classification of anomalies in surveillance videos, effectively addressing both spatial and temporal challenges. Experimental assessments demonstrate that the CRBA model achieves high accuracy on both the University of Central Florida (UCF) and the newly developed Road Anomaly Dataset (RAD). This model enhances detection accuracy while also improving resource efficiency and minimizing response times in critical situations. These advantages make it an invaluable tool for public safety and security operations, where rapid and accurate responses are needed for maintaining safety.
引用
收藏
页数:24
相关论文
共 50 条
  • [21] Anomaly Detection in Surveillance Video using Motion-Direction Model
    Mangoli, Taskeen A.
    Sujatha, C.
    Mudenagudi, Uma
    2018 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRONICS, COMPUTERS AND COMMUNICATIONS (ICAECC), 2018,
  • [22] Spatial-Temporal Cascade Autoencoder for Video Anomaly Detection in Crowded Scenes
    Li, Nanjun
    Chang, Faliang
    Liu, Chunsheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 203 - 215
  • [23] A novel ensemble model for fall detection: leveraging CNN and BiLSTM with channel and temporal attention
    Sahni, Sarita
    Jain, Sweta
    Saritha, Sri Khetwat
    AUTOMATIKA, 2025, 66 (02) : 103 - 116
  • [24] Learning Graph Enhanced Spatial-Temporal Coherence for Video Anomaly Detection
    Cheng, Kai
    Liu, Yang
    Zeng, Xinhua
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 314 - 318
  • [25] Real-time detection of abnormal human activity using deep learning and temporal attention mechanism in video surveillance
    Kumar, Manoj
    Patel, Anoop Kumar
    Biswas, Mantosh
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 55981 - 55997
  • [26] Real-time detection of abnormal human activity using deep learning and temporal attention mechanism in video surveillance
    Manoj Kumar
    Anoop Kumar Patel
    Mantosh Biswas
    Multimedia Tools and Applications, 2024, 83 : 55981 - 55997
  • [27] Analysis of Anomaly Detection Techniques in Video Surveillance
    Ovhal, Karuna B.
    Patange, Sonal S.
    Shinde, Reshma S.
    Tarange, Vaishnavi K.
    Kotkar, Vijay A.
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT SUSTAINABLE SYSTEMS (ICISS 2017), 2017, : 596 - 601
  • [28] AnomalyNet: An Anomaly Detection Network for Video Surveillance
    Zhou, Joey Tianyi
    Du, Jiawei
    Zhu, Hongyuan
    Peng, Xi
    Liu, Yong
    Goh, Rick Siow Mong
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2019, 14 (10) : 2537 - 2550
  • [29] Gaussian Mixture Model and Spatial-Temporal Evaluation for Object Detection and Tracking in Video Surveillance System
    Mushawwir, Luqman Abdul
    Supriana, Iping
    2015 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY SYSTEMS AND INNOVATION (ICITSI), 2015,
  • [30] Video anomaly detection based on attention and efficient spatio-temporal feature extraction
    Rahimpour, Seyed Mohammad
    Kazemi, Mohammad
    Moallem, Payman
    Safayani, Mehran
    VISUAL COMPUTER, 2024, 40 (10): : 6825 - 6841