Deep BiLSTM Attention Model for Spatial and Temporal Anomaly Detection in Video Surveillance

被引:0
|
作者
Natha, Sarfaraz [1 ,2 ]
Ahmed, Fareed [1 ]
Siraj, Mohammad [3 ]
Lagari, Mehwish [1 ]
Altamimi, Majid [3 ]
Chandio, Asghar Ali [1 ]
机构
[1] Quaid E Awam Univ, Dept Informat Technol, Nawabshah 67450, Pakistan
[2] Sir Syed Univ Engn & Technol, Dept Software Engn, Karachi 75300, Pakistan
[3] King Saud Univ, Coll Engn, Dept Elect Engn, Riyadh 11543, Saudi Arabia
关键词
convolutional neural network; recurrent neural network; BiLSTM; multi-attention layer; anomaly detection;
D O I
10.3390/s25010251
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Detection of anomalies in video surveillance plays a key role in ensuring the safety and security of public spaces. The number of surveillance cameras is growing, making it harder to monitor them manually. So, automated systems are needed. This change increases the demand for automated systems that detect abnormal events or anomalies, such as road accidents, fighting, snatching, car fires, and explosions in real-time. These systems improve detection accuracy, minimize human error, and make security operations more efficient. In this study, we proposed the Composite Recurrent Bi-Attention (CRBA) model for detecting anomalies in surveillance videos. The CRBA model combines DenseNet201 for robust spatial feature extraction with BiLSTM networks that capture temporal dependencies across video frames. A multi-attention mechanism was also incorporated to direct the model's focus to critical spatiotemporal regions. This improves the system's ability to distinguish between normal and abnormal behaviors. By integrating these methodologies, the CRBA model improves the detection and classification of anomalies in surveillance videos, effectively addressing both spatial and temporal challenges. Experimental assessments demonstrate that the CRBA model achieves high accuracy on both the University of Central Florida (UCF) and the newly developed Road Anomaly Dataset (RAD). This model enhances detection accuracy while also improving resource efficiency and minimizing response times in critical situations. These advantages make it an invaluable tool for public safety and security operations, where rapid and accurate responses are needed for maintaining safety.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Video Description with Spatial-Temporal Attention
    Tu, Yunbin
    Zhang, Xishan
    Liu, Bingtao
    Yan, Chenggang
    PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1014 - 1022
  • [42] Memory-Augmented Spatial-Temporal Consistency Network for Video Anomaly Detection
    Li, Zhangxun
    Zhao, Mengyang
    Zeng, Xinhua
    Wang, Tian
    Pang, Chengxin
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VI, 2024, 14430 : 95 - 107
  • [43] AI-Generated Video Detection via Spatial-Temporal Anomaly Learning
    Bai, Jianfa
    Lin, Man
    Cao, Gang
    Lou, Zijie
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT X, 2025, 15040 : 460 - 470
  • [44] Weakly supervised video anomaly detection based on spatial–temporal feature fusion enhancement
    Weijie Liang
    Jianming Zhang
    Yongzhao Zhan
    Signal, Image and Video Processing, 2024, 18 : 1111 - 1118
  • [45] VIDEO PREDICTION WITH TEMPORAL-SPATIAL ATTENTION MECHANISM AND DEEP PERCEPTUAL SIMILARITY BRANCH
    Wu, Qian
    Wang, Wenmin
    Chen, Xiongtao
    Li, Weimian
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1594 - 1599
  • [46] COVAD: Content-oriented video anomaly detection using a self attention-based deep learning model
    Wenhao SHAO
    Praboda RAJAPAKSHA
    Yanyan WEI
    Dun LI
    Noel CRESPI
    Zhigang LUO
    虚拟现实与智能硬件(中英文), 2023, 5 (01) : 24 - 41
  • [47] COVAD: Content-Oriented Video Anomaly Detection using a Self-Attention based Deep Learning Model
    Shao W.
    Rajapaksha P.
    Wei Y.
    Li D.
    Crespi N.
    Luo Z.
    Virtual Reality and Intelligent Hardware, 2023, 5 (01): : 24 - 41
  • [48] Spatio-temporal based video anomaly detection using deep neural networks
    Chaurasia R.K.
    Jaiswal U.C.
    International Journal of Information Technology, 2023, 15 (3) : 1569 - 1581
  • [49] DeepPGD: A Deep Learning Model for DNA Methylation Prediction Using Temporal Convolution, BiLSTM, and Attention Mechanism
    Teragawa, Shoryu
    Wang, Lei
    Liu, Yi
    INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES, 2024, 25 (15)
  • [50] Crowd Anomaly Event Detection in Surveillance Video Based on the Evolution of the Spatial Position Relationship Feature
    Zhao, Chunhui
    Zhang, Zhiyuan
    Hu, Jinwen
    Wang, Dong
    Fan, Bin
    Pan, Quan
    He, Qiang
    2018 IEEE 14TH INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2018, : 247 - 252