Deep BiLSTM Attention Model for Spatial and Temporal Anomaly Detection in Video Surveillance

被引:0
|
作者
Natha, Sarfaraz [1 ,2 ]
Ahmed, Fareed [1 ]
Siraj, Mohammad [3 ]
Lagari, Mehwish [1 ]
Altamimi, Majid [3 ]
Chandio, Asghar Ali [1 ]
机构
[1] Quaid E Awam Univ, Dept Informat Technol, Nawabshah 67450, Pakistan
[2] Sir Syed Univ Engn & Technol, Dept Software Engn, Karachi 75300, Pakistan
[3] King Saud Univ, Coll Engn, Dept Elect Engn, Riyadh 11543, Saudi Arabia
关键词
convolutional neural network; recurrent neural network; BiLSTM; multi-attention layer; anomaly detection;
D O I
10.3390/s25010251
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Detection of anomalies in video surveillance plays a key role in ensuring the safety and security of public spaces. The number of surveillance cameras is growing, making it harder to monitor them manually. So, automated systems are needed. This change increases the demand for automated systems that detect abnormal events or anomalies, such as road accidents, fighting, snatching, car fires, and explosions in real-time. These systems improve detection accuracy, minimize human error, and make security operations more efficient. In this study, we proposed the Composite Recurrent Bi-Attention (CRBA) model for detecting anomalies in surveillance videos. The CRBA model combines DenseNet201 for robust spatial feature extraction with BiLSTM networks that capture temporal dependencies across video frames. A multi-attention mechanism was also incorporated to direct the model's focus to critical spatiotemporal regions. This improves the system's ability to distinguish between normal and abnormal behaviors. By integrating these methodologies, the CRBA model improves the detection and classification of anomalies in surveillance videos, effectively addressing both spatial and temporal challenges. Experimental assessments demonstrate that the CRBA model achieves high accuracy on both the University of Central Florida (UCF) and the newly developed Road Anomaly Dataset (RAD). This model enhances detection accuracy while also improving resource efficiency and minimizing response times in critical situations. These advantages make it an invaluable tool for public safety and security operations, where rapid and accurate responses are needed for maintaining safety.
引用
收藏
页数:24
相关论文
共 50 条
  • [31] Spatial-Temporal Visual Attention Model for Video Quality Assessment
    Suen, Wei-Juen
    Liu, Hsin-Hua
    Pei, Soo-Chang
    Liu, Kuan-Hsien
    Liu, Tsung-Jung
    2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,
  • [32] Spatial-temporal Attention Model Based on Transformer Architecture for Anomaly Detection in Multivariate Time Series Data
    Zeng, Lai
    Yang, Xiaomei
    Journal of Computers (Taiwan), 2024, 35 (03) : 193 - 207
  • [33] Cluster Attention Contrast for Video Anomaly Detection
    Wang, Ziming
    Zou, Yuexian
    Zhang, Zeming
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2463 - 2471
  • [34] Spatiotemporal Anomaly Detection Using Deep Learning for Real-Time Video Surveillance
    Nawaratne, Rashmika
    Alahakoon, Damminda
    De Silva, Daswin
    Yu, Xinghuo
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (01) : 393 - 402
  • [35] Video Anomaly Detection Based on Attention Mechanism
    Zhang, Qianqian
    Wei, Hongyang
    Chen, Jiaying
    Du, Xusheng
    Yu, Jiong
    SYMMETRY-BASEL, 2023, 15 (02):
  • [36] Dual-Modality Deep Feature-based Anomaly Detection for Video Surveillance
    Bhatt, Parth Lalitkumar
    Shah, Dhruva
    Silver, Christopher
    Zhang, Wandong
    Akilan, Thangarajah
    2023 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE, 2023,
  • [37] Real-time anomaly detection on surveillance video with two-stream spatio-temporal generative model
    Liu, Weijia
    Cao, Jiuxin
    Zhu, Yilin
    Liu, Bo
    Zhu, Xuelin
    MULTIMEDIA SYSTEMS, 2023, 29 (01) : 59 - 71
  • [38] Real-time anomaly detection on surveillance video with two-stream spatio-temporal generative model
    Weijia Liu
    Jiuxin Cao
    Yilin Zhu
    Bo Liu
    Xuelin Zhu
    Multimedia Systems, 2023, 29 : 59 - 71
  • [39] Two-stream deep spatial-temporal auto-encoder for surveillance video abnormal event detection
    Li, Tong
    Chen, Xinyue
    Zhu, Fushun
    Zhang, Zhengyu
    Yan, Hua
    NEUROCOMPUTING, 2021, 439 (439) : 256 - 270
  • [40] Spatial and Temporal Detection With Attention for Real-Time Video Analytics at Edges
    Yan, Yuting
    Zhang, Sheng
    Jin, Yibo
    Cheng, Fangwen
    Qian, Zhuzhong
    Lu, Sanglu
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (10) : 9254 - 9270