A cutting-edge video anomaly detection method using image quality assessment and attention mechanism-based deep learning

被引:1
|
作者
Cui, Chunying [1 ]
Liu, Linlin [2 ]
Qiao, Rui [1 ]
机构
[1] Zhoukou Normal Univ, Sch Comp Sci & Technol, Zhoukou 466001, Peoples R China
[2] Zhoukou Normal Univ, Sch Network Engn, Zhoukou 466001, Peoples R China
关键词
Video anomaly detection; Image quality assessment; Attention mechanism; Deep learning; Robustness;
D O I
10.1016/j.aej.2024.07.103
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Video anomaly detection is a very important research topic, especially in the field of automatic driving, and timely acquisition of road conditions ahead is very important for safe driving. Past methods used convolution and other operations, resulting in severe delays or low detection accuracy. This paper introduces a cutting- edge video anomaly detection method that combines the advantages of image quality assessment and attention mechanisms while using image signal processing techniques to enhance the data. Our approach first uses image quality metrics to evaluate visual fidelity anomalies for each video frame, providing a computationally simple and effective method for initial anomaly recognition. Then, an attention mechanism is integrated into two deep learning models including convolutional neural networks (CNNs) and long short-term memory (LSTM) networks. This integration enables the system to dynamically focus on significant regions in the video. This capability is unmatched by traditional analysis methods. The dual-structure system shows higher sensitivity to various anomalies. In addition, the system is also equipped with image signals, which makes the data feature extraction more precise. Through thorough testing of the benchmark dataset, the proposed approach has been shown to significantly outperform current state-of-the-art models. It especially excels in challenging monitoring scenarios. For example, in the UCSD dataset, we achieved an area under curve (AUC) value of 99.9%, which exceeds most current methods.
引用
收藏
页码:476 / 485
页数:10
相关论文
共 50 条
  • [21] A Deep Learning Method Based on the Attention Mechanism for Hardware Trojan Detection
    Tang, Wenjing
    Su, Jing
    He, Jiaji
    Gao, Yuchan
    ELECTRONICS, 2022, 11 (15)
  • [22] Deep anomaly detection in expressway based on edge computing and deep learning
    Wang, Juan
    Wang, Meng
    Liu, Qingling
    Yin, Guanxiang
    Zhang, Yuejin
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 13 (03) : 1293 - 1305
  • [23] Deep anomaly detection in expressway based on edge computing and deep learning
    Juan Wang
    Meng Wang
    Qingling Liu
    Guanxiang Yin
    Yuejin Zhang
    Journal of Ambient Intelligence and Humanized Computing, 2022, 13 : 1293 - 1305
  • [24] COVAD: Content-oriented video anomaly detection using a self attention-based deep learning model
    Wenhao SHAO
    Praboda RAJAPAKSHA
    Yanyan WEI
    Dun LI
    Noel CRESPI
    Zhigang LUO
    虚拟现实与智能硬件(中英文), 2023, 5 (01) : 24 - 41
  • [25] COVAD: Content-Oriented Video Anomaly Detection using a Self-Attention based Deep Learning Model
    Shao W.
    Rajapaksha P.
    Wei Y.
    Li D.
    Crespi N.
    Luo Z.
    Virtual Reality and Intelligent Hardware, 2023, 5 (01): : 24 - 41
  • [26] A-DDPG: Attention Mechanism-based Deep Reinforcement Learning for NFV
    He, Nan
    Yang, Song
    Li, Fan
    Trajanovski, Stojan
    Kuipers, Fernando A.
    Fu, Xiaoming
    2021 IEEE/ACM 29TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2021,
  • [27] A Graph Attention Mechanism-Based Multiagent Reinforcement-Learning Method for Task Scheduling in Edge Computing
    Li, Yinong
    Li, Jianbo
    Pang, Junjie
    ELECTRONICS, 2022, 11 (09)
  • [28] A Deep Learning-Based Animation Video Image Data Anomaly Detection and Recognition Algorithm
    Li, Cheng
    Qian, Qiguang
    JOURNAL OF ORGANIZATIONAL AND END USER COMPUTING, 2024, 36 (01)
  • [29] Review of Deep Learning-Based Video Anomaly Detection
    Ji G.
    Qi X.
    Wang J.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (02): : 128 - 143
  • [30] Deep Learning for Image/Video Compression and Visual Quality Assessment
    Multimedia Tools and Applications, 2022, 81 : 42483 - 42483