Event-driven weakly supervised video anomaly detection

被引:0
|
作者
Sun, Shengyang [1 ]
Gong, Xiaojin [1 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Zhejiang, Peoples R China
关键词
Video anomaly detection; Weakly supervised; Transformer; Event-driven;
D O I
10.1016/j.imavis.2024.105169
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inspired by the observations of human working manners, this work proposes an event-driven method for weakly supervised video anomaly detection. Complementary to the conventional snippet-level anomaly detection, this work designs an event analysis module to predict the event-level anomaly scores as well. It first generates event proposals simply via a temporal sliding window and then constructs a cascaded causal transformer to capture temporal dependencies for potential events of varying durations. Moreover, a dual-memory augmented selfattention scheme is also designed to capture global semantic dependencies for event feature enhancement. The network is learned with a standard multiple instance learning (MIL) loss, together with normal-abnormal contrastive learning losses. During inference, the snippet- and event-level anomaly scores are fused for anomaly detection. Experiments show that the event-level analysis helps to detect anomalous events more continuously and precisely. The performance of the proposed method on three public datasets demonstrates that the proposed approach is competitive with state-of-the-art methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Overlooked Video Classification in Weakly Supervised Video Anomaly Detection
    Tan, Weijun
    Yao, Qi
    Liu, Jingfeng
    [J]. 2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 212 - 220
  • [2] Semantic-driven dual consistency learning for weakly supervised video anomaly detection
    Su, Yong
    Tan, Yuyu
    An, Simin
    Xing, Meng
    Feng, Zhiyong
    [J]. PATTERN RECOGNITION, 2025, 157
  • [3] Weakly supervised video anomaly detection with temporal attention module
    Song, Wonjoon
    Kim, Jonghyun
    Kim, Joongkyu
    [J]. 2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 982 - 985
  • [4] Sequential attention mechanism for weakly supervised video anomaly detection
    Ullah, Waseem
    Ullah, Fath U. Min
    Khan, Zulfiqar Ahmad
    Baik, Sung Wook
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 230
  • [5] A Convolutional Autoencoder Approach for Weakly Supervised Anomaly Video Detection
    Phan Nguyen Duc Hieu
    Phan Duy Hung
    [J]. COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2023, 2023, 14162 : 138 - 150
  • [6] CLIP-Driven Multi-Scale Instance Learning for Weakly Supervised Video Anomaly Detection
    Qian, Zhangbin
    Tan, Jiawei
    Ou, Zhilong
    Wang, Hongxing
    [J]. Proceedings - IEEE International Conference on Multimedia and Expo, 2024,
  • [7] Attention-based framework for weakly supervised video anomaly detection
    Hualin Ma
    Liyan Zhang
    [J]. The Journal of Supercomputing, 2022, 78 : 8409 - 8429
  • [8] Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection
    Lv, Hui
    Yue, Zhongqi
    Sun, Qianru
    Luo, Bin
    Cui, Zhen
    Zhang, Hanwang
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8022 - 8031
  • [9] Attention-based framework for weakly supervised video anomaly detection
    Ma, Hualin
    Zhang, Liyan
    [J]. JOURNAL OF SUPERCOMPUTING, 2022, 78 (06): : 8409 - 8429
  • [10] Weakly-Supervised Video Anomaly Detection With Snippet Anomalous Attention
    Fan, Yidan
    Yu, Yongxin
    Lu, Wenhuan
    Han, Yahong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5480 - 5492