Event-driven weakly supervised video anomaly detection

被引:0
|
作者
Sun, Shengyang [1 ]
Gong, Xiaojin [1 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Zhejiang, Peoples R China
关键词
Video anomaly detection; Weakly supervised; Transformer; Event-driven;
D O I
10.1016/j.imavis.2024.105169
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inspired by the observations of human working manners, this work proposes an event-driven method for weakly supervised video anomaly detection. Complementary to the conventional snippet-level anomaly detection, this work designs an event analysis module to predict the event-level anomaly scores as well. It first generates event proposals simply via a temporal sliding window and then constructs a cascaded causal transformer to capture temporal dependencies for potential events of varying durations. Moreover, a dual-memory augmented selfattention scheme is also designed to capture global semantic dependencies for event feature enhancement. The network is learned with a standard multiple instance learning (MIL) loss, together with normal-abnormal contrastive learning losses. During inference, the snippet- and event-level anomaly scores are fused for anomaly detection. Experiments show that the event-level analysis helps to detect anomalous events more continuously and precisely. The performance of the proposed method on three public datasets demonstrates that the proposed approach is competitive with state-of-the-art methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Overlooked Video Classification in Weakly Supervised Video Anomaly Detection
    Tan, Weijun
    Yao, Qi
    Liu, Jingfeng
    2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 212 - 220
  • [2] Semantic-driven dual consistency learning for weakly supervised video anomaly detection
    Su, Yong
    Tan, Yuyu
    An, Simin
    Xing, Meng
    Feng, Zhiyong
    PATTERN RECOGNITION, 2025, 157
  • [3] Weakly supervised video anomaly detection with temporal attention module
    Song, Wonjoon
    Kim, Jonghyun
    Kim, Joongkyu
    2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 982 - 985
  • [4] Sequential attention mechanism for weakly supervised video anomaly detection
    Ullah, Waseem
    Ullah, Fath U. Min
    Khan, Zulfiqar Ahmad
    Baik, Sung Wook
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 230
  • [5] Weakly supervised video anomaly detection based on hyperbolic space
    Qi, Meilin
    Wu, Yuanyuan
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [6] A Convolutional Autoencoder Approach for Weakly Supervised Anomaly Video Detection
    Phan Nguyen Duc Hieu
    Phan Duy Hung
    COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2023, 2023, 14162 : 138 - 150
  • [7] BatchNorm-Based Weakly Supervised Video Anomaly Detection
    Zhou, Yixuan
    Qu, Yi
    Xu, Xing
    Shen, Fumin
    Song, Jingkuan
    Tao Shen, Heng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13642 - 13654
  • [8] CLIP-Driven Multi-Scale Instance Learning for Weakly Supervised Video Anomaly Detection
    Qian, Zhangbin
    Tan, Jiawei
    Ou, Zhilong
    Wang, Hongxing
    Proceedings - IEEE International Conference on Multimedia and Expo, 2024,
  • [9] Attention-based framework for weakly supervised video anomaly detection
    Hualin Ma
    Liyan Zhang
    The Journal of Supercomputing, 2022, 78 : 8409 - 8429
  • [10] Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection
    Lv, Hui
    Yue, Zhongqi
    Sun, Qianru
    Luo, Bin
    Cui, Zhen
    Zhang, Hanwang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8022 - 8031