Normality Guided Multiple Instance Learning for Weakly Supervised Video Anomaly Detection

被引:9
|
作者
Park, Seongheon [1 ]
Kim, Hanjae [1 ]
Kim, Minsu [1 ]
Kim, Dahye [1 ]
Sohn, Kwanghoon [1 ,2 ]
机构
[1] Yonsei Univ, Seoul 120749, South Korea
[2] Korea Inst Sci & Technol KIST, Seoul, South Korea
关键词
D O I
10.1109/WACV56688.2023.00269
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised Video Anomaly Detection (wVAD) aims to distinguish anomalies from normal events based on video-level supervision. Most existing works utilize Multiple Instance Learning (MIL) with ranking loss to tackle this task. These methods, however, rely on noisy predictions from a MIL-based classifier for target instance selection in ranking loss, degrading model performance. To overcome this problem, we propose Normality Guided Multiple Instance Learning (NG-MIL) framework, which encodes diverse normal patterns from noise-free normal videos into prototypes for constructing a similarity-based classifier. By ensembling predictions of two classifiers, our method could refine the anomaly scores, reducing training instability from weak labels. Moreover, we introduce normality clustering and normality guided triplet loss constraining inner bag instances to boost the effect of NG-MIL and increase the discriminability of classifiers. Extensive experiments on three public datasets (ShanghaiTech, UCF-Crime, XD-Violence) demonstrate that our method is comparable to or better than existing weakly supervised methods, achieving stateof-the-art results.
引用
收藏
页码:2664 / 2673
页数:10
相关论文
共 50 条
  • [1] Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection
    Lv, Hui
    Yue, Zhongqi
    Sun, Qianru
    Luo, Bin
    Cui, Zhen
    Zhang, Hanwang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8022 - 8031
  • [2] Collaborative Normality Learning Framework for Weakly Supervised Video Anomaly Detection
    Liu, Yang
    Liu, Jing
    Zhao, Mengyang
    Li, Shuang
    Song, Liang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (05) : 2508 - 2512
  • [3] A Self-Paced Multiple Instance Learning Framework for Weakly Supervised Video Anomaly Detection
    He, Ping
    Li, Huibin
    Han, Miaolin
    Applied Sciences (Switzerland), 2025, 15 (03):
  • [4] WEAKLY SUPERVISED VIDEO ANOMALY DETECTION VIA CENTER-GUIDED DISCRIMINATIVE LEARNING
    Wan, Boyang
    Fang, Yuming
    Xia, Xue
    Mei, Jiajie
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [5] CLIP-Driven Multi-Scale Instance Learning for Weakly Supervised Video Anomaly Detection
    Qian, Zhangbin
    Tan, Jiawei
    Ou, Zhilong
    Wang, Hongxing
    Proceedings - IEEE International Conference on Multimedia and Expo, 2024,
  • [6] Multiple Instance Relational Learning for Video Anomaly Detection
    Dengxiong, Xiwen
    Bao, Wentao
    Kong, Yu
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [7] Discrepant multiple instance learning for weakly supervised object detection
    Gao, Wei
    Wan, Fang
    Yue, Jun
    Xu, Songcen
    Ye, Qixiang
    PATTERN RECOGNITION, 2022, 122
  • [8] Continuation Multiple Instance Learning for Weakly and Fully Supervised Object Detection
    Ye, Qixiang
    Wan, Fang
    Liu, Chang
    Huang, Qingming
    Ji, Xiangyang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5452 - 5466
  • [9] Diffusion-based normality pre-training for weakly supervised video anomaly detection
    Basak, Suvramalya
    Gautam, Anjali
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
  • [10] Overlooked Video Classification in Weakly Supervised Video Anomaly Detection
    Tan, Weijun
    Yao, Qi
    Liu, Jingfeng
    2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 212 - 220