Normality Guided Multiple Instance Learning for Weakly Supervised Video Anomaly Detection

被引:9
|
作者
Park, Seongheon [1 ]
Kim, Hanjae [1 ]
Kim, Minsu [1 ]
Kim, Dahye [1 ]
Sohn, Kwanghoon [1 ,2 ]
机构
[1] Yonsei Univ, Seoul 120749, South Korea
[2] Korea Inst Sci & Technol KIST, Seoul, South Korea
关键词
D O I
10.1109/WACV56688.2023.00269
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised Video Anomaly Detection (wVAD) aims to distinguish anomalies from normal events based on video-level supervision. Most existing works utilize Multiple Instance Learning (MIL) with ranking loss to tackle this task. These methods, however, rely on noisy predictions from a MIL-based classifier for target instance selection in ranking loss, degrading model performance. To overcome this problem, we propose Normality Guided Multiple Instance Learning (NG-MIL) framework, which encodes diverse normal patterns from noise-free normal videos into prototypes for constructing a similarity-based classifier. By ensembling predictions of two classifiers, our method could refine the anomaly scores, reducing training instability from weak labels. Moreover, we introduce normality clustering and normality guided triplet loss constraining inner bag instances to boost the effect of NG-MIL and increase the discriminability of classifiers. Extensive experiments on three public datasets (ShanghaiTech, UCF-Crime, XD-Violence) demonstrate that our method is comparable to or better than existing weakly supervised methods, achieving stateof-the-art results.
引用
收藏
页码:2664 / 2673
页数:10
相关论文
共 50 条
  • [1] Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection
    Lv, Hui
    Yue, Zhongqi
    Sun, Qianru
    Luo, Bin
    Cui, Zhen
    Zhang, Hanwang
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8022 - 8031
  • [2] Collaborative Normality Learning Framework for Weakly Supervised Video Anomaly Detection
    Liu, Yang
    Liu, Jing
    Zhao, Mengyang
    Li, Shuang
    Song, Liang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (05) : 2508 - 2512
  • [3] WEAKLY SUPERVISED VIDEO ANOMALY DETECTION VIA CENTER-GUIDED DISCRIMINATIVE LEARNING
    Wan, Boyang
    Fang, Yuming
    Xia, Xue
    Mei, Jiajie
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [4] CLIP-Driven Multi-Scale Instance Learning for Weakly Supervised Video Anomaly Detection
    Qian, Zhangbin
    Tan, Jiawei
    Ou, Zhilong
    Wang, Hongxing
    [J]. Proceedings - IEEE International Conference on Multimedia and Expo, 2024,
  • [5] Multiple Instance Relational Learning for Video Anomaly Detection
    Dengxiong, Xiwen
    Bao, Wentao
    Kong, Yu
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [6] Discrepant multiple instance learning for weakly supervised object detection
    Gao, Wei
    Wan, Fang
    Yue, Jun
    Xu, Songcen
    Ye, Qixiang
    [J]. PATTERN RECOGNITION, 2022, 122
  • [7] Continuation Multiple Instance Learning for Weakly and Fully Supervised Object Detection
    Ye, Qixiang
    Wan, Fang
    Liu, Chang
    Huang, Qingming
    Ji, Xiangyang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5452 - 5466
  • [8] Diffusion-based normality pre-training for weakly supervised video anomaly detection
    Basak, Suvramalya
    Gautam, Anjali
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
  • [9] Overlooked Video Classification in Weakly Supervised Video Anomaly Detection
    Tan, Weijun
    Yao, Qi
    Liu, Jingfeng
    [J]. 2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 212 - 220
  • [10] Multiple Instance Graph Learning for Weakly Supervised Remote Sensing Object Detection
    Wang, Binglu
    Zhao, Yongqiang
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60