Advancing unsupervised anomaly detection with normalizing flow and multi-scale ensemble learning

被引:0
|
作者
Campos-Romero, Miguel [1 ,2 ]
Carranza-Garcia, Manuel [2 ]
Riquelme, Jose C. [2 ]
机构
[1] LMI Technol Inc, 9200 Glenlyon Pkwy, Burnaby, BC V5J 5J8, Canada
[2] Univ Seville, Div Comp Sci, Av Reina Mercedes S-N, Seville 41012, Spain
关键词
Anomaly detection; Novelty detection; Deep learning; Normalizing flow; Unsupervised learning;
D O I
10.1016/j.engappai.2024.109088
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual anomaly detection plays a crucial role in manufacturing to ensure product quality by identifying image patterns that deviate from the expected ones. Existing methods that rely on distribution estimation struggle with the complexity of real-world images, resulting in complex and inefficient procedures. This study leverages normalizing flow techniques to address the cold start anomaly detection problem, where no prior examples of anomalies are available during the training phase. In such scenarios, models must learn exclusively from defect-free images and still accurately identify anomalies. We propose a novel unsupervised multi-scale and multi-semantic normalizing flow model, enhanced with an ensemble of neural networks, to detect anomalies based on their feature distributions. Our model estimates the likelihood of non-defective features, identifying anomalies as out-of-distribution values. Extensive experiments on three state-of-the-art anomaly detection datasets demonstrate that our proposal achieves superior AUROC performance and improves computational efficiency compared to existing approaches. Furthermore, we validate the robustness and adaptability of our proposal through low-shot training experiments using only 20% of available training data, highlighting its potential as an efficient solution for cold start anomaly detection.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Research on Visual Anomaly Detection Based on Multi-scale Normalizing Flow
    Mao G.-J.
    Wu X.-Z.
    Xing S.-L.
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (03): : 640 - 648
  • [2] UniFlow: Unified Normalizing Flow for Unsupervised Multi-Class Anomaly Detection
    Zhong, Jianmei
    Song, Yanzhi
    Information (Switzerland), 2024, 15 (12)
  • [3] A Multi-Scale A Contrario method for Unsupervised Image Anomaly Detection
    Tailanian, Matias
    Muse, Pablo
    Pardo, Alvaro
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 179 - 184
  • [4] Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection
    Yao, Haiming
    Luo, Wei
    Zhang, Weihang
    Zhang, Xiaotian
    Qiang, Zhenfeng
    Luo, Donghao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 137
  • [5] A Multi-scale Parallel Unsupervised Model for Multivariate Time Series Anomaly Detection
    Bao, Junpeng
    Gao, Han
    Zhang, Chengpu
    Jia, Wentao
    Gao, Junzhe
    Yang, Tongzhi
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, PT IV, AIAI 2024, 2024, 714 : 241 - 251
  • [6] ANEMONE: Graph Anomaly Detection with Multi-Scale Contrastive Learning
    Jin, Ming
    Liu, Yixin
    Zheng, Yu
    Chi, Lianhua
    Li, Yuan-Fang
    Pan, Shirui
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3122 - 3126
  • [7] Multi-scale Anomaly Detection with Wavelets
    Coughlin, Jack
    Perrone, Gian
    INTERNATIONAL CONFERENCE ON BIG DATA AND INTERNET OF THINGS (BDIOT 2017), 2017, : 102 - 108
  • [8] InvFlow: Involution and multi-scale interaction for unsupervised learning of optical flow
    Xiang, Xuezhi
    Abdein, Rokia
    Lv, Ning
    El Saddik, Abdulmotaleb
    PATTERN RECOGNITION, 2024, 145
  • [9] Unsupervised Anomaly Detection and Localization Based on Two-Hierarchy Normalizing Flow
    Jiang, Jielin
    Wei, Shun
    Xu, Xiaolong
    Cui, Yan
    Liu, Xiying
    IEEE Transactions on Instrumentation and Measurement, 2024, 73
  • [10] Multi-Scale Deep Ensemble Learning for Melanoma Skin Cancer Detection
    Guergueb, Takfarines
    Akhloufi, Moulay A.
    2022 IEEE 23RD INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION FOR DATA SCIENCE (IRI 2022), 2022, : 256 - 261