Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection

被引:0
|
作者
Yao, Haiming [1 ]
Luo, Wei [1 ]
Zhang, Weihang [2 ]
Zhang, Xiaotian [1 ]
Qiang, Zhenfeng [1 ]
Luo, Donghao [1 ]
机构
[1] Tsinghua Univ, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
关键词
Unsupervised anomaly detection; Global-local semantics learning; Dual-branch vision transformer; Discrepancy normalizing flow;
D O I
10.1016/j.engappai.2024.109235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unsupervised detection and localization of image anomalies hold significant importance across various domains, particularly in industrial quality inspection. Despite its widespread utilization, this task remains inherently challenging due to its reliance solely on defect-free normal knowledge. This paper presents the local- global normality learning and discrepancy normalizing flow, a new state-of-the-art model for unsupervised image anomaly detection and localization. In contrast to existing methods, It adopts a two-stream approach that considers both local and global semantics, ensuring stable detection of abnormalities. The framework comprises two key components: the dual-branch Transformer and the discrepancy normalizing flow, facilitating reconstruction and discrimination. The proposed framework leverages pre-trained convolutional neural networks to extract multi-scale feature embeddings, followed by a novel dual-branch transformer that achieves feature reconstruction from local and global perspectives. The local reconstruction employs self-attention, while the global reconstruction incorporates global prototype tokens and semantic query tokens by the aggregation- cross attention mechanism. Moreover, discrepancy normalizing flow is developed to estimate the likelihood of anomalies based on the discrepancy between pre-trained features and local/global reconstruction results. Extensive validation on established public benchmarks confirms that our method achieves state-of-the-art performance with the proposed local-global reconstruction and discrimination dual-stream framework.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Advancing unsupervised anomaly detection with normalizing flow and multi-scale ensemble learning
    Campos-Romero, Miguel
    Carranza-Garcia, Manuel
    Riquelme, Jose C.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 137
  • [2] Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning
    Feng, Chenlong
    Liu, Chao
    Jiang, Dongxiang
    RENEWABLE ENERGY, 2023, 206 : 309 - 323
  • [3] LOCAL-GLOBAL BACKGROUND MODELING FOR ANOMALY DETECTION IN HYPERSPECTRAL IMAGES
    Madar, Eyal
    Kuybeda, Oleg
    Malah, David
    Barzohar, Meir
    2009 FIRST WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING, 2009, : 368 - 371
  • [4] Enhancing Local-Global Representation Learning for Image Restoration
    Cui, Yuning
    Knoll, Alois
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (04) : 6522 - 6530
  • [5] UniFlow: Unified Normalizing Flow for Unsupervised Multi-Class Anomaly Detection
    Zhong, Jianmei
    Song, Yanzhi
    Information (Switzerland), 2024, 15 (12)
  • [6] Unsupervised Anomaly Detection and Localization Based on Two-Hierarchy Normalizing Flow
    Jiang, Jielin
    Wei, Shun
    Xu, Xiaolong
    Cui, Yan
    Liu, Xiying
    IEEE Transactions on Instrumentation and Measurement, 2024, 73
  • [7] Self-Supervised Texture Image Anomaly Detection by Fusing Normalizing Flow and Dictionary Learning
    Guo, Yaohua
    Song, Lijuan
    Ma, Zirui
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (04)
  • [8] Unsupervised Learning of PCFGs with Normalizing Flow
    Jin, Lifeng
    Doshi-Velez, Finale
    Miller, Timothy
    Schuler, William
    Schwartz, Lane
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 2442 - 2452
  • [9] U-Flow: A U-Shaped Normalizing Flow for Anomaly Detection with Unsupervised Threshold
    Tailanian, Matias
    Pardo, Alvaro
    Muse, Pablo
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2024, 66 (04) : 678 - 696
  • [10] Flow Graph Anomaly Detection Based on Unsupervised Learning
    Yang, Zhengqiang
    Tian, Junwei
    Li, Ning
    MOBILE INFORMATION SYSTEMS, 2022, 2022