Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection

被引:0
|
作者
Yao, Haiming [1 ]
Luo, Wei [1 ]
Zhang, Weihang [2 ]
Zhang, Xiaotian [1 ]
Qiang, Zhenfeng [1 ]
Luo, Donghao [1 ]
机构
[1] Tsinghua Univ, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
关键词
Unsupervised anomaly detection; Global-local semantics learning; Dual-branch vision transformer; Discrepancy normalizing flow;
D O I
10.1016/j.engappai.2024.109235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unsupervised detection and localization of image anomalies hold significant importance across various domains, particularly in industrial quality inspection. Despite its widespread utilization, this task remains inherently challenging due to its reliance solely on defect-free normal knowledge. This paper presents the local- global normality learning and discrepancy normalizing flow, a new state-of-the-art model for unsupervised image anomaly detection and localization. In contrast to existing methods, It adopts a two-stream approach that considers both local and global semantics, ensuring stable detection of abnormalities. The framework comprises two key components: the dual-branch Transformer and the discrepancy normalizing flow, facilitating reconstruction and discrimination. The proposed framework leverages pre-trained convolutional neural networks to extract multi-scale feature embeddings, followed by a novel dual-branch transformer that achieves feature reconstruction from local and global perspectives. The local reconstruction employs self-attention, while the global reconstruction incorporates global prototype tokens and semantic query tokens by the aggregation- cross attention mechanism. Moreover, discrepancy normalizing flow is developed to estimate the likelihood of anomalies based on the discrepancy between pre-trained features and local/global reconstruction results. Extensive validation on established public benchmarks confirms that our method achieves state-of-the-art performance with the proposed local-global reconstruction and discrimination dual-stream framework.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Effective Local-Global Transformer for Natural Image Matting
    Hu, Liangpeng
    Kong, Yating
    Li, Jide
    Li, Xiaoqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 3888 - 3898
  • [42] Normality learning reinforcement for anomaly detection in surveillance videos
    Cheng, Kai
    Zeng, Xinhua
    Liu, Yang
    Pan, Yaning
    Li, Xinzhe
    KNOWLEDGE-BASED SYSTEMS, 2024, 297
  • [43] Anomaly Detection through Unsupervised Federated Learning
    Nardi, Mirko
    Valerio, Lorenzo
    Passarella, Andrea
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 495 - 501
  • [44] Manifold learning techniques for unsupervised anomaly detection
    Olson, C. C.
    Judd, K. P.
    Nichols, J. M.
    EXPERT SYSTEMS WITH APPLICATIONS, 2018, 91 : 374 - 385
  • [45] Unsupervised Learning for Anomaly Detection of Electric Motors
    Jonghwan Son
    Chayoung Kim
    Minjoong Jeong
    International Journal of Precision Engineering and Manufacturing, 2022, 23 : 421 - 427
  • [46] Unsupervised Adversarial Learning of Anomaly Detection in the Wild
    Berg, Amanda
    Felsberg, Michael
    Ahlberg, Jorgen
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1002 - 1008
  • [47] Conditional normalizing flow for multivariate time series anomaly detection
    Guan, Siwei
    He, Zhiwei
    Ma, Shenhui
    Gao, Mingyu
    ISA TRANSACTIONS, 2023, 143 : 231 - 243
  • [48] A SEMANTICS-AWARE NORMALIZING FLOW MODEL FOR ANOMALY DETECTION
    Ma, Wei
    Lan, Shiyong
    Huang, Weikang
    Wang, Wenwu
    Yang, Hongyu
    Ma, Yitong
    Ma, Yongjie
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2207 - 2212
  • [49] An unsupervised anomaly detection patterns learning algorithm
    Yang, YJ
    Ma, FY
    2003 INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY, VOL 1 AND 2, PROCEEDINGS, 2003, : 400 - 402
  • [50] Unsupervised Learning for Anomaly Detection of Electric Motors
    Son, Jonghwan
    Kim, Chayoung
    Jeong, Minjoong
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, 2022, 23 (04) : 421 - 427