Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection

被引:0
|
作者
Yao, Haiming [1 ]
Luo, Wei [1 ]
Zhang, Weihang [2 ]
Zhang, Xiaotian [1 ]
Qiang, Zhenfeng [1 ]
Luo, Donghao [1 ]
机构
[1] Tsinghua Univ, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
关键词
Unsupervised anomaly detection; Global-local semantics learning; Dual-branch vision transformer; Discrepancy normalizing flow;
D O I
10.1016/j.engappai.2024.109235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unsupervised detection and localization of image anomalies hold significant importance across various domains, particularly in industrial quality inspection. Despite its widespread utilization, this task remains inherently challenging due to its reliance solely on defect-free normal knowledge. This paper presents the local- global normality learning and discrepancy normalizing flow, a new state-of-the-art model for unsupervised image anomaly detection and localization. In contrast to existing methods, It adopts a two-stream approach that considers both local and global semantics, ensuring stable detection of abnormalities. The framework comprises two key components: the dual-branch Transformer and the discrepancy normalizing flow, facilitating reconstruction and discrimination. The proposed framework leverages pre-trained convolutional neural networks to extract multi-scale feature embeddings, followed by a novel dual-branch transformer that achieves feature reconstruction from local and global perspectives. The local reconstruction employs self-attention, while the global reconstruction incorporates global prototype tokens and semantic query tokens by the aggregation- cross attention mechanism. Moreover, discrepancy normalizing flow is developed to estimate the likelihood of anomalies based on the discrepancy between pre-trained features and local/global reconstruction results. Extensive validation on established public benchmarks confirms that our method achieves state-of-the-art performance with the proposed local-global reconstruction and discrimination dual-stream framework.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Learned Focused Plenoptic Image Compression With Local-Global Correlation Learning
    Liu, Gaosheng
    Yue, Huanjing
    Wen, Bihan
    Yang, Jingyu
    IEEE Transactions on Multimedia, 2025, 27 : 1216 - 1227
  • [22] Unsupervised Learning for Network Flow based Anomaly Detection in the Era of Deep Learning
    Kabir, Md Ahsanul
    Luo, Xiao
    2020 IEEE SIXTH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (BIGDATASERVICE 2020), 2020, : 166 - 169
  • [23] Robust Variational Autoencoders and Normalizing Flows for Unsupervised Network Anomaly Detection
    Najari, Naji
    Berlemont, Samuel
    Lefebvre, Gregoire
    Duffner, Stefan
    Garcia, Christophe
    ADVANCED INFORMATION NETWORKING AND APPLICATIONS, AINA-2022, VOL 2, 2022, 450 : 281 - 292
  • [24] Normality Learning in Multispace for Video Anomaly Detection
    Zhang, Yu
    Nie, Xiushan
    He, Rundong
    Chen, Meng
    Yin, Yilong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (09) : 3694 - 3706
  • [25] Global-Local Association Discrepancy for Multivariate Time Series Anomaly Detection in IIoT
    Zhou, Xiaobo
    Dai, Cuini
    Wang, Weixu
    Qiu, Tie
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (07) : 11287 - 11297
  • [26] Learning Unsupervised Metaformer for Anomaly Detection
    Wu, Jhih-Ciang
    Chen, Ding-Jie
    Fuh, Chiou-Shann
    Liu, Tyng-Luh
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4349 - 4358
  • [27] Traffic Anomaly Detection Via Conditional Normalizing Flow
    Kang, Zhuangwei
    Mukhopadhyay, Ayan
    Gokhale, Aniruddha
    Wen, Shijie
    Dubey, Abhishek
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2563 - 2570
  • [28] An Implementation of Combined Local-Global Optical Flow
    Jara-Wilde, Jorge
    Cerda, Mauricio
    Delpiano, Jose
    Haertel, Steffen
    IMAGE PROCESSING ON LINE, 2015, 5 : 139 - 158
  • [29] Local-Global Attentive Adaptation for Object Detection
    Zhang, Dan
    Li, Jingjing
    Li, Xingpeng
    Du, Zhekai
    Xiong, Lin
    Ye, Mao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 100
  • [30] Unsupervised deep learning system for local anomaly event detection in crowded scenes
    Anitha Ramchandran
    Arun Kumar Sangaiah
    Multimedia Tools and Applications, 2020, 79 : 35275 - 35295