Self-supervised Visual Anomaly Detection with Image Patch Generation and Comparison Networks

被引:0
|
作者
Huang, Jianfeng [1 ,2 ]
Zhao, Kaikai [1 ,2 ]
Li, Chenyang [1 ,2 ]
Lin, Yimin [1 ,2 ]
Liu, Zhaoxiang [1 ,2 ]
Wang, Kai [1 ,2 ]
Lian, Shiguo [1 ,2 ]
机构
[1] China Unicom, AI Innovat Ctr, Beijing 100013, Peoples R China
[2] China Unicom, Unicom Digital Technol, Beijing 100013, Peoples R China
关键词
Industrial anomaly detection; Self-supervised anomaly detection; Vision transformer;
D O I
10.1007/978-981-97-5609-4_8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic industrial anomaly detection, especially visual anomaly detection, is still a challenging task. Taking the product of cloth for example, there are often various intrinsic textures or color patterns on cloth images which makes it difficult to distinguish anomaly and normality. To tackle this issue, we propose a novel self-supervised anomaly detection method consisting of three steps. Firstly, the Vision Transformer-based generation network is trained to learn the product image's texture and color patterns and generate an image patch from the other two adjacent patches. Then, the Siamese-based comparison network is designed to compare the generated patch with the original one to identify and localize the anomaly. Finally, the location of anomaly is refined by a bi-directional inference strategy. Experimental results on both the public dataset MVTec AD and our practical dataset demonstrate the superiority of our method over other state-of-the-art approaches.
引用
收藏
页码:96 / 113
页数:18
相关论文
共 50 条
  • [1] Self-supervised Learning for Anomaly Detection in Fundus Image
    Ahn, Sangil
    Shin, Jitae
    [J]. OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2022, 2022, 13576 : 143 - 151
  • [2] Visual defect obfuscation based self-supervised anomaly detection
    Park, YeongHyeon
    Kang, Sungho
    Kim, Myung Jin
    Lee, Yeonho
    Kim, Hyeong Seok
    Yi, Juneho
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01):
  • [3] IMAGE QUALITY ASSESSMENT DRIVEN SELF-SUPERVISED ANOMALY DETECTION
    Wang, Zhipeng
    Hou, Chunping
    Liu, Yang
    Ge, Bangbang
    Yue, Guanghui
    Song, Chunying
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [4] Self-Supervised Image Anomaly Detection and Localization with Synthetic Anomalies
    Tsai, Min-Chun
    Wang, Sheng-De
    [J]. 2023 10TH INTERNATIONAL CONFERENCE ON INTERNET OF THINGS: SYSTEMS, MANAGEMENT AND SECURITY, IOTSMS, 2023, : 90 - 95
  • [5] Self-Supervised Video Forensics by Audio-Visual Anomaly Detection
    Feng, Chao
    Chen, Ziyang
    Owens, Andrew
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10491 - 10503
  • [6] Adaptive Memory Networks With Self-Supervised Learning for Unsupervised Anomaly Detection
    Zhang, Yuxin
    Wang, Jindong
    Chen, Yiqiang
    Yu, Han
    Qin, Tao
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12068 - 12080
  • [7] Self-Supervised Attentive Generative Adversarial Networks for Video Anomaly Detection
    Huang, Chao
    Wen, Jie
    Xu, Yong
    Jiang, Qiuping
    Yang, Jian
    Wang, Yaowei
    Zhang, David
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9389 - 9403
  • [8] Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning
    Liu, Yixin
    Li, Zhao
    Pan, Shirui
    Gong, Chen
    Zhou, Chuan
    Karypis, George
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (06) : 2378 - 2392
  • [9] Self-supervised anomaly detection for new physics
    Dillon, Barry M.
    Mastandrea, Radha
    Nachman, Benjamin
    [J]. PHYSICAL REVIEW D, 2022, 106 (05)
  • [10] SELF-SUPERVISED ANOMALY DETECTION FOR NARROWBAND SETI
    Zhang, Yunfan Gerry
    Won, Ki Hyun
    Son, Seung Woo
    Siemion, Andrew
    Croft, Steve
    [J]. 2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 1114 - 1118