Improving Visual Defect Detection and Localization in Industrial Thermal Images Using Autoencoders

被引:2
|
作者
Behrouzi, Sasha [1 ]
Dix, Marcel [2 ]
Karampanah, Fatemeh [1 ]
Ates, Omer [1 ]
Sasidharan, Nissy [1 ]
Chandna, Swati [1 ]
Vu, Binh [1 ]
机构
[1] SRH Univ, Appl Data Sci & Analyt, D-69123 Heidelberg, Germany
[2] ABB Corp Res, Ind Data Analyt, D-68526 Ladenburg, Germany
关键词
anomaly detection; deep learning; novelty detection; autoencoder; industrial image; thermal image;
D O I
10.3390/jimaging9070137
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reliable functionality in anomaly detection in thermal image datasets is crucial for defect detection of industrial products. Nevertheless, achieving reliable functionality is challenging, especially when datasets are image sequences captured during equipment runtime with a smooth transition from healthy to defective images. This causes contamination of healthy training data with defective samples. Anomaly detection methods based on autoencoders are susceptible to a slight violation of a clean training dataset and lead to challenging threshold determination for sample classification. This paper indicates that combining anomaly scores leads to better threshold determination that effectively separates healthy and defective data. Our research results show that our approach helps to overcome these challenges. The autoencoder models in our research are trained with healthy images optimizing two loss functions: mean squared error (MSE) and structural similarity index measure (SSIM). Anomaly score outputs are used for classification. Three anomaly scores are applied: MSE, SSIM, and kernel density estimation (KDE). The proposed method is trained and tested on the 32 x 32-sized thermal images, including one contaminated dataset. The model achieved the following average accuracies across the datasets: MSE, 95.33%; SSIM, 88.37%; and KDE, 92.81%. Using a combination of anomaly scores could assist in solving a low classification accuracy. The use of KDE improves performance when healthy training data are contaminated. The MSE+ and SSIM+ methods, as well as two parameters to control quantitative anomaly localization using SSIM, are introduced.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Improving the Efficiency of Autoencoders for Visual Defect Detection with Orientation Normalization
    Radli, Richard
    Czuni, Laszlo
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 651 - 658
  • [2] Analysis of the Future Potential of Autoencoders in Industrial Defect Detection
    Schneider, Sarah
    Antensteiner, Doris
    Soukup, Daniel
    Scheutz, Matthias
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 282 - 289
  • [3] VISUAL DETECTION AND LOCALIZATION OF RADIOGRAPHIC IMAGES
    STARR, SJ
    METZ, CE
    LUSTED, LB
    GOODENOUGH, DJ
    RADIOLOGY, 1975, 116 (03) : 533 - 538
  • [4] Robust Anomaly Detection in Images Using Adversarial Autoencoders
    Beggel, Laura
    Pfeiffer, Michael
    Bischl, Bernd
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT I, 2020, 11906 : 206 - 222
  • [5] DETECTION OF TRACKING CARBON PATH USING VISUAL AND THERMAL IMAGES
    NISHIDA, M
    YOSHIMURA, N
    NOTO, F
    HAMMAM, MSAA
    IEEE TRANSACTIONS ON ELECTRICAL INSULATION, 1992, 27 (05): : 1050 - 1053
  • [6] A Malware Detection Approach Using Malware Images and Autoencoders
    Jin, Xiang
    Xing, Xiaofei
    Elahi, Haroon
    Wang, Guojun
    Jiang, Hai
    2020 IEEE 17TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2020), 2020, : 1 - 6
  • [7] Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum
    Bai, Xiaolong
    Fang, Yuming
    Lin, Weisi
    Wang, Lipo
    Ju, Bing-Feng
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (04) : 2135 - 2145
  • [8] Deep learning for photovoltaic defect detection using variational autoencoders
    Westraadt, Edward J.
    Brettenny, Warren J.
    Clohessy, Chantelle M.
    SOUTH AFRICAN JOURNAL OF SCIENCE, 2023, 119 (1-2)
  • [9] Analysis of microtomographic images in automatic defect localization and detection
    Mariusz Marzec
    Piotr Duda
    Zygmunt Wróbel
    Machine Vision and Applications, 2020, 31
  • [10] Analysis of microtomographic images in automatic defect localization and detection
    Marzec, Mariusz
    Duda, Piotr
    Wrobel, Zygmunt
    MACHINE VISION AND APPLICATIONS, 2020, 31 (05)