Improving Visual Defect Detection and Localization in Industrial Thermal Images Using Autoencoders

被引:2
|
作者
Behrouzi, Sasha [1 ]
Dix, Marcel [2 ]
Karampanah, Fatemeh [1 ]
Ates, Omer [1 ]
Sasidharan, Nissy [1 ]
Chandna, Swati [1 ]
Vu, Binh [1 ]
机构
[1] SRH Univ, Appl Data Sci & Analyt, D-69123 Heidelberg, Germany
[2] ABB Corp Res, Ind Data Analyt, D-68526 Ladenburg, Germany
关键词
anomaly detection; deep learning; novelty detection; autoencoder; industrial image; thermal image;
D O I
10.3390/jimaging9070137
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reliable functionality in anomaly detection in thermal image datasets is crucial for defect detection of industrial products. Nevertheless, achieving reliable functionality is challenging, especially when datasets are image sequences captured during equipment runtime with a smooth transition from healthy to defective images. This causes contamination of healthy training data with defective samples. Anomaly detection methods based on autoencoders are susceptible to a slight violation of a clean training dataset and lead to challenging threshold determination for sample classification. This paper indicates that combining anomaly scores leads to better threshold determination that effectively separates healthy and defective data. Our research results show that our approach helps to overcome these challenges. The autoencoder models in our research are trained with healthy images optimizing two loss functions: mean squared error (MSE) and structural similarity index measure (SSIM). Anomaly score outputs are used for classification. Three anomaly scores are applied: MSE, SSIM, and kernel density estimation (KDE). The proposed method is trained and tested on the 32 x 32-sized thermal images, including one contaminated dataset. The model achieved the following average accuracies across the datasets: MSE, 95.33%; SSIM, 88.37%; and KDE, 92.81%. Using a combination of anomaly scores could assist in solving a low classification accuracy. The use of KDE improves performance when healthy training data are contaminated. The MSE+ and SSIM+ methods, as well as two parameters to control quantitative anomaly localization using SSIM, are introduced.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Dynamic video anomaly detection and localization using sparse denoising autoencoders
    Medhini G. Narasimhan
    Sowmya Kamath S.
    Multimedia Tools and Applications, 2018, 77 : 13173 - 13195
  • [22] Improved Anomaly Detection and Localization Using Whitening-Enhanced Autoencoders
    Wang, Chenguang
    Tindemans, Simon H.
    Palensky, Peter
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (01) : 659 - 668
  • [23] Dynamic video anomaly detection and localization using sparse denoising autoencoders
    Narasimhan, Medhini G.
    Kamath, Sowmya S.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (11) : 13173 - 13195
  • [24] Unsupervised pathology detection in medical images using conditional variational autoencoders
    Hristina Uzunova
    Sandra Schultz
    Heinz Handels
    Jan Ehrhardt
    International Journal of Computer Assisted Radiology and Surgery, 2019, 14 : 451 - 461
  • [25] Overlay of thermal and visual medical images using skin detection and image registration
    Schaefer, Gerald
    Tait, Roger
    Zhu, Shao Ying
    2006 28TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-15, 2006, : 3844 - +
  • [26] Change Detection in Satellite Images Using Reconstruction Errors of Joint Autoencoders
    Kalinicheva, Ekaterina
    Sublime, Jeremie
    Trocan, Maria
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: IMAGE PROCESSING, PT III, 2019, 11729 : 637 - 648
  • [27] Unsupervised pathology detection in medical images using conditional variational autoencoders
    Uzunova, Hristina
    Schultz, Sandra
    Handels, Heinz
    Ehrhardt, Jan
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2019, 14 (03) : 451 - 461
  • [28] Solar Panel Damage Detection and Localization of Thermal Images
    Jaybhaye, Sangita
    Thakur, Om
    Yardi, Rajas
    Raut, Ved
    Raut, Aditya
    JOURNAL OF FAILURE ANALYSIS AND PREVENTION, 2023, 23 (05) : 1980 - 1990
  • [29] Solar Panel Damage Detection and Localization of Thermal Images
    Sangita Jaybhaye
    Om Thakur
    Rajas Yardi
    Ved Raut
    Aditya Raut
    Journal of Failure Analysis and Prevention, 2023, 23 (5) : 1980 - 1990
  • [30] A drift detection method for industrial images based on a defect segmentation model
    Li, Weifeng
    Li, Bin
    Wang, Zhenrong
    Qiu, Chaochao
    Niu, Shuanlong
    Tan, Xin
    Niu, Tongzhi
    KNOWLEDGE-BASED SYSTEMS, 2024, 301