Research of U-Net-Based CNN Architectures for Metal Surface Defect Detection

被引:30
|
作者
Konovalenko, Ihor [1 ]
Maruschak, Pavlo [1 ]
Brezinova, Janette [2 ]
Prentkovskis, Olegas [3 ]
Brezina, Jakub [2 ]
机构
[1] Ternopil Natl Ivan Puluj Tech Univ, Dept Ind Automat, Ruska Str 56, UA-46001 Ternopol, Ukraine
[2] Tech Univ Kosice, Fac Mech Engn, Dept Technol Mat & Comp Supported Prod, Masiarska 74, Kosice 04001, Slovakia
[3] Vilnius Gediminas Tech Univ, Dept Mobile Machinery & Railway Transport, Plytines G 27, LT-10101 Vilnius, Lithuania
关键词
surface defect detection; visual inspection technology; image segmentation; CNN optimizer; strip surface; metallurgy; CLASSIFICATION;
D O I
10.3390/machines10050327
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The quality, wear and safety of metal structures can be controlled effectively, provided that surface defects, which occur on metal structures, are detected at the right time. Over the past 10 years, researchers have proposed a number of neural network architectures that have shown high efficiency in various areas, including image classification, segmentation and recognition. However, choosing the best architecture for this particular task is often problematic. In order to compare various techniques for detecting defects such as "scratch abrasion", we created and investigated U-Net-like architectures with encoders such as ResNet, SEResNet, SEResNeXt, DenseNet, InceptionV3, Inception-ResNetV2, MobileNet and EfficientNet. The relationship between training validation metrics and final segmentation test metrics was investigated. The correlation between the loss function, the DSC, IoU, Recall, Precision and Fl validation metrics and DSC test metrics was calculated. Recognition accuracy was analyzed as affected by the optimizer during neural network training. In the context of this problem, neural networks trained using the stochastic gradient descent optimizer with Nesterov momentum were found to have the best generalizing properties. To select the best model during its training on the basis of the validation metrics, the main test metrics of recognition quality (Dice similarity coefficient) were analyzed depending on the validation metrics. The ResNet and DenseNet models were found to achieve the best generalizing properties for our task. The highest recognition accuracy was attained using the U-Net model with a ResNet152 backbone. The results obtained on the test dataset were DSC = 0.9304 and IoU = 0.9122.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] A Transfer Learning and U-Net-based automatic detection of diabetic retinopathy from fundus images
    Bilal, Anas
    Sun, Guangmin
    Mazhar, Sarah
    Imran, Azhar
    Latif, Jahanzaib
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2022, 10 (06): : 663 - 674
  • [32] Research on surface defect detection and fault diagnosis of mechanical gear based on R-CNN
    Guo W.
    Advanced Control for Applications: Engineering and Industrial Systems, 2024, 6 (02):
  • [33] Product Surface Defect Detection Based on CNN Ensemble with Rejection
    Su, Kai
    Zhao, Qiangfu
    Lien, Po Chun
    IEEE 17TH INT CONF ON DEPENDABLE, AUTONOM AND SECURE COMP / IEEE 17TH INT CONF ON PERVAS INTELLIGENCE AND COMP / IEEE 5TH INT CONF ON CLOUD AND BIG DATA COMP / IEEE 4TH CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2019, : 326 - 331
  • [34] U-Net-based RGB and LiDAR image fusion for road segmentation
    Arda Taha Candan
    Habil Kalkan
    Signal, Image and Video Processing, 2023, 17 : 2837 - 2843
  • [35] Surface defect detection of CFRP materials based on infrared thermography and Attention U-Net algorithm
    Zhou, Guangyu
    Zhang, Zhijie
    Yin, Wuliang
    Chen, Haoze
    Wang, Luxiang
    Wang, Dong
    Ma, Huidong
    NONDESTRUCTIVE TESTING AND EVALUATION, 2024, 39 (02) : 238 - 257
  • [36] Research on a Metal Surface Defect Detection Algorithm Based on DSL-YOLO
    Wang, Zhiwen
    Zhao, Lei
    Li, Heng
    Xue, Xiaojun
    Liu, Hui
    SENSORS, 2024, 24 (19)
  • [37] Research on Defect Detection Method for Steel Metal Surface based on Deep Learning
    Gai, Xiaoyang
    Ye, Peiran
    Wang, Jinglin
    Wang, Bingquan
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 642 - 646
  • [38] SIMULATION RESEARCH OF METAL DEFECT DETECTION BASED ON LASER UNTRASONIC SURFACE WAVE
    Deng, Sen
    Zhao, Bo
    2022 16TH SYMPOSIUM ON PIEZOELECTRICITY, ACOUSTIC WAVES, AND DEVICE APPLICATIONS, SPAWDA, 2022, : 633 - 637
  • [39] U-Net-Based Multispectral Image Generation From an RGB Image
    Zeng, Tao
    Diao, Changyu
    Lu, Dongming
    IEEE ACCESS, 2021, 9 : 43387 - 43396
  • [40] Multiscale U-net-based accelerated magnetic resonance imaging reconstruction
    Dhengre, Nikhil
    Sinha, Saugata
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (04) : 881 - 888