A Pixel-Level Segmentation Convolutional Neural Network Based on Global and Local Feature Fusion for Surface Defect Detection

被引:5
|
作者
Zuo, Lei [1 ]
Xiao, Hongyong [1 ]
Wen, Long [1 ]
Gao, Liang [2 ]
机构
[1] China Univ Geosci, Sch Mech Engn & Elect Informat, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Convolutional neural networks; Surface cracks; Convolutional neural network; feature fusion; global mapping branch (GMB); pixel-level segmentation; surface defect detection (SDD);
D O I
10.1109/TIM.2023.3323004
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface defect detection (SDD) is a fundamental task in the smart industry to ensure product quality. Due to the complexity and diversity of the industrial scenes and the low contrast and tiny sizes of the defect, it is still difficult to accurately segment the defect. To overcome these issues, this research studied the pixel-level segmentation convolutional neural network based on multi-scale features, global mapping, feature pyramid and attention mechanisms (MMPA-Net). First, the low- and high-level features are extracted as the multiscale network to enrich the defect features information. Second, the global and local feature fusion (GLF) with the global mapping branch (GMB) module is developed to gradually refine the defect details to promote the detection of defects with different sizes and shapes. Third, deep supervision is applied to the global feature map and multiscale prediction maps to train MMPA-Net. MMPA-Net has been conducted on three public SDD datasets, and the results show that MMPA-Net has achieved state-of-the-art results on the intersection over union (IoU) by comparing with other deep learning (DL) methods (NEU-Seg: 86.62%, DAGM 2007: 87.94%, MT: 84.23%).
引用
收藏
页数:10
相关论文
共 50 条
  • [1] A Pixel-Level Segmentation Convolutional Neural Network Based on Deep Feature Fusion for Surface Defect Detection
    Cao, Jingang
    Yang, Guotian
    Yang, Xiyun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [2] A pixel-level deep segmentation network for automatic defect detection
    Yang, Lei
    Xu, Shuai
    Fan, Junfeng
    Li, En
    Liu, Yanhong
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 215
  • [3] An Automatic Deep Segmentation Network for Pixel-Level Welding Defect Detection
    Yang, Lei
    Song, Shouan
    Fan, Junfeng
    Huo, Benyan
    Li, En
    Liu, Yanhong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [4] Automatic pixel-level crack segmentation in images using fully convolutional neural network based on residual blocks and pixel local weights
    Ali, Raza
    Chuah, Joon Huang
    Abu Talip, Mohamad Sofian
    Mokhtar, Norrima
    Shoaib, Muhammad Ali
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 104
  • [5] ASFormer: attentive semantic feature fusion transformer for pixel-level defect detection
    Zhu, Qinmiao
    Hu, Huan
    Liu, Teng
    Yang, Hua
    Measurement Science and Technology, 2025, 36 (02)
  • [6] InceptionV3 based enriched feature integration network architecture for pixel-level surface defect detection
    Uzen, Huseyin
    Turkoglu, Muammer
    Ari, Ali
    Hanbay, Davut
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2023, 38 (02): : 721 - 732
  • [7] Multi-focus image fusion algorithm based on pixel-level convolutional neural network
    Shen, Xuan-Jing
    Zhang, Xue-Feng
    Wang, Yu
    Jin, Yu-Bo
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (08): : 1857 - 1864
  • [8] Pixel-level crack delineation in images with convolutional feature fusion
    Ni, FuTao
    Zhang, Jian
    Chen, ZhiQiang
    STRUCTURAL CONTROL & HEALTH MONITORING, 2019, 26 (01):
  • [9] Adaptive spatial pixel-level feature fusion network for multispectral pedestrian detection
    Fu, Lei
    Gu, Wen-bin
    Ai, Yong-bao
    Li, Wei
    Wang, Dong
    INFRARED PHYSICS & TECHNOLOGY, 2021, 116
  • [10] Adaptive spatial pixel-level feature fusion network for multispectral pedestrian detection
    Fu, Lei
    Gu, Wen-bin
    Ai, Yong-bao
    Li, Wei
    Wang, Dong
    Infrared Physics and Technology, 2021, 116