EDSV-Net: An efficient defect segmentation network based on visual attention and visual perception

被引:1
|
作者
Huang, Yanqing [1 ]
Jing, Junfeng [1 ]
Sheng, Siyu [1 ]
Wang, Zhen [1 ]
机构
[1] Xian Polytech Univ, Coll Elect & Informat, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Surface defect detection; Defect segmentation; Convolutional neural network; Visual attention; Multi-scale; Structural similarity measure; INSPECTION; IMAGES; FEATURES;
D O I
10.1016/j.eswa.2023.121529
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In industrial production, surface defect detection algorithms based on convolutional neural networks have been widely studied to improve production quality. However, for practical applications, there are still many issues to be solved, such as the complexity and diversity of defect categories, the difficulty of obtaining defect samples, and the difficulty of existing algorithms in accurately segmenting defects. To solve these issues, we present an effective defect segmentation network based on visual attention and visual perception termed EDSV-Net. Specifically, we use ResNet18 as the backbone network in EDSV-Net. Then a multi-scale feature extraction (MSFE) module is introduced to enhance the scale invariance of high-level features and the diversity of contextual features. In addition, a spatial attention (SA) model combined with a channel attention (CA) model is applied to low level features and MSFE features, respectively, to extract more effective spatial and semantic information. Moreover, a depthwise separable convolution is introduced to reduce the network complexity. Finally, due to the issues of existing defect detection algorithms ignoring structural similarity and defects being difficult to obtain, we design a balanced defect and structural measure loss function. Meanwhile, we propose a structural similarity measure, which combines the pixel similarity for evaluation. EDSV-Net only requires no more than 60 random abnormal samples to obtain accurate segmentation results and the real-time performance meets the requirements of actual industrial production. Based on three challenging real-world defect datasets, the results of the evaluation demonstrate that EDSV-Net outperforms seven state-of-the-art methods on accuracy and real-time performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Feature-based attention warps the perception of visual features
    Chapman, Angus F.
    Chunharas, Chaipat
    Stormer, Viola S.
    SCIENTIFIC REPORTS, 2023, 13 (01):
  • [42] ELA-Net: An Efficient Lightweight Attention Network for Skin Lesion Segmentation
    Nie, Tianyu
    Zhao, Yishi
    Yao, Shihong
    SENSORS, 2024, 24 (13)
  • [43] The visual attention network untangled
    Sander Nieuwenhuis
    Tobias H Donner
    Nature Neuroscience, 2011, 14 : 542 - 543
  • [44] The visual attention network untangled
    Nieuwenhuis, Sander
    Donner, Tobias H.
    NATURE NEUROSCIENCE, 2011, 14 (05) : 542 - 543
  • [45] Visual scene segmentation based on neural oscillator network
    Jin, Z. (jinzhuo1978@hotmail.com), 1600, Editorial Board of Jilin University (43):
  • [46] CRA-Net: Composed Relation Attention Network for Visual Question Answering
    Peng, Liang
    Yang, Yang
    Wang, Zheng
    Wu, Xiao
    Huang, Zi
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1202 - 1210
  • [47] Improved U-Net-Like Network for Visual Saliency Detection Based on Pyramid Feature Attention
    Gong, Xiaoran
    Qingge, Letu
    Liu, Qing
    Yang, Pei
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [48] Pulse Couple Neural Network Based on Visual Perception
    Pan, Gai
    Kong, Xiangyong
    6TH ANNUAL INTERNATIONAL WORKSHOP ON MATERIALS SCIENCE AND ENGINEERING, 2020, 1622
  • [49] Biological visual attention convolutional neural network for aircraft skin defect detection
    Zhao J.
    Huang K.
    Wang G.
    Wang L.
    Wang B.
    Zhou Y.
    Li H.
    Measurement: Sensors, 2024, 31
  • [50] CCTseg: A cascade composite transformer semantic segmentation network for UAV visual perception
    Yi, Shi
    Li, Junjie
    Jiang, Gang
    Liu, Xi
    Chen, Ling
    MEASUREMENT, 2023, 211