EDSV-Net: An efficient defect segmentation network based on visual attention and visual perception

被引:1
|
作者
Huang, Yanqing [1 ]
Jing, Junfeng [1 ]
Sheng, Siyu [1 ]
Wang, Zhen [1 ]
机构
[1] Xian Polytech Univ, Coll Elect & Informat, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Surface defect detection; Defect segmentation; Convolutional neural network; Visual attention; Multi-scale; Structural similarity measure; INSPECTION; IMAGES; FEATURES;
D O I
10.1016/j.eswa.2023.121529
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In industrial production, surface defect detection algorithms based on convolutional neural networks have been widely studied to improve production quality. However, for practical applications, there are still many issues to be solved, such as the complexity and diversity of defect categories, the difficulty of obtaining defect samples, and the difficulty of existing algorithms in accurately segmenting defects. To solve these issues, we present an effective defect segmentation network based on visual attention and visual perception termed EDSV-Net. Specifically, we use ResNet18 as the backbone network in EDSV-Net. Then a multi-scale feature extraction (MSFE) module is introduced to enhance the scale invariance of high-level features and the diversity of contextual features. In addition, a spatial attention (SA) model combined with a channel attention (CA) model is applied to low level features and MSFE features, respectively, to extract more effective spatial and semantic information. Moreover, a depthwise separable convolution is introduced to reduce the network complexity. Finally, due to the issues of existing defect detection algorithms ignoring structural similarity and defects being difficult to obtain, we design a balanced defect and structural measure loss function. Meanwhile, we propose a structural similarity measure, which combines the pixel similarity for evaluation. EDSV-Net only requires no more than 60 random abnormal samples to obtain accurate segmentation results and the real-time performance meets the requirements of actual industrial production. Based on three challenging real-world defect datasets, the results of the evaluation demonstrate that EDSV-Net outperforms seven state-of-the-art methods on accuracy and real-time performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] The PCNN adaptive segmentation algorithm based on visual perception
    Zhao, Yanming
    PIAGENG 2013: IMAGE PROCESSING AND PHOTONICS FOR AGRICULTURAL ENGINEERING, 2013, 8761
  • [22] Visual Localization and Target Perception Based on Panoptic Segmentation
    Lv, Kefeng
    Zhang, Yongsheng
    Yu, Ying
    Zhang, Zhenchao
    Li, Lei
    REMOTE SENSING, 2022, 14 (16)
  • [23] Dual Visual Attention Network for Visual Dialog
    Guo, Dan
    Wang, Hui
    Wang, Meng
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 4989 - 4995
  • [24] Facilitation of Visual Perception in Head Direction: Visual Attention Modulation Based on Head Direction
    Nakashima, Ryoichi
    Shioiri, Satoshi
    PLOS ONE, 2015, 10 (04):
  • [25] An Efficient Method for Infrared and Visual Images Fusion Based on Visual Attention Technique
    Liu, Yaochen
    Dong, Lili
    Chen, Yang
    Xu, Wenhai
    REMOTE SENSING, 2020, 12 (05)
  • [26] Segmentation, attention and phenomenal visual objects
    Driver, J
    Davis, G
    Russell, C
    Turatto, M
    Freeman, E
    COGNITION, 2001, 80 (1-2) : 61 - 95
  • [27] Pavement Disease Visual Detection by Structure Perception and Feature Attention Network
    Lv, Bin
    Zhang, Shuo
    Gong, Haixia
    Zhang, Hongbo
    Dong, Bin
    Wang, Jianzhu
    Du, Cong
    Wu, Jianqing
    APPLIED SCIENCES-BASEL, 2025, 15 (02):
  • [28] Interactions of visual attention and quality perception
    Redi, Judith
    Liu, Hantao
    Zunino, Rodolfo
    Heynderickx, Ingrid
    HUMAN VISION AND ELECTRONIC IMAGING XVI, 2011, 7865
  • [29] Attention modulates perception of visual space
    Zhou, Liu
    Deng, Chenglong
    Ooi, Teng Leng
    He, Zijiang J.
    NATURE HUMAN BEHAVIOUR, 2017, 1 (01):
  • [30] On the role of selective attention in visual perception
    Luck, SJ
    Ford, MA
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1998, 95 (03) : 825 - 830