EDSV-Net: An efficient defect segmentation network based on visual attention and visual perception

被引:1
|
作者
Huang, Yanqing [1 ]
Jing, Junfeng [1 ]
Sheng, Siyu [1 ]
Wang, Zhen [1 ]
机构
[1] Xian Polytech Univ, Coll Elect & Informat, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Surface defect detection; Defect segmentation; Convolutional neural network; Visual attention; Multi-scale; Structural similarity measure; INSPECTION; IMAGES; FEATURES;
D O I
10.1016/j.eswa.2023.121529
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In industrial production, surface defect detection algorithms based on convolutional neural networks have been widely studied to improve production quality. However, for practical applications, there are still many issues to be solved, such as the complexity and diversity of defect categories, the difficulty of obtaining defect samples, and the difficulty of existing algorithms in accurately segmenting defects. To solve these issues, we present an effective defect segmentation network based on visual attention and visual perception termed EDSV-Net. Specifically, we use ResNet18 as the backbone network in EDSV-Net. Then a multi-scale feature extraction (MSFE) module is introduced to enhance the scale invariance of high-level features and the diversity of contextual features. In addition, a spatial attention (SA) model combined with a channel attention (CA) model is applied to low level features and MSFE features, respectively, to extract more effective spatial and semantic information. Moreover, a depthwise separable convolution is introduced to reduce the network complexity. Finally, due to the issues of existing defect detection algorithms ignoring structural similarity and defects being difficult to obtain, we design a balanced defect and structural measure loss function. Meanwhile, we propose a structural similarity measure, which combines the pixel similarity for evaluation. EDSV-Net only requires no more than 60 random abnormal samples to obtain accurate segmentation results and the real-time performance meets the requirements of actual industrial production. Based on three challenging real-world defect datasets, the results of the evaluation demonstrate that EDSV-Net outperforms seven state-of-the-art methods on accuracy and real-time performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] PointAS: an attention based sampling neural network for visual perception
    Qiu, Bozhi
    Li, Sheng
    Wang, Lei
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2024, 18
  • [3] Fabric defect image segmentation based on the visual attention mechanism of the wavelet domain
    Guan, Shengqi
    Gao, Zhaoyuan
    TEXTILE RESEARCH JOURNAL, 2014, 84 (10) : 1018 - 1033
  • [4] Attention and visual perception
    Boynton, GM
    CURRENT OPINION IN NEUROBIOLOGY, 2005, 15 (04) : 465 - 469
  • [5] EANTrack: An Efficient Attention Network for Visual Tracking
    Gu, Fengwei
    Lu, Jun
    Cai, Chengtao
    Zhu, Qidan
    Ju, Zhaojie
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, 21 (04) : 1 - 18
  • [6] Image segmentation based on visual attention mechanism
    Zhang, Qiaorong
    Gu, Guochang
    Xiao, Huimin
    Journal of Multimedia, 2009, 4 (06): : 363 - 370
  • [7] Autonomous incremental visual environment perception based on visual selective attention
    Ban, Sang-Woo
    Lee, Minho
    2007 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-6, 2007, : 1411 - +
  • [8] VPA-Net: A visual perception assistance network for 3d lidar semantic segmentation
    Lin, Fangfang
    Lin, Tianliang
    Yao, Yu
    Ren, Haoling
    Wu, Jiangdong
    Cai, Qipeng
    Pattern Recognition, 2025, 158
  • [9] Application of Visual Attention Network in Workpiece Surface Defect Detection
    Wang Y.
    Du H.
    Zhang X.
    Xu Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (09): : 1528 - 1534
  • [10] DISSOCIATED PERCEPTION OF A VISUAL DEFECT
    BENDER, AL
    JOURNAL OF NERVOUS AND MENTAL DISEASE, 1984, 172 (06) : 364 - 368