SIA-net: Structural information awareness network based on normal samples for surface defect detection

被引:7
|
作者
Ma, Qiurui [1 ]
Zhang, Erhu [2 ]
Chen, Yajun [2 ]
Duan, Jinghong [3 ]
Shao, Linhao [2 ]
机构
[1] Xian Univ Technol, Sch Mech & Precis Instrument Engn, Xian 710048, Peoples R China
[2] Xian Univ Technol, Dept Informat Sci, Xian 710048, Peoples R China
[3] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Peoples R China
关键词
Surface defect detection; Structural information awareness; Generative adversarial network; INSPECTION; SEGMENTATION; FRAMEWORK; VISION;
D O I
10.1016/j.engappai.2023.107131
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Surface defect detection is a challenging task in industrial manufacturing, and the detection method based on deep learning has become the mainstream trend in the industry. However, this method requires a large number of labeled datasets for network training, and it cannot detect new types of defects randomly generated in the actual production process, making it difficult to transfer to actual production. To address this problem, we propose a structural information awareness network (SIA-Net). It is constructed by the adaptive generative adjunctive network (AGAN) module, which can simulate the background style of defect-free samples to randomly embed more reasonable defects. Then, the model is trained to recover the defect embedded area and the defect area is inferred according to the difference between before and after image restoration. Furthermore, in order to avoid blurring the image structure information during feature extraction, the self-attention encoder (SE) and spatial awareness decoder (SD) modules are designed to aggregate the image structure information to generate the final prediction results. We selected four public datasets and specially developed a box defect dataset to verify its detection effect. Experimental results (mIoU/mPA) (Kolektor: 88.91%/89.55%, AITEX defect: 89.61%/ 91.46%, RSDDs: 86.89%/87.88%, MT defect: 88.36%/90.32%, box defect: 89.71%/90.57%) show that our proposed method clearly outperforms the current unsupervised detection methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] SSCT-Net: A Semisupervised Circular Teacher Network for Defect Detection With Limited Labeled Multiview MFL Samples
    Shen, Xiangkai
    Liu, Jinhai
    Sun, Jiayue
    Jiang, Lin
    Zhao, He
    Zhang, Huaguang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (10) : 10114 - 10124
  • [32] Network social media information leakage detection based on link state awareness
    Qi D.
    Guangming D.
    International Journal of Web Based Communities, 2022, 18 (3-4) : 318 - 328
  • [33] Rail surface defect detection using a transformer-based network
    Guo, Feng
    Liu, Jian
    Qian, Yu
    Xie, Quanyi
    JOURNAL OF INDUSTRIAL INFORMATION INTEGRATION, 2024, 38
  • [34] Bearing surface defect detection based on improved convolutional neural network
    Fu, Xian
    Yang, Xiao
    Zhang, Ningning
    Zhang, RuoGu
    Zhang, Zhuzhu
    Jin, Aoqun
    Ye, Ruiwen
    Zhang, Huiling
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (07) : 12341 - 12359
  • [35] Metal Surface Defect Detection Based on IADSA Deep Transfer Network
    Su L.
    Wang L.
    Qi Y.
    Zhang S.
    Gu J.
    Li K.
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2023, 59 (24): : 46 - 55
  • [36] Gear Surface Defect Detection Method Based on Improved YOLOx Network
    Zhang Shuwen
    Zhong Zhenyu
    Zhu Dahu
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (22)
  • [37] A Weakly Supervised Surface Defect Detection Based on Convolutional Neural Network
    Xu, Liang
    Lv, Shuai
    Deng, Yong
    Li, Xiuxi
    IEEE ACCESS, 2020, 8 : 42285 - 42296
  • [38] A New Improved YOLO based Network for PCB Surface Defect Detection
    Fei, Yihong
    Xie, Binyang
    Zhang, Jingya
    Jin, Yixin
    Pan, Ziyi
    Yuan, Chenyue
    2024 6TH INTERNATIONAL CONFERENCE ON DATA-DRIVEN OPTIMIZATION OF COMPLEX SYSTEMS, DOCS 2024, 2024, : 864 - 869
  • [39] Research of U-Net-Based CNN Architectures for Metal Surface Defect Detection
    Konovalenko, Ihor
    Maruschak, Pavlo
    Brezinova, Janette
    Prentkovskis, Olegas
    Brezina, Jakub
    MACHINES, 2022, 10 (05)
  • [40] Workpiece Surface Defect Detection Based on Prototype Network With Blur Pooling
    Tan, Ling
    Guo, WeiYu
    Wang, JingQiu
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 8360 - 8365