Automatic zipper tape defect detection using two-stage multi-scale convolutional networks

被引:16
|
作者
Fang, Houzhang [1 ]
Xia, Mingjiang [1 ]
Liu, Hehui [2 ]
Chang, Yi [3 ]
Wang, Liming [1 ]
Liu, Xiyang [1 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Software Engn Inst, Xian 710071, Peoples R China
[2] Nanjing Cognit Internet Things Res Inst, Nanjing 210001, Peoples R China
[3] Artificial Intelligence Res Ctr, Pengcheng Lab, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Automatic defect detection; Zipper tape inspection; Fully convolutional neural network; Feature fusion; Multi-scale detection;
D O I
10.1016/j.neucom.2020.09.046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Defects inevitably occur during the manufacturing process of the zipper, significantly affecting its value. Zipper inspection is of significant importance in ensuring the quality of the zipper products. Traditional zipper inspection requires skilled inspectors and is labor-intensive, inefficient, and inaccurate. Currently, automated zipper defects inspection with high precision and high efficiency is still very challenging. In this paper, we propose a novel zipper tape defect detection framework based on fully convolutional networks in a two-stage coarse-to-fine cascade manner. For our special application, the zipper tape defects have multi-scale characteristics. Most of the existing deep learning methods have great advantages in detecting the large-scale defects with prominent features, but are prone to fail in detecting the smallscale ones due to their less remarkable features as well as their general location in a large background area. Thus, we propose to detect first the large local context regions containing the small-scale defects using a multi-scale detection architecture with high efficiency, which integrates a new detection branch by fusing the features in the shallow layer into the high-level layer to boost the detection performance of the context regions. Then we finely detect the small-scale defects from the local context regions detected in the first stage, which can be regarded as large-scale objects that are more easily detected. Extensive comparative experiments demonstrate that the proposed method offers a high detection accuracy while still having high detection efficiency compared with the state-of-the-art methods, coupled with good robustness in some complex cases. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:34 / 50
页数:17
相关论文
共 50 条
  • [1] A Multi-scale Pyramid of Fully Convolutional Networks for Automatic Cell Detection
    Gu, Jiang
    Zhu, Yichen
    Yang, Bohong
    Jia, Jingkai
    Wang, Juanjuan
    Yang, Jian
    Zhang, Wenqiang
    PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 633 - 636
  • [2] Automatic Fabric Defect Detection with a Multi-Scale Convolutional Denoising Autoencoder Network Model
    Mei, Shuang
    Wang, Yudan
    Wen, Guojun
    SENSORS, 2018, 18 (04)
  • [3] FAST PEDESTRIAN DETECTION WITH MULTI-SCALE ORIENTATION FEATURES AND TWO-STAGE CLASSIFIERS
    Ye, Qixiang
    Jiao, Jianbin
    Zhang, Baochang
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 881 - 884
  • [4] Fully Automatic Aortic Valve Landmarks Detection with Two-stage Based Convolutional Neural Networks
    Ma, Qixiang
    Lemarchand, Leo
    Chan-Sock-Line, Diane
    Rigal, Louis
    Simon, Antoine
    Haigron, Pascal
    MEDICAL IMAGING 2023, 2023, 12464
  • [5] Two-stage streaming keyword detection and localization with multi-scale depthwise temporal convolution
    Hou, Jingyong
    Xie, Lei
    Zhang, Shilei
    NEURAL NETWORKS, 2022, 150 : 28 - 42
  • [6] Two-stage streaming keyword detection and localization with multi-scale depthwise temporal convolution
    Hou, Jingyong
    Xie, Lei
    Zhang, Shilei
    Neural Networks, 2022, 150 : 28 - 42
  • [7] Cooperative Multi-Scale Convolutional Neural Networks for Person Detection
    Eisenbach, Markus
    Seichter, Daniel
    Wengefeld, Tim
    Gross, Horst-Michael
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 267 - 276
  • [8] Atrial Fibrillation Detection by Multi-scale Convolutional Neural Networks
    Yao, Zhenjie
    Zhu, Zhiyong
    Chen, Yixin
    2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2017, : 1159 - 1164
  • [9] A Two-Stage Convolutional Neural Networks for Lung Nodule Detection
    Cao, Haichao
    Liu, Hong
    Song, Enmin
    Ma, Guangzhi
    Xu, Xiangyang
    Jin, Renchao
    Liu, Tengying
    Hung, Chih-Cheng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (07) : 2006 - 2015
  • [10] A multi-branch multi-scale convolutional neural network using automatic detection of fetal arrhythmia
    Kanna, S. K. Rajesh
    Shajin, Francis H.
    Rajesh, P.
    Mannepalli, Kasiprasad
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 87 - 96