A real-time anchor-free defect detector with global and local feature enhancement for surface defect detection

被引:2
|
作者
Liu, Qing [1 ]
Liu, Min [1 ]
Jonathan, Q. M. [2 ]
Shen, Weiming [3 ]
机构
[1] Tongji Univ, Sch Elect & Informat Engn, Shanghai 201800, Peoples R China
[2] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[3] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Hubei, Peoples R China
关键词
Industrial surface defect detection; Real-time anchor-free defect detector; Global feature enhancement module; Local feature enhancement module; Box refinement module;
D O I
10.1016/j.eswa.2024.123199
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Industrial surface defect detection (ISDD) is vital for manufacturing enterprises to control product quality. Many general object detection (GOD) methods are utilized in this field. However, they rarely take into full account the characteristics of industrial defects. We identify three crucial characteristics in ISDD: complex background, small size defect and irregular shape. To copy with it, in this paper, we proposed a novel real-time anchorfree defect detector for ISDD. Firstly, to reduce noise interfere from complex background, we proposed global feature enhancement module (GFEM) to enhance high-level feature's ability in modeling global information so that background noises are alleviated. Secondly, to enhance small size defect's feature, we introduced local feature enhancement module (LFEM). It enhances small size defect's feature by amplifying local peaks in lowlevel features. Thirdly, we introduced box refinement module (BRM) to capture defect's shape information to provide more accurate prediction result. Lastly, we evaluated the proposed defect detector's effectiveness using three public ISDD datasets. The experimental results are promising: our detector achieves a mAP of 92.0% on PVEL_AD, 99.6% on the PCB defect dataset, and 81.6% on NEU-DET. These scores outperform state-of-the-art methods, proving the superiority of our proposed detector. Additionally, it reached 46.1 FPS on the PVEL_AD dataset, showing its capability for real-time detection.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] FlashNet: A Real-time Anchor-Free Face Detector
    Ge, Yongtao
    Wang, Qiang
    Sheng, Biyun
    Yang, Wankou
    [J]. 2020 35TH YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2020, : 441 - 446
  • [2] A Robust Real-Time Anchor-Free Traffic Sign Detector With One-Level Feature
    Zhang, Jianming
    Lv, Yaru
    Tao, Jiajun
    Huang, Fengxiang
    Zhang, Jin
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1437 - 1451
  • [3] Fabric defect detection based on anchor-free network
    Wang, Xianbao
    Fang, Weijie
    Xiang, Sheng
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (12)
  • [4] An Anchor-Free Defect Detector for Complex Background Based on Pixelwise Adaptive Multiscale Feature Fusion
    Lu, Hantong
    Fang, Mengyuan
    Qiu, Ying
    Xu, Weiqiang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [5] An Anchor-Free Defect Detector for Complex Background Based on Pixelwise Adaptive Multiscale Feature Fusion
    Lu, Hantong
    Fang, Mengyuan
    Qiu, Ying
    Xu, Weiqiang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [6] An Anchor-Free Defect Detector for Complex Background Based on Pixelwise Adaptive Multiscale Feature Fusion
    Lu, Hantong
    Fang, Mengyuan
    Qiu, Ying
    Xu, Weiqiang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [7] D-CenterNet: An Anchor-Free Detector With Knowledge Distillation for Industrial Defect Detection
    Liu, Zhiwei
    Lyu, Wentao
    Wang, Chengqun
    Guo, Qing
    Zhou, Di
    Xu, Weiqiang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [8] Real-Time Robotic Multigrasp Detection Using Anchor-Free Fully Convolutional Grasp Detector
    Wu, Yongxiang
    Zhang, Fuhai
    Fu, Yili
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (12) : 13171 - 13181
  • [9] Surface Defect Detection of Steel Strips Based on Anchor-Free Network With Channel Attention and Bidirectional Feature Fusion
    Yu, Jianbo
    Cheng, Xun
    Li, Qingfeng
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [10] Real-time fire detection algorithm with Anchor-Free network architecture
    Jin, Yao
    Zhang, Wei
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2020, 54 (12): : 2430 - 2436