Internal defects inspection of arc magnets using multi-head attention-based CNN

被引:8
|
作者
Li, Qiang [1 ]
Huang, Qinyuan [1 ,2 ]
Yang, Tian [1 ]
Zhou, Ying [1 ]
Yang, Kun [1 ]
Song, Hong [2 ]
机构
[1] Sichuan Univ Sci & Engn, Sch Automat & Informat Engn, Zigong 643000, Peoples R China
[2] Artificial Intelligence Key Lab Sichuan Prov, Zigong 643000, Peoples R China
关键词
Convolutional neural network; Multi -head attention; Defect detection; Arc magnets; Classification; CONVOLUTIONAL NEURAL-NETWORK; BEARING FAULT-DIAGNOSIS; LITHIUM-ION BATTERIES; OF-CHARGE ESTIMATION; CLASSIFICATION; TILE;
D O I
10.1016/j.measurement.2022.111808
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Arc magnets are the key components of various motor machinery, and their internal defects detection is extremely significant for maintaining system performance and ensuring operational safety. In this paper, an endto-end improved convolutional neural network (CNN) model based on multi-head attention is presented, where features that play a more important role in defect detection could be efficiently highlighted. In addition, owing to the characteristics of strong parallel working ability in multi-head attention, the training process is greatly accelerated. Meanwhile, to meet the requirements of the model on the amount of data, a data augmentation method is designed accordingly. Then, the performance of the constructed framework is verified in different test scenarios. Experiment results demonstrate that the presented approach owns superior inspection performance based on relatively fewer model parameters compared to other existing methods, even under the small sample, intense noise, and the coexistence of noise and insufficient data.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Sentiment Analysis Using Multi-Head Attention Capsules With Multi-Channel CNN and Bidirectional GRU
    Cheng, Yan
    Sun, Huan
    Chen, Haomai
    Li, Meng
    Cai, Yingying
    Cai, Zhuang
    Huang, Jing
    IEEE ACCESS, 2021, 9 : 60383 - 60395
  • [22] Short Text Sentiment Analysis Based on Multi-Channel CNN With Multi-Head Attention Mechanism
    Feng, Yue
    Cheng, Yan
    IEEE ACCESS, 2021, 9 : 19854 - 19863
  • [23] Estimating ocean thermocline from satellite observations with a multi-head attention-based neural network
    Deng, Fangyu
    Pan, Yanxi
    Wang, Jichao
    OCEAN DYNAMICS, 2025, 75 (02)
  • [24] A multi-head adjacent attention-based pyramid layered model for nested named entity recognition
    Shengmin Cui
    Inwhee Joe
    Neural Computing and Applications, 2023, 35 : 2561 - 2574
  • [25] MSKd_Net: Multi-Head Attention-Based Swin Transformer for Kidney Diseases Classification
    Sharen, H.
    Narendra, Modigari
    Anbarasi, L. Jani
    IEEE ACCESS, 2024, 12 : 181975 - 181986
  • [26] A multi-head adjacent attention-based pyramid layered model for nested named entity recognition
    Cui, Shengmin
    Joe, Inwhee
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (03): : 2561 - 2574
  • [27] Pattern Classification for Small-Sized Defects Using Multi-Head CNN in Semiconductor Manufacturing
    Byun, Yunseon
    Baek, Jun-Geol
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, 2021, 22 (10) : 1681 - 1691
  • [28] Pattern Classification for Small-Sized Defects Using Multi-Head CNN in Semiconductor Manufacturing
    Yunseon Byun
    Jun-Geol Baek
    International Journal of Precision Engineering and Manufacturing, 2021, 22 : 1681 - 1691
  • [29] Sarcasm Detection Using Multi-Head Attention Based Bidirectional LSTM
    Kumar, Avinash
    Narapareddy, Vishnu Teja
    Aditya Srikanth, Veerubhotla
    Malapati, Aruna
    Neti, Lalita Bhanu Murthy
    IEEE ACCESS, 2020, 8 : 6388 - 6397
  • [30] Multimodal Approach of Speech Emotion Recognition Using Multi-Level Multi-Head Fusion Attention-Based Recurrent Neural Network
    Ngoc-Huynh Ho
    Yang, Hyung-Jeong
    Kim, Soo-Hyung
    Lee, Gueesang
    IEEE ACCESS, 2020, 8 : 61672 - 61686