Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

被引:0
|
作者
Liu, Zhihui [1 ,2 ]
Ji, Shuai [2 ,3 ]
Ma, Chunhui [4 ]
Zhang, Chengrui [2 ,3 ]
Yu, Hongjuan [4 ]
Yin, Yisheng [2 ,3 ]
机构
[1] Shandong Univ, Joint SDU NTU Ctr Artificial Intelligence Res, Sch Software, Jinan 250101, Peoples R China
[2] Shandong Univ, Sch Mech Engn, Key Lab High Efficiency & Clean Mech Manufacture, Jinan 250061, Peoples R China
[3] Shandong Univ, Sch Mech Engn, Jinan 250061, Peoples R China
[4] China Natl Heavy Duty Truck Grp, Jinan 250013, Peoples R China
关键词
weld penetration monitoring; laser welding; image processing; weld process control; JOINT PENETRATION;
D O I
10.3390/ma17184441
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
Vision-based laser penetration control has become an important research area in the field of welding quality control. Due to the complexity and large number of parameters in the monitoring model, control of the welding process based on deep learning and the reliance on long-term information for penetration identification are challenges. In this study, a penetration recognition method based on a two-stage temporal convolutional network is proposed to realize the online process control of laser welding. In this paper, a coaxial vision welding monitoring system is built. A lightweight segmentation model, based on channel pruning, is proposed to extract the key features of the molten pool and the keyhole from the clear molten pool keyhole image. Using these molten pool and keyhole features, a temporal convolutional network based on attention mechanism is established. The recognition method can effectively predict the laser welding penetration state, which depends on long-term information. In addition, the penetration identification experiment and closed-loop control experiment of unequal thickness plates are designed. The proposed method in this study has an accuracy of 98.96% and an average inference speed of 20.4 ms. The experimental results demonstrate that the proposed method exhibits significant performance in recognizing the penetration state from long sequences of welding image signals, adjusting welding power, and stabilizing welding quality.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Two-stage traffic sign detection and recognition based on SVM and convolutional neural networks
    Hechri, Ahmed
    Mtibaa, Abdellatif
    IET IMAGE PROCESSING, 2020, 14 (05) : 939 - 946
  • [2] Two-Stage Ensemble of Deep Convolutional Neural Networks for Object Recognition
    Uddamvathanak, Rom
    Yang, Feng
    Yang, Xulei
    Das, Ankit Kumar
    Shen, Yan
    Salahuddin, Mohamed
    Hussain, Shaista
    Chawla, Shailey
    2018 INTERNATIONAL CONFERENCE ON INTELLIGENT RAIL TRANSPORTATION (ICIRT), 2018,
  • [3] Two-stage fusion framework driven by domain knowledge for penetration prediction of laser welding
    Li, Jie
    Zhang, Yi
    Xu, Yuewen
    Chen, Cong
    OPTICS AND LASER TECHNOLOGY, 2024, 179
  • [4] Two-stage quality monitoring of a laser welding process using machine learning
    Dold, Patricia M.
    Bleier, Fabian
    Boley, Meiko
    Mikut, Ralf
    AT-AUTOMATISIERUNGSTECHNIK, 2023, 71 (10) : 878 - 890
  • [5] Two-Stage Solar Flare Forecasting Based on Convolutional Neural Networks
    Chen, Jun
    Li, Weifu
    Li, Shuxin
    Chen, Hong
    Zhao, Xuebin
    Peng, Jiangtao
    Chen, Yanhong
    Deng, Hao
    SPACE: SCIENCE & TECHNOLOGY, 2022, 2022
  • [6] Two-stage voltage control of subtransmission networks with high penetration of wind power
    Tang, Zhiyuan
    Hill, David J.
    Liu, Tao
    CONTROL ENGINEERING PRACTICE, 2017, 62 : 1 - 10
  • [7] Real-time laser keyhole welding penetration state monitoring based on adaptive fusion images using convolutional neural networks
    Wang Cai
    Ping Jiang
    LeShi Shu
    ShaoNing Geng
    Qi Zhou
    Journal of Intelligent Manufacturing, 2023, 34 : 1259 - 1273
  • [8] Real-time laser keyhole welding penetration state monitoring based on adaptive fusion images using convolutional neural networks
    Cai, Wang
    Jiang, Ping
    Shu, LeShi
    Geng, ShaoNing
    Zhou, Qi
    JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (03) : 1259 - 1273
  • [9] Two-Stage Rail Defect Classification Based on Fuzzy Measure and Convolutional Neural Networks
    Aydin, Ilhan
    Akin, Erhan
    INTELLIGENT AND FUZZY SYSTEMS: DIGITAL ACCELERATION AND THE NEW NORMAL, INFUS 2022, VOL 1, 2022, 504 : 769 - 776
  • [10] Two-stage buffer monitoring method based on statistical process control
    Hu X.-J.
    Wang J.-J.
    Cui N.-F.
    Kongzhi yu Juece/Control and Decision, 2020, 35 (06): : 1453 - 1462