Penetration State Recognition during Laser Welding Process Control Based on Two-Stage Temporal Convolutional Networks

被引:0
|
作者
Liu, Zhihui [1 ,2 ]
Ji, Shuai [2 ,3 ]
Ma, Chunhui [4 ]
Zhang, Chengrui [2 ,3 ]
Yu, Hongjuan [4 ]
Yin, Yisheng [2 ,3 ]
机构
[1] Shandong Univ, Joint SDU NTU Ctr Artificial Intelligence Res, Sch Software, Jinan 250101, Peoples R China
[2] Shandong Univ, Sch Mech Engn, Key Lab High Efficiency & Clean Mech Manufacture, Jinan 250061, Peoples R China
[3] Shandong Univ, Sch Mech Engn, Jinan 250061, Peoples R China
[4] China Natl Heavy Duty Truck Grp, Jinan 250013, Peoples R China
关键词
weld penetration monitoring; laser welding; image processing; weld process control; JOINT PENETRATION;
D O I
10.3390/ma17184441
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
Vision-based laser penetration control has become an important research area in the field of welding quality control. Due to the complexity and large number of parameters in the monitoring model, control of the welding process based on deep learning and the reliance on long-term information for penetration identification are challenges. In this study, a penetration recognition method based on a two-stage temporal convolutional network is proposed to realize the online process control of laser welding. In this paper, a coaxial vision welding monitoring system is built. A lightweight segmentation model, based on channel pruning, is proposed to extract the key features of the molten pool and the keyhole from the clear molten pool keyhole image. Using these molten pool and keyhole features, a temporal convolutional network based on attention mechanism is established. The recognition method can effectively predict the laser welding penetration state, which depends on long-term information. In addition, the penetration identification experiment and closed-loop control experiment of unequal thickness plates are designed. The proposed method in this study has an accuracy of 98.96% and an average inference speed of 20.4 ms. The experimental results demonstrate that the proposed method exhibits significant performance in recognizing the penetration state from long sequences of welding image signals, adjusting welding power, and stabilizing welding quality.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Research on detection of welding penetration state during robotic GTAW process based on audible arc sound
    Lv, Na
    Xu, Yanling
    Zhong, Jiyong
    Chen, Huabin
    Wang, Jifeng
    Chen, Shanben
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2013, 40 (05): : 474 - 493
  • [22] Intelligent optimization control of wastewater treatment process based on two-stage neighborhood search
    Li, Hong-Peng
    Zhou, Ping
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (09): : 1569 - 1577
  • [23] An integrated model based on statistical process control and maintenance for two-stage dependent processes
    Zhong, Jianlan
    Ma, Yizhong
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2017, 46 (01) : 106 - 126
  • [24] Skeleton-Based Activity Recognition for Process-Based Quality Control of Concealed Work via Spatial-Temporal Graph Convolutional Networks
    Xiao, Lei
    Yang, Xincong
    Peng, Tian
    Li, Heng
    Guo, Runhao
    SENSORS, 2024, 24 (04)
  • [25] A two-stage attention aware method for train bearing shed oil inspection based on convolutional neural networks
    Fu, Xiao
    Li, Kenli
    Liu, Jing
    Li, Keqin
    Zeng, Zeng
    Chen, Cen
    NEUROCOMPUTING, 2020, 380 : 212 - 224
  • [26] A two-stage segmentation of sublingual veins based on compact fully convolutional networks for Traditional Chinese Medicine images
    Xu, Hua
    Chen, Xiaofei
    Qian, Peng
    Li, Fufeng
    HEALTH INFORMATION SCIENCE AND SYSTEMS, 2023, 11 (01)
  • [27] A two-stage segmentation of sublingual veins based on compact fully convolutional networks for Traditional Chinese Medicine images
    Hua Xu
    Xiaofei Chen
    Peng Qian
    Fufeng Li
    Health Information Science and Systems, 11
  • [28] Human action recognition using a convolutional neural network based on skeleton heatmaps from two-stage pose estimation
    Sun, Ruiqi
    Zhang, Qin
    Luo, Chuang
    Guo, Jiamin
    Chai, Hui
    BIOMIMETIC INTELLIGENCE AND ROBOTICS, 2022, 2 (03):
  • [29] AFFECTIVE STATE RECOGNITION BASED ON EYE GAZE ANALYSIS USING TWO-STREAM CONVOLUTIONAL NETWORKS
    Chrysouli, Christina
    Vretos, Nicholas
    Daras, Petros
    2018 IEEE 28TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2018,
  • [30] Real-time hand grasp recognition using weakly supervised two-stage convolutional neural networks for understanding manipulation actions
    Kim, Ji Woong
    You, Sujeong
    Ji, Sang Hoon
    Kim, Hong Seok
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 481 - 482