A Seam Tracking Method Based on an Image Segmentation Deep Convolutional Neural Network

被引:8
|
作者
Lu, Jun [1 ]
Yang, Aodong [1 ]
Chen, Xiaoyu [1 ]
Xu, Xingwang [1 ]
Lv, Ri [1 ]
Zhao, Zhuang [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect Engn & Optoelect Technol, Nanjing 210094, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
seam track; PAW; passive vision; image segmentation; convolutional neural network;
D O I
10.3390/met12081365
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Vision-based welding seam tracking is an important and unique branch of welding automation. Active vision seam tracking systems achieve accurate feature extraction by using an auxiliary light source, but this will introduce extra costs and the real-time performance will be affected. In contrast, passive vision systems achieve better real-time performance and their structure is relatively simple. This paper proposes a passive vision welding seam tracking system in Plasma Arc Welding (PAW) based on semantic segmentation. The BiseNetV2 network is adopted in this paper and online hard example mining (OHEM) is used to improve the segmentation effect. This network structure is a lightweight structure allowing effective image feature extraction. According to the segmentation results, the offset between the welding seam and the welding torch can be calculated. The results of the experiments show that the proposed method can achieve 57 FPS and the average error of the offset calculation is within 0.07 mm, meaning it can be used for real-time seam tracking.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Cardiac magnetic resonance image segmentation based on convolutional neural network
    Liu, Duqiu
    Jia, Zheng
    Jin, Ming
    Liu, Qian
    Liao, Zhiliang
    Zhong, Junyan
    Ye, Haowen
    Chen, Gang
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 197
  • [42] Retinal Vessel Image Segmentation Based on Improved Convolutional Neural Network
    Wu Chenyue
    Yi Benshun
    Zhang Yungang
    Huang Song
    Feng Yu
    [J]. ACTA OPTICA SINICA, 2018, 38 (11)
  • [43] Satellite cloud image segmentation based on lightweight convolutional neural network
    Li, Xi
    Chen, Shilan
    Wu, Jin
    Li, Jun
    Wang, Ting
    Tang, Junquan
    Hu, Tongyi
    Wu, Wenzhu
    [J]. PLOS ONE, 2023, 18 (02):
  • [44] A New Belt Ore Image Segmentation Method Based on the Convolutional Neural Network and the Image-Processing Technology
    Ma, Xiqi
    Zhang, Pengyu
    Man, Xiaofei
    Ou, Leming
    [J]. MINERALS, 2020, 10 (12) : 1 - 16
  • [45] Convolutional Neural Network Based Segmentation
    Silvoster, Leena M.
    Govindan, V. K.
    [J]. COMPUTER NETWORKS AND INTELLIGENT COMPUTING, 2011, 157 : 190 - 197
  • [46] An Image Segmentation Method Based on the BP Neural Network
    Wang, Xiao-rong
    Yang, Zhi-ming
    You, Ming-ying
    [J]. FUZZY INFORMATION AND ENGINEERING, VOLUME 2, 2009, 62 : 341 - +
  • [47] Research of Image Segmentation method based on Neural Network
    Jiang, Derong
    Yin, Jinghai
    Hu, Jianfeng
    [J]. PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON MODELLING AND SIMULATION (ICMS2009), VOL 8, 2009, : 85 - 90
  • [48] Semantic segmentation of track image based on deep neural network
    Wang Zhaoying
    Zhou Junhua
    Liao Zhonghua
    Zhai Xiang
    Zhang Lianping
    [J]. The Journal of China Universities of Posts and Telecommunications, 2020, 27 (05) : 23 - 33
  • [49] Semantic segmentation of track image based on deep neural network
    Wang Z.
    Zhou J.
    Liao Z.
    Zhai X.
    Zhang L.
    [J]. Journal of China Universities of Posts and Telecommunications, 2020, 27 (05): : 23 - 33
  • [50] Automated Object Tracing for Biomedical Image Segmentation Using a Deep Convolutional Neural Network
    Rutter, Erica M.
    Lagergren, John H.
    Flores, Kevin B.
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT IV, 2018, 11073 : 686 - 694