A Seam Tracking Method Based on an Image Segmentation Deep Convolutional Neural Network

被引:8
|
作者
Lu, Jun [1 ]
Yang, Aodong [1 ]
Chen, Xiaoyu [1 ]
Xu, Xingwang [1 ]
Lv, Ri [1 ]
Zhao, Zhuang [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect Engn & Optoelect Technol, Nanjing 210094, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
seam track; PAW; passive vision; image segmentation; convolutional neural network;
D O I
10.3390/met12081365
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Vision-based welding seam tracking is an important and unique branch of welding automation. Active vision seam tracking systems achieve accurate feature extraction by using an auxiliary light source, but this will introduce extra costs and the real-time performance will be affected. In contrast, passive vision systems achieve better real-time performance and their structure is relatively simple. This paper proposes a passive vision welding seam tracking system in Plasma Arc Welding (PAW) based on semantic segmentation. The BiseNetV2 network is adopted in this paper and online hard example mining (OHEM) is used to improve the segmentation effect. This network structure is a lightweight structure allowing effective image feature extraction. According to the segmentation results, the offset between the welding seam and the welding torch can be calculated. The results of the experiments show that the proposed method can achieve 57 FPS and the average error of the offset calculation is within 0.07 mm, meaning it can be used for real-time seam tracking.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] A new method for segmentation of medical image using convolutional neural network
    Luo, Fugui
    Qin, Yunchu
    Li, Mingzhen
    Song, Qian
    [J]. JOURNAL OF OPTICS-INDIA, 2023, 53 (04): : 3411 - 3420
  • [22] Practical method of cell segmentation in electron microscope image stack using deep convolutional neural network
    Konishi, Kohki
    Mimura, Masafumi
    Nonaka, Takao
    Sase, Ichiro
    Nishioka, Hideo
    Suga, Mitsuo
    [J]. MICROSCOPY, 2019, 68 (04) : 338 - 341
  • [23] DMCNN: A Deep Multiscale Convolutional Neural Network Model for Medical Image Segmentation
    Teng, Lin
    Li, Hang
    Karim, Shahid
    [J]. JOURNAL OF HEALTHCARE ENGINEERING, 2019, 2019
  • [24] FusionNet: A Deep Fully Residual Convolutional Neural Network for Image Segmentation in Connectomics
    Quan, Tran Minh
    Hildebrand, David Grant Colburn
    Jeong, Won-Ki
    [J]. FRONTIERS IN COMPUTER SCIENCE, 2021, 3
  • [25] Psoriasis skin biopsy image segmentation using Deep Convolutional Neural Network
    Pal, Anabik
    Garain, Utpal
    Chandra, Aditi
    Chatterjee, Raghunath
    Senapati, Swapan
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2018, 159 : 59 - 69
  • [26] On the contextual aspects of using deep convolutional neural network for semantic image segmentation
    Wang, Chunlai
    Mauch, Lukas
    Saxena, Mehul Manoj
    Yang, Bin
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (05)
  • [27] DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentation
    Jha, Debesh
    Riegler, Michael A.
    Johansen, Dag
    Halvorsen, Pal
    Johansen, Havard D.
    [J]. 2020 IEEE 33RD INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS(CBMS 2020), 2020, : 558 - 564
  • [28] Dermoscopic image segmentation method based on convolutional neural networks
    Dang Ngoc Hoang Thanh
    Le Thi Thanh
    Erkan, Ugur
    Khamparia, Aditya
    Prasath, V. B. Surya
    [J]. INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2021, 66 (02) : 89 - 99
  • [29] A Patch Based Denoising Method Using Deep Convolutional Neural Network for Seismic Image
    Zhang, Yushu
    Lin, Hongbo
    Li, Yue
    Ma, Haitao
    [J]. IEEE ACCESS, 2019, 7 : 156883 - 156894
  • [30] A method of image classification based on convolutional neural network
    Dong, Zhe
    Jiang, Mingyang
    Pei, Zhili
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2018, 124 : 47 - 48