A Seam Tracking Method Based on an Image Segmentation Deep Convolutional Neural Network

被引:8
|
作者
Lu, Jun [1 ]
Yang, Aodong [1 ]
Chen, Xiaoyu [1 ]
Xu, Xingwang [1 ]
Lv, Ri [1 ]
Zhao, Zhuang [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect Engn & Optoelect Technol, Nanjing 210094, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
seam track; PAW; passive vision; image segmentation; convolutional neural network;
D O I
10.3390/met12081365
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Vision-based welding seam tracking is an important and unique branch of welding automation. Active vision seam tracking systems achieve accurate feature extraction by using an auxiliary light source, but this will introduce extra costs and the real-time performance will be affected. In contrast, passive vision systems achieve better real-time performance and their structure is relatively simple. This paper proposes a passive vision welding seam tracking system in Plasma Arc Welding (PAW) based on semantic segmentation. The BiseNetV2 network is adopted in this paper and online hard example mining (OHEM) is used to improve the segmentation effect. This network structure is a lightweight structure allowing effective image feature extraction. According to the segmentation results, the offset between the welding seam and the welding torch can be calculated. The results of the experiments show that the proposed method can achieve 57 FPS and the average error of the offset calculation is within 0.07 mm, meaning it can be used for real-time seam tracking.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Meteorological Radar Noise Image Semantic Segmentation Method Based on Deep Convolutional Neural Network
    Yang Hongyun
    Wang Fengyan
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2019, 41 (10) : 2373 - 2381
  • [2] Remote sensing image segmentation based on the fuzzy deep convolutional neural network
    Zhao, Tianyu
    Xu, Jindong
    Chen, Rui
    Ma, Xiangyue
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (16) : 6267 - 6286
  • [3] A deep convolutional neural network for rock fracture image segmentation
    Hoon Byun
    Jineon Kim
    Dongyoung Yoon
    Il-Seok Kang
    Jae-Joon Song
    [J]. Earth Science Informatics, 2021, 14 : 1937 - 1951
  • [4] Wound image segmentation using deep convolutional neural network
    Kang, Hyunyoung
    Seo, Kyungdeok
    Lee, Sena
    Oh, Byung Ho
    Yang, Sejung
    [J]. PHOTONICS IN DERMATOLOGY AND PLASTIC SURGERY 2023, 2023, 12352
  • [5] A deep convolutional neural network for rock fracture image segmentation
    Byun, Hoon
    Kim, Jineon
    Yoon, Dongyoung
    Kang, Il-Seok
    Song, Jae-Joon
    [J]. EARTH SCIENCE INFORMATICS, 2021, 14 (04) : 1937 - 1951
  • [6] Satellite Image Matching Method Based on Deep Convolutional Neural Network
    Dazhao FAN
    Yang DONG
    Yongsheng ZHANG
    [J]. Journal of Geodesy and Geoinformation Science, 2019, 2 (02) : 90 - 100
  • [7] Convolutional Neural Network Based Image Segmentation: A Review
    Ajmal, Hina
    Rehman, Saad
    Farooq, Umar
    Ain, Qurrat U.
    Riaz, Farhan
    Hassan, Ali
    [J]. PATTERN RECOGNITION AND TRACKING XXIX, 2018, 10649
  • [8] Hyperspectral Remote Sensing Image Segmentation Based on the Fuzzy Deep Convolutional Neural Network
    Zhao Tianyu
    Xu, Jindong
    [J]. 2020 13TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2020), 2020, : 181 - 186
  • [9] Tongue image segmentation algorithm based on deep convolutional neural network and attention mechanism
    Tian, Chang
    Liu, Yanjung
    Li, Meng
    Fen, Chaofan
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (01) : 1473 - 1480
  • [10] Remote Sensing Image Semantic Segmentation Method Based on a Deep Convolutional Neural Network and Multiscale Feature Fusion
    Zhang, Guangzhen
    Jiang, Wangyang
    [J]. INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2023, 19 (01)