Research on a Feature Point Detection Algorithm for Weld Images Based on Deep Learning

被引:0
|
作者
Kang, Shaopeng [1 ,2 ]
Qiang, Hongbin [1 ,2 ]
Yang, Jing [1 ,2 ]
Liu, Kailei [1 ,2 ]
Qian, Wenbin [1 ,2 ]
Li, Wenpeng [1 ,2 ]
Pan, Yanfei [3 ]
机构
[1] Jiangsu Univ Technol, Sch Mech Engn, Changzhou 213001, Peoples R China
[2] Jiangsu Prov Engn Res Ctr Adv Fluid Power & Equipm, Changzhou 213001, Peoples R China
[3] Jiangsu Yangtze Intelligent Mfg Res Inst Co Ltd, Changzhou 213001, Peoples R China
基金
中国国家自然科学基金;
关键词
seam tracking; visual sensing; deep learning; feature point extraction; SEAM TRACKING; PARTICLE FILTER; VISION;
D O I
10.3390/electronics13204117
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Laser vision seam tracking enhances robotic welding by enabling external information acquisition, thus improving the overall intelligence of the welding process. However, camera images captured during welding often suffer from distortion due to strong noises, including arcs, splashes, and smoke, which adversely affect the accuracy and robustness of feature point detection. To mitigate these issues, we propose a feature point extraction algorithm tailored for weld images, utilizing an improved Deeplabv3+ semantic segmentation network combined with EfficientDet. By replacing Deeplabv3+'s backbone with MobileNetV2, we enhance prediction efficiency. The DenseASPP structure and attention mechanism are implemented to focus on laser stripe edge extraction, resulting in cleaner laser stripe images and minimizing noise interference. Subsequently, EfficientDet extracts feature point positions from these cleaned images. Experimental results demonstrate that, across four typical weld types, the average feature point extraction error is maintained below 1 pixel, with over 99% of errors falling below 3 pixels, indicating both high detection accuracy and reliability.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Weld defect detection method based on deep subspace learning
    Li J.
    Wang X.
    Ge W.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2024, 30 (01): : 90 - 102
  • [42] Feature point detection in HDR images based on coefficient of variation
    Nascimento, Artur Santos
    Melo, Welerson Augusto Lino de Jesus
    Dantas, Daniel Oliveira
    Andrade, Beatriz Trinchao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (07) : 19981 - 20002
  • [43] Deep Learning Based Steel Pipe Weld Defect Detection
    Yang, Dingming
    Cui, Yanrong
    Yu, Zeyu
    Yuan, Hongqiang
    APPLIED ARTIFICIAL INTELLIGENCE, 2021, 35 (15) : 1237 - 1249
  • [44] Feature point detection in HDR images based on coefficient of variation
    Artur Santos Nascimento
    Welerson Augusto Lino de Jesus Melo
    Daniel Oliveira Dantas
    Beatriz Trinchão Andrade
    Multimedia Tools and Applications, 2024, 83 : 19981 - 20002
  • [45] Weld joint penetration state sequential identification algorithm based on representation learning of weld images
    Zhang, Xudong
    Wang, Fei
    Chen, Yourong
    Zhang, Heng
    Liu, Liyuan
    Wang, Qiyue
    JOURNAL OF MANUFACTURING PROCESSES, 2024, 120 : 192 - 204
  • [46] Multimodal Deep Learning-based Feature Fusion for Object Detection in Remote Sensing Images
    Yin, Shoulin
    Wang, Qunming
    Wang, Liguo
    Ivanovic, Mirjana
    Li, Hang
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2025, 22 (01) : 327 - 344
  • [47] Deep Learning and Superpixel Feature Extraction Based on Contractive Autoencoder for Change Detection in SAR Images
    Lv, Ning
    Chen, Chen
    Qiu, Tie
    Sangaiah, Arun Kumar
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (12) : 5530 - 5538
  • [48] Defect detection on EL images based on deep feature optimized by metric learning for imbalanced data
    Liu, Kun
    Han, Jiangrui
    Chen, Haiyong
    Yan, Haowei
    Yang, Peng
    2019 25TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND COMPUTING (ICAC), 2019, : 607 - 611
  • [49] CLOUD DETECTION BASED ON DEEP LEARNING COMBINING MUTI-FEATURE FOR REMOTE SENSING IMAGES
    Ma, Nan
    Liu, Sichao
    Su, Qinghua
    Yu, Zhenjun
    Liu, Xirong
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 1438 - 1441
  • [50] Automatic Feature Learning for Glaucoma Detection Based on Deep Learning
    Chen, Xiangyu
    Xu, Yanwu
    Yan, Shuicheng
    Wong, Damon Wing Kee
    Wong, Tien Yin
    Liu, Jiang
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 : 669 - 677