Depth Camera-based Algorithm for Visual Recognition and Automated Polishing of Ship Components

被引:0
|
作者
Xing, Hongyan [1 ]
Lai, Xinmin [2 ]
Chu, Yunze [1 ]
Zhang, Ran [3 ]
Yu, Hang [1 ]
Wang, Xu [3 ]
Wang, Xuan [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai Shipbldg Technol Res Inst, Sch Mech Engn, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai, Peoples R China
[3] Shanghai Shipbldg Technol Res Inst, Shanghai, Peoples R China
关键词
Depth camera; automated polishing; pose estimation; point cloud segmentation; centroid extraction; point cloud edge detection;
D O I
10.1117/12.2640982
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Intelligent polishing equipment comprising industrial robots and sensors is increasingly used to polish ship components, which has traditionally been done manually The core component of such equipment is the visual recognition system, which is responsible for workpiece recognition and positioning, and polishing point recognition and extraction. Current systems are mostly based on CCD or CMOS cameras with 2D image processing. However, recognition efficacy is limited by the auxiliary lighting conditions and image resolution, and depth information cannot be obtained. An algorithm module is designed for object recognition in point cloud from a depth camera in a device used to polish small ship components. The module's architecture and the functions of the visual recognition system are described. The module's functions are based on the OpenCV and printer control language (PCL) libraries and are implemented in the C++ programming language. An algorithm test platform was built to verify the algorithm module its functions, including camera pose estimation and coordinate transformation, point cloud segmentation, centroid extraction, and edge extraction. The limitations of on-site auxiliary light conditions and image resolution were overcome. A workpiece recognition and positioning success rate of 98% was achieved, and the polishing point detection and recognition accuracy are sufficient for real applications. This allows accurate and comprehensive visual data to be provided to the automated polishing device, ensuring smooth operation and effective workpiece handling and polishing.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] An Anytime Algorithm for Camera-Based Character Recognition
    Kobayashi, Takuya
    Iwamura, Masakazu
    Matsuda, Takahiro
    Kise, Koichi
    2013 12TH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), 2013, : 1140 - 1144
  • [2] Single Camera-based Algorithm for Depth Map Generation in UAV
    Xiong, Hao
    Zhang, Changlong
    Yang, Xuesong
    Li, Lizheng
    2015 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND INTELLIGENT CONTROL (ISIC 2015), 2015, : 441 - 447
  • [3] Depth Camera-Based Facial Expression Recognition System Using Multilayer Scheme
    Siddiqi, Muhammad Hameed
    Ali, Rahman
    Sattar, Abdul
    Khan, Adil Mehmood
    Lee, Sungyoung
    IETE TECHNICAL REVIEW, 2014, 31 (04) : 277 - 286
  • [4] A camera-based pointer with visual feedback
    Ishihara, Makio
    Ishihara, Yukio
    PROCEEDINGS OF THE SECOND IASTED INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION, 2007, : 105 - +
  • [5] Camera-based digit recognition system
    Castells-Rufas, David
    Carrabina, Jordi
    2006 13TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS, VOLS 1-3, 2006, : 756 - 759
  • [6] A Depth Camera Based Lightweight Visual SLAM Algorithm
    Wang, Zhihao
    Jia, Qingxuan
    Ye, Ping
    Sun, Hanxu
    2017 4TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2017, : 143 - 148
  • [7] "Visual Expressiveness" in Camera-Based Research and Communication
    Pauwels, Luc
    VISUAL ANTHROPOLOGY, 2021, 34 (03) : 234 - 244
  • [8] Survey of Monocular Camera-Based Visual Relocalization
    Chen Z.
    Pei H.
    Wang J.
    Dai D.
    Jiqiren/Robot, 2021, 43 (03): : 373 - 384
  • [9] Visual recognition and location algorithm based on optimized YOLOv3 detector and RGB depth camera
    He, Bin
    Qian, Shusheng
    Niu, Yongchao
    VISUAL COMPUTER, 2024, 40 (03): : 1965 - 1981
  • [10] Visual recognition and location algorithm based on optimized YOLOv3 detector and RGB depth camera
    Bin He
    Shusheng Qian
    Yongchao Niu
    The Visual Computer, 2024, 40 : 1965 - 1981