Epipolar Geometry-Based Visual Servoing of Soft Endoscopic Manipulator for Transoral Laser Ablation

被引:3
|
作者
Fang, Ge [1 ]
Wang, Xiaomei [1 ,2 ]
Ho, Justin D. L. [1 ]
Wang, Kui [1 ]
Chow, Chun-Kit [1 ]
Lee, Kit-Hang [1 ]
Xie, Xiaochen [1 ,3 ]
Tang, Wai Lun [1 ]
Liang, Liyuan [4 ]
Chang, Hing-Chiu [4 ,5 ]
Juan, Chun-Jung [6 ]
Liu, Yun-hui [7 ]
Chan, Jason Ying-Kuen [8 ]
Kwok, Ka-Wai [1 ]
机构
[1] Univ Hong Kong, Dept Mech Engn, Hong Kong 999077, Peoples R China
[2] Multiscale Med Robot Ctr Ltd, Hong Kong 999077, Peoples R China
[3] Harbin Inst Technol, Dept Automat, Shenzhen 518000, Guangdong, Peoples R China
[4] Univ Hong Kong, Dept Diagnost Radiol, Hong Kong 999077, Peoples R China
[5] Chinese Univ Hong Kong, Dept Biomed Engn, Hong Kong 999077, Peoples R China
[6] China Med Univ, Dept Med Imaging, Hsinchu Hosp, Hsinchu 302, Taiwan
[7] Chinese Univ Hong Kong, Dept Mech & Automat Engn, Hong Kong 999077, Peoples R China
[8] Chinese Univ Hong Kong, Dept Otorhinolaryngol Head & Neck Surg, Hong Kong 999077, Peoples R China
关键词
epipolar geometry; soft robot control; soft robotic laser manipulation; visual servoing; INTRAOPERATIVE MRI; ROBOT; HEAD; MICROSURGERY; DESIGN; TUMORS; DEPTH;
D O I
10.1002/aisy.202200197
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Soft manipulators integrated with optical laser fibers offer new opportunities for endoscopic noncontact laser surgery. To achieve precise laser projection in a confined workspace and avoid damage, a controller with high accuracy and stability is required. An effective way is to close the control loop. Therefore, a visual servo controller that allows automatic laser spot steering using soft manipulators is proposed. An epipolar geometry model is established to acquire the inverse transition mapping from image to actuation. With this mapping, a feedback controller is derived without prior information of tissue surface geometry. Experimental validation demonstrates accurate path following using a magnetic resonance-safe manipulator, with root-mean-square (RMS) tracking errors <4 pixels (140 mu m) in the camera view. This is maintained even throughout 70 repeated cycles, with a maximum tracking error <11.32 pixels (approximate to 396.2 mu m). The controller enables laser spot following of the mouse cursor with an RMS tracking error of 3.97 pixels (approximate to 180.5 mu m). Ex vivo tissue ablation tests are conducted to validate the laser ablation pattern, with an RMS tracking error of about 5.75 pixels (approximate to 201.3 mu m). A laser ablation test is conducted under magnetic resonance imaging (MRI) to validate the feasibility of MRI-guided laser surgery.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Visual servoing of a robotic manipulator based on fuzzy logic control
    De Giuseppe, R.
    Taurisano, F.
    Distante, C.
    Anglani, A.
    Proceedings - IEEE International Conference on Robotics and Automation, 1999, 2 : 1487 - 1494
  • [22] Epipolar Geometry-Based Side Information Creation for Multiview Wyner-Ziv Video Coding
    Brites, Catarina
    Pereira, Fernando
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (10) : 1771 - 1786
  • [23] Soft robotic manipulator for intraoperative MRI-guided transoral laser microsurgery
    Fang, Ge
    Chow, Marco C. K.
    Ho, Justin D. L.
    He, Zhuoliang
    Wang, Kui
    Ng, T. C.
    Tsoi, James K. H.
    Chan, Po-Ling
    Chang, Hing-Chiu
    Chan, Danny Tat-Ming
    Liu, Yun-hui
    Holsinger, Christopher
    Chan, Jason Ying-Kuen
    Kwok, Ka-Wai
    SCIENCE ROBOTICS, 2021, 6 (57)
  • [24] Image based visual servoing with kinematic singularity avoidance for mobile manipulator
    Hernandez-Barragan, Jesus
    Villasenor, Carlos
    Lopez-Franco, Carlos
    Arana-Daniel, Nancy
    Gomez-Avila, Javier
    PEERJ, 2024, 10 : 1 - 24
  • [25] Visual Servoing Based Pickup of Moving Objects with a Kinematically Controlled Manipulator
    Dai, Fuquan
    Wang, Kai
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2016, : 550 - 555
  • [26] Visual Servoing Based Pickup of Stationary Objects with a Dynamically Controlled Manipulator
    Wang, Kai
    Ding, Ning
    Dai, Fuquan
    2017 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2017, : 902 - 907
  • [27] Geometry-based control of instability patterns in cellular soft matter
    Janbaz, Shahram
    Weinans, Harrie
    Zadpoor, Amir A.
    RSC ADVANCES, 2016, 6 (24): : 20431 - 20436
  • [28] A Weighted KNN Epipolar Geometry-Based Approach for Vision-Based Indoor Localization Using Smartphone Cameras
    Sadeghi, Hamed
    Valaee, Shahrokh
    Shirani, Shahram
    2014 IEEE 8TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2014, : 37 - 40
  • [29] Three-Step Epipolar-Based Visual Servoing for Nonholonomic Robot with FOV Constraint
    Xu, Yang
    Peng, Jun
    Yu, Wentao
    Fang, Yuan
    Liu, Weirong
    JOURNAL OF APPLIED MATHEMATICS, 2014,
  • [30] Multi-View Hand Tracking using Epipolar Geometry-Based Consistent Labeling for an Industrial Application
    Yun, Yixiao
    Gu, Irene Yu-Hua
    Provost, Julien
    Akesson, Knut
    2013 SEVENTH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS (ICDSC), 2013,