Epipolar Geometry-Based Visual Servoing of Soft Endoscopic Manipulator for Transoral Laser Ablation

被引:3
|
作者
Fang, Ge [1 ]
Wang, Xiaomei [1 ,2 ]
Ho, Justin D. L. [1 ]
Wang, Kui [1 ]
Chow, Chun-Kit [1 ]
Lee, Kit-Hang [1 ]
Xie, Xiaochen [1 ,3 ]
Tang, Wai Lun [1 ]
Liang, Liyuan [4 ]
Chang, Hing-Chiu [4 ,5 ]
Juan, Chun-Jung [6 ]
Liu, Yun-hui [7 ]
Chan, Jason Ying-Kuen [8 ]
Kwok, Ka-Wai [1 ]
机构
[1] Univ Hong Kong, Dept Mech Engn, Hong Kong 999077, Peoples R China
[2] Multiscale Med Robot Ctr Ltd, Hong Kong 999077, Peoples R China
[3] Harbin Inst Technol, Dept Automat, Shenzhen 518000, Guangdong, Peoples R China
[4] Univ Hong Kong, Dept Diagnost Radiol, Hong Kong 999077, Peoples R China
[5] Chinese Univ Hong Kong, Dept Biomed Engn, Hong Kong 999077, Peoples R China
[6] China Med Univ, Dept Med Imaging, Hsinchu Hosp, Hsinchu 302, Taiwan
[7] Chinese Univ Hong Kong, Dept Mech & Automat Engn, Hong Kong 999077, Peoples R China
[8] Chinese Univ Hong Kong, Dept Otorhinolaryngol Head & Neck Surg, Hong Kong 999077, Peoples R China
关键词
epipolar geometry; soft robot control; soft robotic laser manipulation; visual servoing; INTRAOPERATIVE MRI; ROBOT; HEAD; MICROSURGERY; DESIGN; TUMORS; DEPTH;
D O I
10.1002/aisy.202200197
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Soft manipulators integrated with optical laser fibers offer new opportunities for endoscopic noncontact laser surgery. To achieve precise laser projection in a confined workspace and avoid damage, a controller with high accuracy and stability is required. An effective way is to close the control loop. Therefore, a visual servo controller that allows automatic laser spot steering using soft manipulators is proposed. An epipolar geometry model is established to acquire the inverse transition mapping from image to actuation. With this mapping, a feedback controller is derived without prior information of tissue surface geometry. Experimental validation demonstrates accurate path following using a magnetic resonance-safe manipulator, with root-mean-square (RMS) tracking errors <4 pixels (140 mu m) in the camera view. This is maintained even throughout 70 repeated cycles, with a maximum tracking error <11.32 pixels (approximate to 396.2 mu m). The controller enables laser spot following of the mouse cursor with an RMS tracking error of 3.97 pixels (approximate to 180.5 mu m). Ex vivo tissue ablation tests are conducted to validate the laser ablation pattern, with an RMS tracking error of about 5.75 pixels (approximate to 201.3 mu m). A laser ablation test is conducted under magnetic resonance imaging (MRI) to validate the feasibility of MRI-guided laser surgery.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Visual servoing based on epipolar geometry
    Rives, P
    2000 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2000), VOLS 1-3, PROCEEDINGS, 2000, : 602 - 607
  • [2] A visual servoing algorithm based on epipolar geometry
    Chesi, G
    Prattichizzo, D
    Vicino, A
    2001 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS I-IV, PROCEEDINGS, 2001, : 737 - 742
  • [3] Epipolar Geometry Estimation for Contour-based visual servoing
    Mariottini, GL
    Prattichizzo, D
    ROBOTICS: TRENDS, PRINCIPLES AND APPLICATIONS, VOL 15, 2004, 15 : 529 - 534
  • [4] Visual servoing of laser ablation based cochleostomy
    Kahrs, Lueder A.
    Raczkowsky, Joerg
    Werner, Martin
    Knapp, Felix B.
    Mehrwald, Markus
    Hering, Peter
    Schipper, Joerg
    Klenzner, Thomas
    Woern, Heinz
    MEDICAL IMAGING 2008: VISUALIZATION, IMAGE-GUIDED PROCEDURES, AND MODELING, PTS 1 AND 2, 2008, 6918
  • [5] Image-based visual servoing for nonholonomic mobile robots using epipolar geometry
    Mariottini, Gian Luca
    Oriolo, Giuseppe
    Prattichizzo, Domenico
    IEEE TRANSACTIONS ON ROBOTICS, 2007, 23 (01) : 87 - 100
  • [6] Active Fault Detection of Soft Manipulator in Visual Servoing
    Gu, Haoyuan
    Wang, Hesheng
    Xu, Fan
    Liu, Zhe
    Chen, Weidong
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (10) : 9778 - 9788
  • [7] An Epipolar Geometry-Based Approach for Vision-Based Indoor Localization
    Liu, Yinan
    Ma, Lin
    Wang, Xuedong
    Meng, Weixiao
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2019, 463 : 2643 - 2652
  • [8] Uncalibrated 3D visual servoing from epipolar geometry and projective invariants
    Adachi, Jun
    Sato, Jun
    ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 2007, 90 (12): : 50 - 58
  • [9] An Image-based Visual Servoing for Manipulator
    Tian, Shi-xiang
    Wang, Sheng-ze
    NEW TRENDS AND APPLICATIONS OF COMPUTER-AIDED MATERIAL AND ENGINEERING, 2011, 186 : 277 - 280
  • [10] Dynamic Pose-Estimation from the Epipolar Geometry for Visual Servoing of Mobile Robots
    Becerra, H. M.
    Sagues, C.
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,