Design and voice-based control of a nasal endoscopic surgical robot

被引:12
|
作者
He, Yucheng [1 ]
Deng, Zhen [2 ]
Zhang, Jianwei [2 ]
机构
[1] Chinese Univ Hong Kong, Dept Mech & Automat Engn, Hong Kong, Peoples R China
[2] Univ Hamburg, Dept Informat, Hamburg, Germany
关键词
ASSISTANT; AESOP; ENDOASSIST; SURGERY; HOLDER; AID;
D O I
10.1049/cit2.12022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In traditional nasal surgery, surgeons are prone to fatigue and jitter by holding the endoscope for a long-time. Some complex operations require assistant surgeon to assist with holding the endoscope. To address the above problems, the authors design a remote centre of motion based nasal robot, and propose a voice-based robot control method. First, through the operation space analysis of nasal surgery, the design scheme of the robot based on RCM mechanism is proposed. On this basis, the design parameters of the robot are analysed to complete the entire design of robot. Then, considering that the surgeon's hands are occupied by surgical instruments during complex surgical operations, a voice-based robot control method is proposed. This method obtains direction instructions from surgeons by analysing the movement of the endoscopic image. Afterward, a commercial speech recognition interface is used to realise the offline grammar controlwords lib compatible with both Chinese and English, and the overall strategy of robot control is proposed. Finally, an experimental platform for virtual robot control is established, and the voice-based robot control experiment is performed. The results show that the proposed voice-based control method is feasible, and it provides guidance for the subsequent development and control of the actual robot system.
引用
收藏
页码:123 / 131
页数:9
相关论文
共 50 条
  • [31] Voice-Based Gender Identification in Multimedia Applications
    Hadi Harb
    Liming Chen
    Journal of Intelligent Information Systems, 2005, 24 : 179 - 198
  • [32] Design and Implementation of a Robot based on Voice Recognition
    Yu, Youming
    Zhao, Guoqing
    Du, Tiancang
    MATERIALS RESEARCH AND APPLICATIONS, PTS 1-3, 2014, 875-877 : 2128 - 2131
  • [33] Voice-based motion control of a robotic vehicle through visible light communication
    Saradi, V. Partha
    Kailasapathi, P.
    COMPUTERS & ELECTRICAL ENGINEERING, 2019, 76 : 154 - 167
  • [34] Longitudinal Study of People Learning to Use Continuous Voice-Based Cursor Control
    Harada, Susumu
    Wobbrock, Jacob O.
    Malkin, Jonathan
    Bilmes, Jeff A.
    Landay, James A.
    CHI2009: PROCEEDINGS OF THE 27TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4, 2009, : 347 - 356
  • [35] Usability of Voice-based Intelligent Personal Assistants
    Zwakman, Dilawar Shah
    Pal, Debajyoti
    Triyason, Tuul
    Vanijja, Vajirasak
    11TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE: DATA, NETWORK, AND AI IN THE AGE OF UNTACT (ICTC 2020), 2020, : 652 - 657
  • [36] Enabling voice-Based Apps with European values
    Campbell, Akira
    Kleinbauer, Thomas
    Tommasi, Marc
    Vincent, Emmanuel
    ERCIM NEWS, 2021, (126): : 38 - 39
  • [37] Multiple Information Communication in Voice-Based Interaction
    Abu ul Fazal, Muhammad
    Karim, M. Shuaib
    MULTIMEDIA AND NETWORK INFORMATION SYSTEMS, MISSI 2016, 2017, 506 : 101 - 111
  • [38] Thermal Interaction with a Voice-based Intelligent Agent
    Kim, Seyeong
    Row, Yea-kyung
    Nam, Tek-Jin
    CHI 2018: EXTENDED ABSTRACTS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2018,
  • [39] A dataset for voice-based human identity recognition
    Alsaify, Baha' A.
    Abu Arja, Hadeel S.
    Maayah, Baskal Y.
    Al-Taweel, Masa M.
    DATA IN BRIEF, 2022, 42
  • [40] Voice-based gender identification in multimedia applications
    Harb, H
    Chen, LM
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2005, 24 (2-3) : 179 - 198