An eye-tracking based robotic scrub nurse: proof of concept

被引:10
|
作者
Ezzat, Ahmed [1 ,2 ]
Kogkas, Alexandros [1 ,2 ]
Holt, Josephine [3 ]
Thakkar, Rudrik [4 ]
Darzi, Ara [1 ,2 ]
Mylonas, George [1 ,2 ]
机构
[1] Imperial Coll London, Hamlyn Ctr Robot Surg, London SW7 2AZ, England
[2] Imperial Coll London, Fac Med, Dept Surg & Canc, London SW7 2AZ, England
[3] UCL, London, England
[4] St Georges Univ London, London, England
关键词
Surgery; Robotic scrub nurse; Eye-tracking; Assistive robotic devices; Gaze interactions; Smart operating room; OPERATING-ROOM; COMMUNICATION; INTERRUPTIONS; TEAMS;
D O I
10.1007/s00464-021-08569-w
中图分类号
R61 [外科手术学];
学科分类号
摘要
Background Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a "third hand" to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) in a simulated operating room based on a novel real-time framework for theatre-wide 3D gaze localization in a mobile fashion. Methods Surgeons performed segmental resection of pig colon and handsewn end-to-end anastomosis while wearing eye-tracking glasses (ETG) assisted by distributed RGB-D motion sensors. To select instruments, surgeons (ST) fixed their gaze on a screen, initiating the RSN to pick up and transfer the item. Comparison was made between the task with the assistance of a human scrub nurse (HSNt) versus the task with the assistance of robotic and human scrub nurse (R&HSNt). Task load (NASA-TLX), technology acceptance (Van der Laan's), metric data on performance and team communication were measured. Results Overall, 10 ST participated. NASA-TLX feedback for ST on HSNt vs R&HSNt usage revealed no significant difference in mental, physical or temporal demands and no change in task performance. ST reported significantly higher frustration score with R&HSNt. Van der Laan's scores showed positive usefulness and satisfaction scores in using the RSN. No significant difference in operating time was observed. Conclusions We report initial findings of our eye-tracking based RSN. This enables mobile, unrestricted hands-free human-robot interaction intra-operatively. Importantly, this platform is deemed non-inferior to HSNt and accepted by ST and HSN test users.
引用
收藏
页码:5381 / 5391
页数:11
相关论文
共 50 条
  • [1] An eye-tracking based robotic scrub nurse: proof of concept
    Ahmed Ezzat
    Alexandros Kogkas
    Josephine Holt
    Rudrik Thakkar
    Ara Darzi
    George Mylonas
    [J]. Surgical Endoscopy, 2021, 35 : 5381 - 5391
  • [2] Perceptions of surgeons and scrub nurses towards a novel eye-tracking based robotic scrub nurse platform
    Ezzat, Ahmed
    Thakkar, Rudrik
    Kogkas, Alexandros
    Mylonas, George
    [J]. BRITISH JOURNAL OF SURGERY, 2019, 106 : 81 - 82
  • [3] Proof of Concept of an Assistive Robotic Arm Control Using Artificial Stereovision and Eye-Tracking
    Cio, Yann-Seing Law-Kam
    Raison, Maxime
    Menard, Cedric Leblond
    Achiche, Sofiane
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (12) : 2344 - 2352
  • [4] Developing a visual perimetry test based on eye-tracking: proof of concept
    Martinez-Gonzalez, Eduardo A.
    Alba, Alfonso
    Mendez, Martin O.
    Fernandez-Wong, Jorge
    [J]. HEALTH AND TECHNOLOGY, 2020, 10 (02) : 437 - 441
  • [5] Developing a visual perimetry test based on eye-tracking: proof of concept
    Eduardo A. Martínez-González
    Alfonso Alba
    Martin O. Méndez
    Jorge Fernández-Wong
    [J]. Health and Technology, 2020, 10 : 437 - 441
  • [6] Webcam-Based Eye-Tracking of Attentional Biases in Alzheimer's Disease: A Proof-Of-Concept Study
    Greenaway, Anne-Marie
    Hwang, Faustina
    Nasuto, Slawomir
    Ho, Aileen
    [J]. CLINICAL GERONTOLOGIST, 2024, 47 (01) : 98 - 109
  • [7] Design and evaluation of an eye tracking support system for the scrub nurse
    Unger, Michael
    Black, David
    Fischer, Nele M.
    Neumuth, Thomas
    Glaser, Bernhard
    [J]. INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2019, 15 (01):
  • [8] Collaboration with a Robotic Scrub Nurse
    Jacob, Mithun George
    Li, Yu-Ting
    Akingba, George A.
    Wachs, Juan P.
    [J]. COMMUNICATIONS OF THE ACM, 2013, 56 (05) : 68 - 75
  • [9] Eye-tracking
    Tanenhaus, MK
    SpiveyKnowlton, MJ
    [J]. LANGUAGE AND COGNITIVE PROCESSES, 1996, 11 (06): : 583 - 588
  • [10] Semantics Based on Eye-tracking Data
    Buchmann, Robert Andrei
    Mihaila, Alin
    Meza, Radu
    [J]. AIC '09: PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON APPLIED INFORMATICS AND COMMUNICATIONS: RECENT ADVANCES IN APPLIED INFORMAT AND COMMUNICATIONS, 2009, : 471 - +