Shared Control of Bimanual Robotic Limbs With a Brain-Machine Interface for Self-Feeding

被引:20
|
作者
Handelman, David A. [1 ]
Osborn, Luke E. [1 ]
Thomas, Tessy M. [2 ]
Badger, Andrew R. [1 ]
Thompson, Margaret [1 ]
Nickl, Robert W. [3 ]
Anaya, Manuel A. [3 ]
Wormley, Jared M. [1 ]
Cantarero, Gabriela L. [3 ]
McMullen, David [4 ]
Crone, Nathan E. [5 ]
Wester, Brock [1 ]
Celnik, Pablo A. [3 ]
Fifer, Matthew S. [1 ]
Tenore, Francesco V. [1 ]
机构
[1] Johns Hopkins Univ, Dept Res & Exploratory Dev, Appl Phys Lab, Laurel, MD 20723 USA
[2] Johns Hopkins Univ, Dept Biomed Engn, Sch Med, Baltimore, MD USA
[3] Johns Hopkins Med, Dept Phys Med & Rehabil, Baltimore, MD USA
[4] Natl Inst Mental Hlth, NIH, Bethesda, MD USA
[5] Johns Hopkins Med, Dept Neurol, Baltimore, MD USA
基金
美国国家卫生研究院;
关键词
human machine teaming; brain computer interface (BCI); bimanual control; robotic shared control; activities of daily living (ADL); STIMULATION; SENSATIONS;
D O I
10.3389/fnbot.2022.918001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Advances in intelligent robotic systems and brain-machine interfaces (BMI) have helped restore functionality and independence to individuals living with sensorimotor deficits; however, tasks requiring bimanual coordination and fine manipulation continue to remain unsolved given the technical complexity of controlling multiple degrees of freedom (DOF) across multiple limbs in a coordinated way through a user input. To address this challenge, we implemented a collaborative shared control strategy to manipulate and coordinate two Modular Prosthetic Limbs (MPL) for performing a bimanual self-feeding task. A human participant with microelectrode arrays in sensorimotor brain regions provided commands to both MPLs to perform the self-feeding task, which included bimanual cutting. Motor commands were decoded from bilateral neural signals to control up to two DOFs on each MPL at a time. The shared control strategy enabled the participant to map his four-DOF control inputs, two per hand, to as many as 12 DOFs for specifying robot end effector position and orientation. Using neurally-driven shared control, the participant successfully and simultaneously controlled movements of both robotic limbs to cut and eat food in a complex bimanual self-feeding task. This demonstration of bimanual robotic system control via a BMI in collaboration with intelligent robot behavior has major implications for restoring complex movement behaviors for those living with sensorimotor deficits.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Continuous Teleoperation of a Robotic Manipulator via Brain-Machine Interface with Shared Control
    Tortora, Stefano
    Gottardi, Alberto
    Menegatti, Emanuele
    Tonin, Luca
    [J]. 2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [2] Bimodal brain-machine interface for motor control of robotic prosthetic
    Darmanjian, S
    Kim, SP
    Nechyba, MC
    Morrison, S
    Principe, J
    Wessberg, J
    Nicolelis, MAL
    [J]. IROS 2003: PROCEEDINGS OF THE 2003 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2003, : 3612 - 3617
  • [3] A Brain-Machine Interface Enables Bimanual Arm Movements in Monkeys
    Ifft, Peter J.
    Shokur, Solaiman
    Li, Zheng
    Lebedev, Mikhail A.
    Nicolelis, Miguel A. L.
    [J]. SCIENCE TRANSLATIONAL MEDICINE, 2013, 5 (210)
  • [4] Shared Control of an Intelligent Wheelchair with Dynamic Constraints Using Brain-Machine Interface
    Li, Z.
    Yang, C.
    Zhao, S.
    Wang, N.
    Su, C. -Y.
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2015), PT II, 2015, 9245 : 260 - 271
  • [5] Brain-Machine Interface Control Algorithms
    Shanechi, Maryam M.
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (10) : 1725 - 1734
  • [6] Assistive Mobile Robot with Shared Control of Brain-Machine Interface and Computer Vision
    Song, Yonghao
    Wu, Weifeng
    Lin, Chengqi
    Lin, Gengliang
    Li, Guofeng
    Xie, Longhan
    [J]. PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 405 - 409
  • [7] Brain-Machine Interface Based on EEG Mapping to Control an Assistive Robotic Arm
    Ubeda, Andres
    Azorin, Jose M.
    Garcia, Nicolas
    Sabater, Jose M.
    Perez, Carlos
    [J]. 2012 4TH IEEE RAS & EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL ROBOTICS AND BIOMECHATRONICS (BIOROB), 2012, : 1311 - 1315
  • [8] Control of a robotic prosthesis simulation by a closed-loop intracortical brain-machine interface
    Goueytes, Dorian
    Abbasi, Aamir
    Lassagne, Henri
    Shulz, Daniel E.
    Estebanez, Luc
    Ego-Stengel, Valerie
    [J]. 2019 9TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2019, : 183 - 186
  • [9] Robotic arm control using hybrid brain-machine interface and augmented reality feedback
    Wang, Yanxin
    Zeng, Hong
    Song, Aiguo
    Xu, Baoguo
    Li, Huijun
    Zhu, Lifeng
    Wen, Pengcheng
    Liu, Jia
    [J]. 2017 8TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2017, : 411 - 414
  • [10] EEG Based Brain-Machine Interface for Navigation of Robotic Device
    Mahmud, Mufti
    Hawellek, David
    Bertoldo, Alessandra
    [J]. 2010 3RD IEEE RAS AND EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL ROBOTICS AND BIOMECHATRONICS, 2010, : 168 - 172