Meeting brain-computer interface user performance expectations using a deep neural network decoding framework

被引:98
|
作者
Schwemmer, Michael A. [1 ]
Skomrock, Nicholas D. [1 ]
Sederberg, Per B. [2 ]
Ting, Jordyn E. [3 ]
Sharma, Gaurav [3 ]
Bockbrader, Marcia A. [4 ,5 ]
Friedenberg, David A. [1 ]
机构
[1] Battelle Mem Inst, Adv Analyt, 505 King Ave, Columbus, OH 43201 USA
[2] Univ Virginia, Dept Psychol, Gilmer Hall, Charlottesville, VA 22903 USA
[3] Battelle Mem Inst, Med Devices & Neuromodulat, 505 King Ave, Columbus, OH 43201 USA
[4] Ohio State Univ, Neurol Inst, Columbus, OH 43210 USA
[5] Ohio State Univ, Dept Phys Med & Rehabil, Columbus, OH 43210 USA
关键词
MACHINE INTERFACES; MUSCLE STIMULATION; POTENTIAL USERS; WANT OPINIONS; PRIORITIES; TETRAPLEGIA; COMMUNICATION; MOVEMENTS; RELEASE; GRASP;
D O I
10.1038/s41591-018-0171-y
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
Brain-computer interface (BCI) neurotechnology has the potential to reduce disability associated with paralysis by translating neural activity into control of assistive devices(1-9). Surveys of potential end-users have identified key BCI system features(10-14), including high accuracy, minimal daily setup, rapid response times, and multifunctionality. These performance characteristics are primarily influenced by the BCI's neural decoding algorithm(1,15), which is trained to associate neural activation patterns with intended user actions. Here, we introduce a new deep neural network(16) decoding framework for BCI systems enabling discrete movements that addresses these four key performance characteristics. Using intracortical data from a participant with tetraplegia, we provide offline results demonstrating that our decoder is highly accurate, sustains this performance beyond a year without explicit daily retraining by combining it with an unsupervised updating procedure(3,17- 20), responds faster than competing methods(8), and can increase functionality with minimal retraining by using a technique known as transfer learning(21). We then show that our participant can use the decoder in real-time to reanimate his paralyzed forearm with functional electrical stimulation (FES), enabling accurate manipulation of three objects from the grasp and release test (GRT)(22). These results demonstrate that deep neural network decoders can advance the clinical translation of BCI technology.
引用
收藏
页码:1669 / +
页数:11
相关论文
共 50 条
  • [1] Meeting brain–computer interface user performance expectations using a deep neural network decoding framework
    Michael A. Schwemmer
    Nicholas D. Skomrock
    Per B. Sederberg
    Jordyn E. Ting
    Gaurav Sharma
    Marcia A. Bockbrader
    David A. Friedenberg
    [J]. Nature Medicine, 2018, 24 : 1669 - 1676
  • [2] NEURAL DECODING USING A NONLINEAR GENERATIVE MODEL FOR BRAIN-COMPUTER INTERFACE
    Dantas, Henrique
    Kellis, Spencer
    Mathews, V. John
    Greger, Bradley
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [3] Application of Neural Network to Brain-Computer Interface
    Hsu, Wei-Yen
    Chiang, I-Jen
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING (GRC 2012), 2012, : 163 - 168
  • [4] Brain-Computer Interface Using Deep Neural Network and Its Application to Mobile Robot Control
    Huve, Gauvain
    Takahashi, Kazuhiko
    Hashimoto, Masafumi
    [J]. 2018 IEEE 15TH INTERNATIONAL WORKSHOP ON ADVANCED MOTION CONTROL (AMC), 2018, : 169 - 174
  • [5] A deep neural network with subdomain adaptation for motor imagery brain-computer interface
    Zheng, Minmin
    Yang, Banghua
    [J]. MEDICAL ENGINEERING & PHYSICS, 2021, 96 (96) : 29 - 40
  • [6] A hybrid autoencoder framework of dimensionality reduction for brain-computer interface decoding
    Ran, Xingchen
    Chen, Weidong
    Yvert, Blaise
    Zhang, Shaomin
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 148
  • [7] Deep Convolutional Neural Network for Decoding Motor Imagery based Brain Computer Interface
    Zhang, Jin
    Yan, Chungang
    Gong, Xiaoliang
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING (ICSPCC), 2017,
  • [8] Continuous tracking using deep learning-based decoding for noninvasive brain-computer interface
    Forenzo, Dylan
    Zhu, Hao
    Shanahan, Jenn
    Lim, Jaehyun
    He, Bin
    [J]. PNAS NEXUS, 2024, 3 (04):
  • [9] Brain-Computer Interface using neural network and temporal-spectral features
    Wang, Gan
    Cerf, Moran
    [J]. FRONTIERS IN NEUROINFORMATICS, 2022, 16
  • [10] Application of Continuous Wavelet Transform and Convolutional Neural Network in Decoding Motor Imagery Brain-Computer Interface
    Lee, Hyeon Kyu
    Choi, Young-Seok
    [J]. ENTROPY, 2019, 21 (12)