Quadcopter Robot Control Based on Hybrid Brain-Computer Interface System

被引:20
|
作者
Chao, Chen [1 ,2 ]
Zhou, Peng [1 ]
Belkacem, Abdelkader Nasreddine [3 ]
Lu, Lin [4 ]
Xu, Rui [2 ]
Wang, Xiaotian [5 ]
Tan, Wenjun [6 ]
Qiao, Zhifeng [1 ]
Li, Penghai [1 ]
Gao, Qiang [1 ]
Shin, Duk [7 ]
机构
[1] Tianjin Univ Technol, Key Lab Complex Syst Control Theory & Applicat, Tianjin 300384, Peoples R China
[2] Tianjin Univ Technol, Acad Med Engn & Translat Med, Tianjin 300072, Peoples R China
[3] UAE Univ, Coll Informat Technol, Dept Comp & Network Engn, Al Ain 15551, U Arab Emirates
[4] Tianjin Univ Technol, Zhonghuan Informat Coll, Tianjin 300380, Peoples R China
[5] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
[6] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110189, Peoples R China
[7] Tokyo Polytech Univ, Dept Elect & Mechatron, Tokyo 2430297, Japan
基金
中国国家自然科学基金;
关键词
hybrid brain computer interface (hBCI); common spatial pattern (CSP); hierarchical support vector machine (hSVM); EEG; SIGNALS; COMMUNICATION; SPEED; FORCE; P300;
D O I
10.18494/SAM.2020.2517
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
A hybrid brain-computer interface (hBCI) has recently been proposed to address the limitations of existing single-modal brain computer interfaces (BCIs) in terms of accuracy and information transfer rate (ITR) by combining more than one modality. The hBCI system also showed promising prospects for patients because the design of a human-centered smart robot control system may allow the performance of multiple tasks with high efficiency. In this paper, we present a hybrid multicontrol system that simultaneously uses electroencephalography (EEG) and electrooculography (EOG) signals. After the preprocessing phase, we used a common spatial pattern (CSP) algorithm to extract EEG and EOG features from motor imagery and eye movements. Moreover, a support vector machine (SVM) was used to solve a multiclass problem and complete flight operations through the asynchronous hBCI control of a four-axis quadcopter (e.g., takeoff, forward, backward, rightward, leftward, and landing). Online decoding of experimental results showed that 97.14, 95.23, 98.09, and 96.66% average accuracies, and 45.80, 43.99, 46.78, and 45.34 bits/min average ITRs were achieved in the control of a quadcopter. These online experimental results showed that the proposed hybrid system might be better in terms of completing multidirection control tasks to increase the multitasking and dimensionality of a BCI.
引用
收藏
页码:991 / 1004
页数:14
相关论文
共 50 条
  • [1] Control of a Quadcopter with Hybrid Brain-Computer Interface
    Yu, Yih-Choung
    Garrison, Haley
    Battison, Alexandria
    Gabel, Lisa
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 2779 - 2784
  • [2] Application of Hybrid Brain-Computer Interface with Augmented Reality on Quadcopter Control
    Choi, Jaehoon
    Jo, Sungho
    [J]. 2020 8TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2020, : 107 - 111
  • [3] SSVEP Based Brain-Computer Interface for Robot Control
    Ortner, Rupert
    Guger, Christoph
    Prueckl, Robert
    Gruenbacher, Engelbert
    Edlinger, Guenter
    [J]. COMPUTERS HELPING PEOPLE WITH SPECIAL NEEDS, PROCEEDINGS, PT 2, 2010, 6180 : 85 - 90
  • [4] A Hybrid Brain-Computer Interface for ClosedLoop Position Control of a Robot Arm
    Arnab Rakshit
    Amit Konar
    Atulya K.Nagar
    [J]. IEEE/CAA Journal of Automatica Sinica, 2020, 7 (05) : 1344 - 1360
  • [5] Fast Robot Arm Control Based on Brain-computer Interface
    Wang, Jingjun
    Liu, Yadong
    Tang, Jingsheng
    [J]. 2016 IEEE INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC), 2016, : 571 - 575
  • [6] Robot control with multitasking of brain-computer interface
    Zhou, Yajun
    Lu, Zilin
    Li, Yuanqing
    [J]. 2022 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2022, : 155 - 160
  • [7] A Multiple Command UAV Control System Based on a Hybrid Brain-Computer Interface
    Wu, Qingfu
    Xie, Shanghong
    Zeng, Zhen
    Huang, Qian
    Pan, Jiahui
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [8] Service robot system based on brain-computer interface technology
    Zhao, Li
    Li, Chuo
    Cui, Shigang
    [J]. ICNC 2007: THIRD INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 2, PROCEEDINGS, 2007, : 349 - +
  • [9] A brain-computer interface-based meal-assist robot control system
    Ha, Jihyeon
    Kim, Laehyun
    [J]. 2021 9TH IEEE INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2021, : 199 - 201
  • [10] Control of a nursing bed based on a hybrid brain-computer interface
    Peng, Nengneng
    Zhang, Rui
    Zeng, Haihua
    Wang, Fei
    Li, Kai
    Li, Yuanqing
    Zhuang, Xiaobin
    [J]. 2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 1556 - 1559