Human-computer interaction multi-task modeling based on implicit intent EEG decoding

被引:0
|
作者
Miao X. [1 ,2 ]
Hou W. [3 ,4 ,5 ]
机构
[1] School of Modern Post, School of Automation, Beijing University of Posts and Telecommunications, Beijing
[2] School of Architecture and Artistic Design, Inner Mongolia University of Science and Technology, Baotou
[3] School of Digital Media & Design Arts, Beijing University of Posts and Telecommunications
[4] Beijing Key Laboratoryof Network System and Network Culture, Beijing University of Postsand Telecommunications, Beijing
[5] Key Laboratory of Interactive Technology and Experience System, Ministry of Cultureand Tourism, Beijing University of Postsand Telecommunications, Beijing
关键词
electroencephalogram decoding; human-computer interaction; implicit intention; multi-task modeling;
D O I
10.13196/j.cims.2023.HI12
中图分类号
学科分类号
摘要
In the short term with fully autonomous level of machine intelligence can not be achieved,human are still an important part of the Human Computer Interaction (HCI) systems.Intelligent systems should be able to "feel" and "predict" human intentions to achieve multi-channel natural and dynamic collaboration between human and machine,which is very important to improve the safety and efficiency of HCI system.However,the process of HCI is filled with a lot of fuzzy and hidden implicit intentions,and the analysis efficiency and accuracy using traditional psychological or behavioral analysis methods are poor.With the development of sensing technology,the intention recognition based on physiological signals has become the main method,but the existing research basis has some problems,such as few separable modes,low recognition accuracy and insufficient research on domain context.A method to integrate human into human-machine coordination loop naturally based on passive brain-computer interface technology was presented in the field of industrial control complex system.The typical interactive tasks of Human-Machine Interaction (HMI) were extracted based on Multi-Attribute Task Battery (MATB) multi-task paradigm.Then,the common space pattern algorithm was used to extract the Electroencephalogram(EEG) spatial features of multi-task intention.A machine learning intention model was constructed to decode implicit intention EEG and realize automatic recognition of implicit intention through subject-wise cross-validation and 5-fold parameter optimization.It was proved that EEG signals could be used as the basis for judging the implicit intention of HCI,and CSP+SVM algorithm model could effectively improve the EEG decoding performance of implicit intention.The translation of implicit intent information was of significance for the study of intent-based efficient HCI model,the development of HCI systems and the improvement of human-machine collaboration efficiency. © 2024 CIMS. All rights reserved.
引用
收藏
页码:1668 / 1682
页数:14
相关论文
共 51 条
  • [1] Future and emerging technologies [M], (2012)
  • [2] MOORE A, O'REILLY T, NIELSEN P D, Et al., Four thought leaders on where the industry is headed[jj, IEEE Software, 33, 1, pp. 36-39, (2015)
  • [3] DE LEMOS R, GIESE H, MULLER H A, Et al., Software engineering for self-adaptive systems: A second research roadmap, Proceedings of the Software Engineering for Self-Adaptive Systems II, pp. 1-32, (2013)
  • [4] GIL M, ALBERT M, FONS J, Et al., Designing human-in-the-loop autonomous cyber-physical systems[jj, International Journal of Human-Computer Studies, 130, pp. 21-39, (2019)
  • [5] CUTRELL E, GUAN Z W, What are you looking for? An eye-tracking study of information usage in web search, Pro-ceedings of the Conference on Human Factors in Computing Systems, pp. 407-416, (2007)
  • [6] DENG Xin, XIAO Lifeng, YANG Pengfei, Et al., Development of a robot arm control system using motor imagery electroencephalography and electrooculography, CAAI Transactions on Intelligent Systems, 17, 6, pp. 1163-1172, (2022)
  • [7] WANG Xinrui, Research on auxiliary brain state monitoring methods in brain-computer interfaces[D], (2022)
  • [8] YAN Nan, WANG Jue, WEI Na, Feature exaction and classification of attention related electroencephalographic signals based on sample entropy[j], Journal of Xi'an Jiaotong University, 41, 10, pp. 1237-1241, (2007)
  • [9] HU X., YU J W, SONG MD, EEG correlates of ten positive emotionsCJ, Frontiers in Human Neuroscience, 11, (2017)
  • [10] XU Junli, WANG Ping, MU Zhendong, Fatigue driving detection based on eye movement and EEG features[J], Journal of Chongqing Jiaotong University: Natural Science, 40, 12, pp. s7-ll, (2021)