A Biologically Inspired Attention Network for EEG-Based Auditory Attention Detection

被引:3
|
作者
Li, Peiwen [1 ]
Cai, Siqi [1 ,2 ]
Su, Enze [1 ]
Xie, Longhan [1 ]
机构
[1] South China Univ Technol, Shien Ming Wu Sch Intelligent Engn, Guangzhou 510460, Guangdong, Peoples R China
[2] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119077, Singapore
基金
中国国家自然科学基金;
关键词
Electroencephalography; Decoding; Brain modeling; Frequency modulation; Speech processing; Training; Three-dimensional displays; Auditory attention; brain-computer interfaces; cross-modal attention; electroencephalography; ATTENDED SPEECH; OSCILLATIONS; TRACKING;
D O I
10.1109/LSP.2021.3134563
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Decoding auditory attention in a cocktail party from neural activities is crucial in the brain-computer interfaces (BCIs). Given that the speech-electroencephalography (EEG) relationships are informative about attentional focus, we propose a novel framework called the biologically inspired attention network (BIAnet) to capture the interactions between EEG and speech. With the neural attention mechanism, the BIAnet can model how each EEG frequency band is related to the subband envelopes of speech by dynamically assigning weights to individual frequency bands at run-time. Results show that the proposed BIAnet outperforms state-of-the-art AAD methods on two publicly available datasets. We also analyze how the BIAnet works and the frequency-specific interactions between EEG and speech signals through data visualization. Overall, the proposed BIAnet provides an accurate, low-latency, and interpretable AAD approach, which has the potential to be extended to general problems in BCIs.
引用
收藏
页码:284 / 288
页数:5
相关论文
共 50 条
  • [1] A Neural-Inspired Architecture for EEG-Based Auditory Attention Detection
    Cai, Siqi
    Li, Peiwen
    Su, Enze
    Liu, Qi
    Xie, Longhan
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2022, 52 (04) : 668 - 676
  • [2] A neuroscience-inspired spiking neural network for EEG-based auditory spatial attention detection
    Faghihi, Faramarz
    Cai, Siqi
    Moustafa, Ahmed A.
    [J]. NEURAL NETWORKS, 2022, 152 : 555 - 565
  • [3] EEG-Based Auditory Attention Detection via Frequency and Channel Neural Attention
    Cai, Siqi
    Su, Enze
    Xie, Longhan
    Li, Haizhou
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2022, 52 (02) : 256 - 266
  • [4] EEG-based Auditory Attention Detection in Cocktail Party Environment
    Cai, Siqi
    Zhu, Hongxu
    Schultz, Tanja
    Li, Haizhou
    [J]. APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2023, 12 (03)
  • [5] RGCnet: An Efficient Recursive Gated Convolutional Network for EEG-based Auditory Attention Detection
    Cai, Siqi
    Li, Jia
    Yang, Hongmeng
    Li, Haizhou
    [J]. 2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [6] EEG-based detection of the locus of auditory attention with convolutional neural networks
    Vandecappelle, Servaas
    Deckers, Lucas
    Das, Neetha
    Ansari, Amir Hossein
    Bertrand, Alexander
    Francart, Tom
    [J]. ELIFE, 2021, 10
  • [7] Auditory-Inspired Speech Envelope Extraction Methods for Improved EEG-Based Auditory Attention Detection in a Cocktail Party Scenario
    Biesmans, Wouter
    Das, Neetha
    Francart, Tom
    Bertrand, Alexander
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (05) : 402 - 412
  • [8] Auditory Attention Detection with EEG Channel Attention
    Su, Enze
    Cai, Siqi
    Li, Peiwen
    Xie, Longhan
    Li, Haizhou
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 5804 - 5807
  • [9] EEG-Based Auditory Attention Detection and Its Possible Future Applications for Passive BCI
    Belo, Joan
    Clerc, Maureen
    Schon, Daniele
    [J]. FRONTIERS IN COMPUTER SCIENCE, 2021, 3
  • [10] EEG-based auditory attention detection: boundary conditions for background noise and speaker positions
    Das, Neetha
    Bertrand, Alexander
    Francart, Tom
    [J]. JOURNAL OF NEURAL ENGINEERING, 2018, 15 (06)