A comparison and classification of oscillatory characteristics in speech perception and covert speech

被引:5
|
作者
Moon, Jae [1 ]
Orlandi, Silvia [2 ]
Chau, Tom [1 ]
机构
[1] Univ Toronto, Holland Bloorview Kids Rehabil Hosp, Bloorview Res Inst, Inst Biomed Engn, Toronto, ON, Canada
[2] Univ Bologna, Dept Elect Elect & Informat Engn Guglielmo Marcon, Bologna, Italy
关键词
EEG; Neural oscillation; Phase-amplitude coupling; Speech perception; Covert speech; Brain-computer interface; COROLLARY DISCHARGE DYSFUNCTION; CONTINUOUS WAVELET TRANSFORM; NEURONAL OSCILLATIONS; SENSORIMOTOR INTEGRATION; COMPUTATIONAL PRINCIPLES; BRAIN OSCILLATIONS; THETA OSCILLATIONS; SURFACE LAPLACIAN; WORKING-MEMORY; INNER SPEECH;
D O I
10.1016/j.brainres.2022.147778
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Covert speech, the mental imagery of speaking, has been studied increasingly to understand and decode thoughts in the context of brain-computer interfaces. In studies of speech comprehension, neural oscillations are thought to play a key role in the temporal encoding of speech. However, little is known about the role of oscillations in covert speech. In this study, we investigated the oscillatory involvements in covert speech and speech perception. Data were collected from 10 participants with 64 channel EEG. Participants heard the words, 'blue' and 'orange', and subsequently mentally rehearsed them. First, continuous wavelet transform was performed on epoched signals and subsequently two-tailed t-tests between two classes (tasks) were conducted to determine statistical differences in frequency and time (t-CWT). In the current experiment, a task comprised speech perception or covert rehearsal of a word while a condition was the discrimination between tasks. Features were extracted using t-CWT and subsequently classified using a support vector machine. theta and gamma phase amplitude coupling (PAC) was also assessed within tasks and across conditions between perception and covert activities (i.e. cross-task). All binary classifications accuracies (80-90%) significantly exceeded chance level, supporting the use of t-CWT in determining relative oscillatory involvements. While the perception condition dynamically invoked all frequencies with more prominent theta and alpha activity, the covert condition favoured higher frequencies with significantly higher gamma activity than perception. Moreover, the perception condition produced significant theta-gamma PAC, possibly corroborating a reported linkage between syllabic and phonemic sampling. Although this coupling was found to be suppressed in the covert condition, we found significant cross-task coupling between perception theta and covert speech gamma. Covert speech processing appears to be largely associated with higher frequencies of EEG. Importantly, the significant cross-task coupling between speech perception and covert speech, in the absence of within-task covert speech PAC, seems to support the notion that the gamma- and theta-bands reflect, respectively, shared and unique encoding processes across tasks.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Online Ternary Classification of Covert Speech by Leveraging the Passive Perception of Speech
    Moon, Jae
    Chau, Tom
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2023,
  • [2] OVERT AND COVERT ASPECTS OF ADULT SPEECH-PERCEPTION
    MORSE, PA
    LEAVITT, LA
    MILLER, CL
    ROMERO, RC
    [J]. JOURNAL OF SPEECH AND HEARING RESEARCH, 1977, 20 (01): : 40 - 54
  • [3] Shared and task-specific phase coding characteristics of gamma- and theta-bands in speech perception and covert speech
    Moon, Jae
    Chau, Tom
    [J]. SPEECH COMMUNICATION, 2023, 147 : 63 - 73
  • [4] SOME CHARACTERISTICS OF SPEECH PERCEPTION
    GALUNOV, VI
    [J]. SOVIET PHYSICS ACOUSTICS-USSR, 1967, 12 (04): : 369 - &
  • [5] Comparison of speech parameterization techniques for the classification of speech disfluencies
    Fook, Chong Yen
    Muthusamy, Hariharan
    Chee, Lim Sin
    Bin Yaacob, Sazali
    Bin Adom, Abdul Hamid
    [J]. TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2013, 21 : 1983 - 1994
  • [6] Song and speech: Brain regions involved with perception and covert production
    Callan, Daniel E.
    Tsytsarev, Vassilly
    Hanakawa, Takashi
    Callan, Akiko M.
    Katsuhara, Maya
    Fukuyama, Hidenao
    Turner, Robert
    [J]. NEUROIMAGE, 2006, 31 (03) : 1327 - 1342
  • [7] Multiclass covert speech classification using extreme learning machine
    Dipti Pawar
    Sudhir Dhage
    [J]. Biomedical Engineering Letters, 2020, 10 : 217 - 226
  • [8] Multiclass covert speech classification using extreme learning machine
    Pawar, Dipti
    Dhage, Sudhir
    [J]. BIOMEDICAL ENGINEERING LETTERS, 2020, 10 (02) : 217 - 226
  • [9] Lateralization of Brain During EEG Based Covert Speech Classification
    Biswas, Sukanya
    Sinha, Rohit
    [J]. IEEE INDICON: 15TH IEEE INDIA COUNCIL INTERNATIONAL CONFERENCE, 2018,
  • [10] EEG Classification of Covert Speech Using Regularized Neural Networks
    Sereshkeh, Alborz Rezazadeh
    Trott, Robert
    Bricout, Aurelien
    Chau, Tom
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2017, 25 (12) : 2292 - 2300