An novel SDA-CNN few shot domain adaptation framework for silent speech recognition

被引:0
|
作者
Ramkumar N. [1 ]
Karthika Renuka D. [1 ]
机构
[1] Department of Information Technology, PSG College of Technology, Tamil Nadu, Coimbatore
来源
Journal of Intelligent and Fuzzy Systems | 2024年 / 46卷 / 04期
关键词
Brain-computer interface; Convolutional Neural Network; distribution divergence; Electroencephalography; supervised domain adaptation;
D O I
10.3233/JIFS-237890
中图分类号
学科分类号
摘要
In BCI (brain-computer interface) applications, it is difficult to obtain enough well-labeled EEG data because of the expensive annotation and time-consuming data capture procedure. Conventional classification techniques that repurpose EEG data across domains and subjects lead to significant decreases in silent speech recognition classification accuracy. This research provides a supervised domain adaptation using Convolutional Neural Network framework (SDA-CNN) to tackle this problem. The objective is to provide a solution for the distribution divergence issue in the categorization of speech recognition across domains. The suggested framework involves taking raw EEG data and deriving deep features from it and the proposed feature selection method also retrieves the statistical features from the corresponding channels. Moreover, it attempts to minimize the distribution divergence caused by variations in people and settings by aligning the correlation of both the source and destination EEG characteristic dissemination. In order to obtain minimal feature distribution divergence and discriminative classification performance, the last stage entails simultaneously optimizing the loss of classification and adaption loss. The usefulness of the suggested strategy in reducing distributed divergence among the source and target Electroencephalography (EEG) data is demonstrated by extensive experiments carried out on KaraOne datasets. The suggested method achieves an average accuracy for classification of 87.4% for single-subject classification and a noteworthy average class accuracy of 88.6% for cross-subject situations, which shows that it surpasses existing cutting-edge techniques in thinking tasks. Regarding the speaking task, the model's median classification accuracy for single-subject categorization is 86.8%, while its average classification accuracy for cross-subject classification is 87.8%. These results underscore the innovative approach of SDA-CNN to mitigating distribution discrepancies while optimizing classification performance, offering a promising avenue to enhance accuracy and adaptability in brain-computer interface applications. © 2024 - IOS Press. All rights reserved.
引用
收藏
页码:10713 / 10726
页数:13
相关论文
共 50 条
  • [21] A prototypical network for few-shot recognition of speech imagery data
    Hernandez-Galvan, Alan
    Ramirez-Alonso, Graciela
    Ramirez-Quintana, Juan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [22] Pre-Finetuning for Few-Shot Emotional Speech Recognition
    Chen, Maximillian
    Yu, Zhou
    INTERSPEECH 2023, 2023, : 3602 - 3606
  • [23] SelectNAdapt: Support Set Selection for Few-Shot Domain Adaptation
    Dawoud, Youssef
    Carneiro, Gustavo
    Belagiannis, Vasileios
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 973 - 982
  • [24] Augmenting and Aligning Snippets for Few-Shot Video Domain Adaptation
    Xu, Yuecong
    Yang, Jianfei
    Zhou, Yunjiao
    Chen, Zhenghua
    Wu, Min
    Li, Xiaoli
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 13399 - 13410
  • [25] Few-Shot Domain Adaptation for Identification of Clinical Image in Dermatology
    Jing H.
    Zhang Q.
    Chen M.
    Zhang L.
    Li Z.
    Zhu J.
    Li Z.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2020, 54 (09): : 142 - 148and156
  • [26] Few-Shot Domain Adaptation via Mixup Optimal Transport
    Xu, Bingrong
    Zeng, Zhigang
    Lian, Cheng
    Ding, Zhengming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2518 - 2528
  • [27] Adversarial domain adaptation with CLIP for few-shot image classification
    Sun, Tongfeng
    Yang, Hongjian
    Li, Zhongnian
    Xu, Xinzheng
    Wang, Xiurui
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [28] Discriminativeness-Preserved Domain Adaptation for Few-Shot Learning
    Liu, Guangzhen
    Lu, Zhiwu
    IEEE ACCESS, 2020, 8 : 168405 - 168413
  • [29] CellTranspose: Few-shot Domain Adaptation for Cellular Instance Segmentation
    Keaton, Matthew R.
    Zaveri, Ram J.
    Doretto, Gianfranco
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 455 - 466
  • [30] FEW-SHOT ASSOCIATIVE DOMAIN ADAPTATION FOR SURFACE NORMAL ESTIMATION
    Kang, Haeyong
    Kim, Gwangsu
    Yoo, Chang D.
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4619 - 4623