An novel SDA-CNN few shot domain adaptation framework for silent speech recognition

被引:0
|
作者
Ramkumar N. [1 ]
Karthika Renuka D. [1 ]
机构
[1] Department of Information Technology, PSG College of Technology, Tamil Nadu, Coimbatore
来源
Journal of Intelligent and Fuzzy Systems | 2024年 / 46卷 / 04期
关键词
Brain-computer interface; Convolutional Neural Network; distribution divergence; Electroencephalography; supervised domain adaptation;
D O I
10.3233/JIFS-237890
中图分类号
学科分类号
摘要
In BCI (brain-computer interface) applications, it is difficult to obtain enough well-labeled EEG data because of the expensive annotation and time-consuming data capture procedure. Conventional classification techniques that repurpose EEG data across domains and subjects lead to significant decreases in silent speech recognition classification accuracy. This research provides a supervised domain adaptation using Convolutional Neural Network framework (SDA-CNN) to tackle this problem. The objective is to provide a solution for the distribution divergence issue in the categorization of speech recognition across domains. The suggested framework involves taking raw EEG data and deriving deep features from it and the proposed feature selection method also retrieves the statistical features from the corresponding channels. Moreover, it attempts to minimize the distribution divergence caused by variations in people and settings by aligning the correlation of both the source and destination EEG characteristic dissemination. In order to obtain minimal feature distribution divergence and discriminative classification performance, the last stage entails simultaneously optimizing the loss of classification and adaption loss. The usefulness of the suggested strategy in reducing distributed divergence among the source and target Electroencephalography (EEG) data is demonstrated by extensive experiments carried out on KaraOne datasets. The suggested method achieves an average accuracy for classification of 87.4% for single-subject classification and a noteworthy average class accuracy of 88.6% for cross-subject situations, which shows that it surpasses existing cutting-edge techniques in thinking tasks. Regarding the speaking task, the model's median classification accuracy for single-subject categorization is 86.8%, while its average classification accuracy for cross-subject classification is 87.8%. These results underscore the innovative approach of SDA-CNN to mitigating distribution discrepancies while optimizing classification performance, offering a promising avenue to enhance accuracy and adaptability in brain-computer interface applications. © 2024 - IOS Press. All rights reserved.
引用
收藏
页码:10713 / 10726
页数:13
相关论文
共 50 条
  • [31] Spectral Adversarial MixUp for Few-Shot Unsupervised Domain Adaptation
    Zhang, Jiajin
    Chao, Hanqing
    Dhurandhar, Amit
    Chen, Pin-Yu
    Tajer, Ali
    Xu, Yangyang
    Yan, Pingkun
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 728 - 738
  • [32] Exploring the Adaptation Strategy of CLIP for Few-Shot Action Recognition
    Cao, Congqi
    Zhang, Yueran
    Lv, Qinyi
    Min, Lingtong
    Zhang, Yanning
    PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON EFFICIENT MULTIMEDIA COMPUTING UNDER LIMITED RESOURCES, EMCLR 2024, 2024, : 39 - 48
  • [33] Convert Cross-Domain Classification Into Few-Shot Learning: A Unified Prompt-Tuning Framework for Unsupervised Domain Adaptation
    Zhu, Yi
    Shen, Hui
    Li, Yun
    Qiang, Jipeng
    Yuan, Yunhao
    Wu, Xindong
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 810 - 821
  • [34] A few-shot based phase-batch multi-layer domain adaptation pattern recognition method
    Li, Yiming
    Wang, Jiankang
    Luo, Guangxu
    Liu, Tongshan
    Song, Guiqiu
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (07)
  • [35] Radar HRRP based few-shot target recognition with CNN-SSD
    采用CNN-SSD的雷达HRRP小样本目标识别方法
    Han, Ning (haning1103@163.com); Chen, Bo (bchen@mail.xidian.edu.cn), 1600, Science Press (48): : 7 - 14
  • [36] FedFSLAR: A Federated Learning Framework for Few-shot Action Recognition
    Nguyen Anh Tu
    Abu, Assanali
    Aikyn, Nartay
    Makhanov, Nursultan
    Lee, Min-Ho
    Khiem Le-Huy
    Wong, Kok-Seng
    2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 270 - 279
  • [37] SUPERVISED DOMAIN ADAPTATION FOR EMOTION RECOGNITION FROM SPEECH
    Abdelwahab, Mohammed
    Busso, Carlos
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 5058 - 5062
  • [38] Adversarial Domain Adaptation for Noisy Speech Emotion Recognition
    Cho, Sunyoung
    Yoon, Soosung
    Song, Hyunseung
    2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 1966 - 1970
  • [39] DOMAIN ADAPTATION FOR LEARNING GENERATOR FROM PAIRED FEW-SHOT DATA
    Teng, Chun-Chih
    Chen, Pin-Yu
    Chiu, Wei-Chen
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1750 - 1754
  • [40] Perspectives of Calibrated Adaptation for Few-Shot Cross-Domain Classification
    Kong, Dechen
    Yang, Xi
    Wang, Nannan
    Gao, Xinbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2410 - 2421