MLDA: Multi-Loss Domain Adaptor for Cross-Session and Cross-Emotion EEG-Based Individual Identification

被引:4
|
作者
Miao, Yifan [1 ,2 ,3 ]
Jiang, Wanqing [1 ,2 ,3 ]
Su, Nuo [4 ]
Shan, Jun [4 ]
Jiang, Tianzi [1 ,2 ,3 ]
Zuo, Nianming [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Brainnetome Ctr, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Inst Automat, NLPR, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Ocean Univ China, Coll Comp Sci & Technol, Qingdao 266100, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Task analysis; Support vector machines; Recording; Motion pictures; Brain modeling; EEG; biometric; across mental states; across time; deep learning; domain adaptation; BRAIN;
D O I
10.1109/JBHI.2023.3315974
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional individual identification methods, such as face and fingerprint recognition, carry the risk of personal information leakage. The uniqueness and privacy of electroencephalograms (EEG) and the popularization of EEG acquisition devices have intensified research on EEG-based individual identification in recent years. However, most existing work uses EEG signals from a single session or emotion, ignoring large differences between domains. As EEG signals do not satisfy the traditional deep learning assumption that training and test sets are independently and identically distributed, it is difficult for trained models to maintain good classification performance for new sessions or new emotions. In this article, an individual identification method, called Multi-Loss Domain Adaptor (MLDA), is proposed to deal with the differences between marginal and conditional distributions elicited by different domains. The proposed method consists of four parts: a) Feature extractor, which uses deep neural networks to extract deep features from EEG data; b) Label predictor, which uses full-layer networks to predict subject labels; c) Marginal distribution adaptation, which uses maximum mean discrepancy (MMD) to reduce marginal distribution differences; d) Associative domain adaptation, which adapts to conditional distribution differences. Using the MLDA method, the cross-session and cross-emotion EEG-based individual identification problem is addressed by reducing the influence of time and emotion. Experimental results confirmed that the method outperforms other state-of-the-art approaches.
引用
收藏
页码:5767 / 5778
页数:12
相关论文
共 50 条
  • [1] Affective EEG-based cross-session person identification using hierarchical graph embedding
    Liu, Honggang
    Jin, Xuanyu
    Liu, Dongjun
    Kong, Wanzeng
    Tang, Jiajia
    Peng, Yong
    COGNITIVE NEURODYNAMICS, 2024, 18 (05) : 2897 - 2908
  • [2] Toward cross-subject and cross-session generalization in EEG-based emotion recognition: Systematic review, taxonomy, and methods
    Apicella, Andrea
    Arpaia, Pasquale
    D'Errico, Giovanni
    Marocco, Davide
    Mastrati, Giovanna
    Moccaldi, Nicola
    Prevete, Roberto
    NEUROCOMPUTING, 2024, 604
  • [3] Multisource Associate Domain Adaptation for Cross-Subject and Cross-Session EEG Emotion Recognition
    She, Qingshan
    Zhang, Chenqi
    Fang, Feng
    Ma, Yuliang
    Zhang, Yingchun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [4] Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems
    Wang, Kangning
    Qiu, Shuang
    Wei, Wei
    Yi, Weibo
    He, Huiguang
    Xu, Minpeng
    Jung, Tzyy-Ping
    Ming, Dong
    JOURNAL OF NEURAL ENGINEERING, 2023, 20 (05)
  • [5] Dynamic Domain Adaptation for Class-Aware Cross-Subject and Cross-Session EEG Emotion Recognition
    Li, Zhunan
    Zhu, Enwei
    Jin, Ming
    Fan, Cunhang
    He, Huiguang
    Cai, Ting
    Li, Jinpeng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (12) : 5964 - 5973
  • [6] FMLAN: A novel framework for cross-subject and cross-session EEG emotion recognition
    Yu, Peng
    He, Xiaopeng
    Li, Haoyu
    Dou, Haowen
    Tan, Yeyu
    Wu, Hao
    Chen, Badong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100
  • [7] TSFAN: tensorized spatial-frequency attention network with domain adaptation for cross-session EEG-based biometric recognition
    Jin, Xuanyu
    Yang, Xinyu
    Kong, Wanzeng
    Zhu, Li
    Tang, Jiajia
    Peng, Yong
    Ding, Yu
    Zhao, Qibin
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (04)
  • [8] Multi-Scale Masked Autoencoders for Cross-Session Emotion Recognition
    Pang, Miaoqi
    Wang, Hongtao
    Huang, Jiayang
    Vong, Chi-Man
    Zeng, Zhiqiang
    Chen, Chuangquan
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 1637 - 1646
  • [9] Joint disentangled representation and domain adversarial training for EEG-based cross-session biometric recognition in single-task protocols
    Liu, Honggang
    Jin, Xuanyu
    Liu, Dongjun
    Kong, Wanzeng
    Tang, Jiajia
    Peng, Yong
    COGNITIVE NEURODYNAMICS, 2025, 19 (01)
  • [10] Multi-source joint domain adaptation for cross-subject and cross-session emotion recognition from electroencephalography
    Liang, Shengjin
    Su, Lei
    Wu, Liping
    Fu, Yunfa
    FRONTIERS IN HUMAN NEUROSCIENCE, 2022, 16