Dual-Modal Information Bottleneck Network for Seizure Detection

被引:17
|
作者
Wang, Jiale [1 ]
Ge, Xinting [1 ]
Shi, Yunfeng [1 ]
Sun, Mengxue [1 ]
Gong, Qingtao [2 ]
Wang, Haipeng [3 ]
Huang, Wenhui [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250358, Peoples R China
[2] Ludong Univ, Ulsan Ship & Ocean Coll, Yantai 264025, Peoples R China
[3] Naval Aviat Univ, Inst Informat Fus, Yantai 264001, Peoples R China
关键词
Seizure detection; dual modal; information bottleneck; temporal dependencies; BiLSTM; EEG; PREDICTION;
D O I
10.1142/S0129065722500617
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, deep learning has shown very competitive performance in seizure detection. However, most of the currently used methods either convert electroencephalogram (EEG) signals into spectral images and employ 2D-CNNs, or split the one-dimensional (1D) features of EEG signals into many segments and employ 1D-CNNs. Moreover, these investigations are further constrained by the absence of consideration for temporal links between time series segments or spectrogram images. Therefore, we propose a Dual-Modal Information Bottleneck (Dual-modal IB) network for EEG seizure detection. The network extracts EEG features from both time series and spectrogram dimensions, allowing information from different modalities to pass through the Dual-modal IB, requiring the model to gather and condense the most pertinent information in each modality and only share what is necessary. Specifically, we make full use of the information shared between the two modality representations to obtain key information for seizure detection and to remove irrelevant feature between the two modalities. In addition, to explore the intrinsic temporal dependencies, we further introduce a bidirectional long-short-term memory (BiLSTM) for Dual-modal IB model, which is used to model the temporal relationships between the information after each modality is extracted by convolutional neural network (CNN). For CHB-MIT dataset, the proposed framework can achieve an average segment-based sensitivity of 97.42%, specificity of 99.32%, accuracy of 98.29%, and an average event-based sensitivity of 96.02%, false detection rate (FDR) of 0.70/h.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Object Detection Algorithm Based on Dual-modal Fusion Network
    Sun Ying
    Hou Zhiqiang
    Yang Chen
    Ma Sugang
    Fan Jiulun
    ACTA PHOTONICA SINICA, 2023, 52 (01)
  • [2] IMAGE FUSION NETWORK FOR DUAL-MODAL RESTORATION
    Zhang, Ying
    Ren, Xuhua
    Clifford, Bryan Alexander
    Wang, Qian
    Zhang, Xiaoqun
    INVERSE PROBLEMS AND IMAGING, 2021, 15 (06) : 1409 - 1419
  • [3] Dual-modal aptasensor for the detection of isocarbophos in vegetables
    Wang, Rong-Hua
    Zhu, Cheng-Long
    Wang, Ling-Ling
    Xu, Li-Zhi
    Wang, Wen-Long
    Yang, Cheng
    Zhang, Yi
    TALANTA, 2019, 205
  • [4] A Smart Dual-modal Aligned Transformer Deep Network for Robotic Grasp Detection
    Cang, Xin
    Zhang, Haojun
    Yang, Yuequan
    Cao, Zhiqiang
    Li, Fudong
    Zhu, Jiaming
    2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 1230 - 1235
  • [5] A study of the feasibility and effectiveness of dual-modal information presentations
    Fang, XW
    Xu, SA
    Brzezinski, J
    Chan, SS
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2006, 20 (01) : 3 - 17
  • [6] Dual-Modal Drowsiness Detection to Enhance Driver Safety
    Chew, Yi Xuan
    Razak, Siti Fatimah Abdul
    Yogarayan, Sumendra
    Ismail, Sharifah Noor Masidayu Sayed
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (03): : 4397 - 4417
  • [7] Airfield concrete pavement joint detection network based on dual-modal feature fusion
    Yuan, Bo
    Sun, Zhaoyun
    Pei, Lili
    Li, Wei
    Hu, Yuanjiao
    AL-Soswa, Mohammed
    AUTOMATION IN CONSTRUCTION, 2023, 151
  • [8] Dual-Modal Photoelectrochemical and Visualized Detection of Copper Ions
    Zhang, Nan
    Dai, Danqin
    Hu, Peiwen
    Guo, Shuangming
    Yang, Hong
    ACS OMEGA, 2022, 7 (06): : 5415 - 5420
  • [9] RGBT dual-modal Siamese tracking network with feature fusion
    Shen Y.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2021, 50 (03):
  • [10] Dual-modal nanoplatform integrated with smartphone for hierarchical diabetic detection
    Huang, Lin
    Zhou, Yan
    Zhu, Yuexing
    Su, Haiyang
    Yang, Shouzhi
    Feng, Lei
    Zhao, Liang
    Liu, Shanrong
    Qian, Kun
    BIOSENSORS & BIOELECTRONICS, 2022, 210