CareSleepNet: A Hybrid Deep Learning Network for Automatic Sleep Staging

被引:0
|
作者
Wang J. [1 ]
Zhao S. [1 ]
Jiang H. [1 ]
Zhou Y. [1 ]
Yu Z. [2 ]
Li T. [1 ]
Li S. [1 ]
Pan G. [1 ]
机构
[1] State Key Laboratory of Brain-machine Intelligence, Zhejiang University, Hangzhou, Zhejiang
[2] s Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang
基金
中国国家自然科学基金;
关键词
Brain modeling; Context modeling; cross-modality; deep learning; Deep learning; Electroencephalography; Electrooculography; PSG recordings; Sleep; Sleep staging; Transformers;
D O I
10.1109/JBHI.2024.3426939
中图分类号
学科分类号
摘要
Sleep staging is essential for sleep assessment and plays an important role in disease diagnosis, which refers to the classification of sleep epochs into different sleep stages. Polysomnography (PSG), consisting of many different physiological signals, e.g. electroencephalogram (EEG) and electrooculogram (EOG), is a gold standard for sleep staging. Although existing studies have achieved high performance on automatic sleep staging from PSG, there are still some limitations: 1) they focus on local features but ignore global features within each sleep epoch, and 2) they ignore cross-modality context relationship between EEG and EOG. In this paper, we propose CareSleepNet, a novel hybrid deep learning network for automatic sleep staging from PSG recordings. Specifically, we first design a multi-scale Convolutional-Transformer Epoch Encoder to encode both local salient wave features and global features within each sleep epoch. Then, we devise a Cross-Modality Context Encoder based on co-attention mechanism to model cross-modality context relationship between different modalities. Next, we use a Transformer-based Sequence Encoder to capture the sequential relationship among sleep epochs. Finally, the learned feature representations are fed into an epoch-level classifier to determine the sleep stages. We collected a private sleep dataset, SSND, and use two public datasets, Sleep-EDF-153 and ISRUC to evaluate the performance of CareSleepNet. The experiment results show that our CareSleepNet achieves the state-of-the-art performance on the three datasets. Moreover, we conduct ablation studies and attention visualizations to prove the effectiveness of each module and to analyze the influence of each modality. IEEE
引用
收藏
页码:1 / 14
页数:13
相关论文
共 50 条
  • [1] Deep Learning in Automatic Sleep Staging With a Single Channel Electroencephalography
    Fu, Mingyu
    Wang, Yitian
    Chen, Zixin
    Li, Jin
    Xu, Fengguo
    Liu, Xinyu
    Hou, Fengzhen
    FRONTIERS IN PHYSIOLOGY, 2021, 12
  • [2] Deep Learning Automatic Sleep Staging Method Based on Multidimensional Sleep Data
    Yang, Jian
    Meng, Yao
    Cheng, Qian
    Li, Huafei
    Cai, Wenpeng
    Wang, Tengjiao
    IEEE Access, 2024, 12 : 168360 - 168369
  • [3] Hybrid manifold-deep convolutional neural network for sleep staging
    Zhang, Chuanhao
    Liu, Sen
    Han, Fang
    Nie, Zedong
    Lo, Benny
    Zhang, Yuan
    METHODS, 2022, 202 : 164 - 172
  • [4] MHFNet: A Multimodal Hybrid-embedding Fusion Network for Automatic Sleep Staging
    Liu, Ruhan
    Li, Jiajia
    Wen, Yang
    Huang, Xian
    Sheng, Bin
    Feng, David Dagan
    Zhang, Ping
    IEEE Journal of Biomedical and Health Informatics,
  • [5] Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
    Phan, Huy
    Chen, Oliver Y.
    Koch, Philipp
    Lu, Zongqing
    McLoughlin, Ian
    Mertins, Alfred
    De Vos, Maarten
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2021, 68 (06) : 1787 - 1798
  • [6] Adaptive Hybrid System for Automatic Sleep Staging
    Hassaan, Amr A.
    Morsy, Ahmed A.
    2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vols 1-8, 2008, : 1631 - 1634
  • [7] Embedded Deep Learning for Sleep Staging
    Turetken, Engin
    Van Zaen, Jerome
    Delgado-Gonzalo, Ricard
    2019 6TH SWISS CONFERENCE ON DATA SCIENCE (SDS), 2019, : 95 - 96
  • [8] Automatic Sleep Staging Based on Deep Neural Network Using Single Channel EEG
    Huang, Yongfeng
    Zhang, Yujuan
    Yan, Cairong
    KNOWLEDGE MANAGEMENT IN ORGANIZATIONS, KMO 2019, 2019, 1027 : 63 - 73
  • [9] ESSN: An Efficient Sleep Sequence Network for Automatic Sleep Staging
    Chen, Yongliang
    Lv, Yudan
    Sun, Xinyu
    Poluektov, Mikhail
    Zhang, Yuan
    Penzel, Thomas
    IEEE Journal of Biomedical and Health Informatics, 2024, 28 (12) : 7447 - 7456
  • [10] Deep Transfer Learning for Single-Channel Automatic Sleep Staging with Channel Mismatch
    Huy Phan
    Chen, Oliver Y.
    Koch, Philipp
    Mertins, Alfred
    De Vos, Maarten
    2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,