GraphSleepFormer: a multi-modal graph neural network for sleep staging in OSA patients

被引:0
|
作者
Wang, Chen [1 ]
Jiang, Xiuquan [1 ]
Lv, Chengyan [1 ]
Meng, Qi [1 ]
Zhao, Pengcheng [1 ]
Yan, Di [1 ]
Feng, Chao [1 ]
Xu, Fangzhou [1 ]
Lu, Shanshan [2 ,3 ]
Jung, Tzyy-Ping [4 ,5 ]
Leng, Jiancai [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Int Sch Optoelect Engn, 3501 Univ Rd, Jinan, Shandong, Peoples R China
[2] Shandong First Med Univ, Affiliated Hosp 1, Dept Neurol, Jinan, Peoples R China
[3] Shandong Prov Qianfoshan Hosp, Shandong Inst Neuroimmunol, Shandong Key Lab Rheumat Dis & Translat Med, Jinan, Peoples R China
[4] Univ Calif San Diego, Inst Neural Computat, San Diego, CA 92093 USA
[5] Univ Calif San Diego, Inst Engn Med, San Diego, CA 92093 USA
基金
中国国家自然科学基金;
关键词
polysomnography; sleep stage classification; graph convolutional network; obstructive sleep apnea; graphormer; K-FOLD; APNEA; CLASSIFICATION; MODEL; RNN;
D O I
10.1088/1741-2552/adb996
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Obstructive sleep apnea (OSA) is a prevalent sleep disorder. Accurate sleep staging is one of the prerequisites in the study of sleep-related disorders and the evaluation of sleep quality. We introduce a novel GraphSleepFormer (GSF) network designed to effectively capture global dependencies and node characteristics in graph-structured data. Approach. The network incorporates centrality coding and spatial coding into its architecture. It employs adaptive learning of adjacency matrices for spatial encoding between channels located on the head, thereby encoding graph structure information to enhance the model's representation and understanding of spatial relationships. Centrality encoding integrates the degree matrix into node features, assigning varying degrees of attention to different channels. Ablation experiments demonstrate the effectiveness of these encoding methods. The Shapley Additive Explanations (SHAP) method was employed to evaluate the contribution of each channel in sleep staging, highlighting the necessity of using multimodal data. Main results. We trained our model on overnight polysomnography data collected from 28 OSA patients in a clinical setting and achieved an overall accuracy of 80.10%. GSF achieved performance comparable to state-of-the-art methods on two subsets of the ISRUC database. Significance. The GSF Accurately identifies sleep periods, providing a critical basis for diagnosing and treating OSA, thereby contributing to advancements in sleep medicine.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Corporate Relative Valuation Using Heterogeneous Multi-Modal Graph Neural Network
    Yang, Yang
    Yang, Jia-Qi
    Bao, Ran
    Zhan, De-Chuan
    Zhu, Hengshu
    Gao, Xiao-Ru
    Xiong, Hui
    Yang, Jian
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 211 - 224
  • [2] Multi-modal Contextual Graph Neural Network for Text Visual Question Answering
    Liang, Yaoyuan
    Wang, Xin
    Duan, Xuguang
    Zhu, Wenwu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3491 - 3498
  • [3] Multi-modal Graph Convolutional Network for Knowledge Graph Entity Alignment
    You, Yinghui
    Wei, Yuyang
    Zhang, Yanlong
    Chen, Wei
    Zhao, Lei
    WEB AND BIG DATA, PT I, APWEB-WAIM 2023, 2024, 14331 : 142 - 157
  • [4] Multi-modal Recurrent Graph Neural Networks for Spatiotemporal Forecasting
    Majeske, Nicholas
    Azad, Ariful
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT II, PAKDD 2024, 2024, 14646 : 144 - 157
  • [5] Multi-modal graph contrastive encoding for neural machine translation
    Yin, Yongjing
    Zeng, Jiali
    Su, Jinsong
    Zhou, Chulun
    Meng, Fandong
    Zhou, Jie
    Huang, Degen
    Luo, Jiebo
    ARTIFICIAL INTELLIGENCE, 2023, 323
  • [6] Adversarial Graph Attention Network for Multi-modal Cross-modal Retrieval
    Wu, Hongchang
    Guan, Ziyu
    Zhi, Tao
    zhao, Wei
    Xu, Cai
    Han, Hong
    Yang, Yarning
    2019 10TH IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (ICBK 2019), 2019, : 265 - 272
  • [7] Object Interaction Recommendation with Multi-Modal Attention-based Hierarchical Graph Neural Network
    Zhang, Huijuan
    Liang, Lipeng
    Wang, Dongqing
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 295 - 305
  • [8] A generic neural network for multi-modal sensorimotor learning
    Carenzi, F
    Bendahan, P
    Roschin, VY
    Frolov, AA
    Gorce, P
    Maier, MA
    COMPUTATIONAL NEUROSCIENCE: TRENDS IN RESEARCH 2004, 2004, : 525 - 533
  • [9] A Multi-modal Graph Neural Network Approach to Traffic Risk Forecasting in Smart Urban Sensing
    Zhang, Yang
    Dong, Xiangyu
    Shang, Lanyu
    Zhang, Daniel
    Wang, Dong
    2020 17TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2020,
  • [10] A generic neural network for multi-modal sensorimotor learning
    Carenzi, F
    Bendahan, P
    Roschin, VY
    Frolov, AA
    Gorce, P
    Maier, MA
    NEUROCOMPUTING, 2004, 58 : 525 - 533