Interpretable disease prediction using heterogeneous patient records with self-attentive fusion encoder

被引:3
|
作者
Kwak, Heeyoung [1 ]
Chang, Jooyoung [2 ]
Choe, Byeongjin [1 ]
Park, Sangmin [2 ,3 ]
Jung, Kyomin [1 ]
机构
[1] Seoul Natl Univ, Dept Elect Engn, 1 Gwanak Ro, Seoul 08826, South Korea
[2] Seoul Natl Univ, Dept Biomed Sci, Seoul, South Korea
[3] Seoul Natl Univ Hosp, Dept Family Med, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
disease prediction; cardiovascular disease; deep learning; recurrent neural network; attention;
D O I
10.1093/jamia/ocab109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective: We propose an interpretable disease prediction model that efficiently fuses multiple types of patient records using a self-attentive fusion encoder. We assessed the model performance in predicting cardiovascular disease events, given the records of a general patient population. Materials and Methods: We extracted 7981 1 1 ses and 67 623 controls from the sample cohort database and nationwide healthcare claims data of South Korea. Among the information provided, our model used the sequential records of medical codes and patient characteristics, such as demographic profiles and the most recent health examination results. These two types of patient records were combined in our self-attentive fusion module, whereas previously dominant methods aggregated them using a simple concatenation. The prediction performance was compared to state-of-the-art recurrent neural network-based approaches and other widely used machine learning approaches. Results: Our model outperformed all the other compared methods in predicting cardiovascular disease events. It achieved an area under the curve of 0.839, while the other compared methods achieved between 0.74111 d 0.830. Moreover, our model consistently outperformed the other methods in a more challenging setting in which we tested the model's ability to draw an inference from more nonobvious, diverse factors. Discussion: We also interpreted the attention weights provided by our model as the relative importance of each time step in the sequence. We showed that our model reveals the informative parts of the patients' history by measuring the attention weights. Conclusion: We suggest an interpretable disease prediction model that efficiently fuses heterogeneous patient records and demonstrates superior disease prediction performance.
引用
收藏
页码:2155 / 2164
页数:10
相关论文
共 50 条
  • [1] Constituency Parsing with a Self-Attentive Encoder
    Kitaev, Nikita
    Klein, Dan
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 2676 - 2686
  • [2] Self-attentive Rationalization for Interpretable Graph Contrastive Learning
    Li, Sihang
    Luo, Yanchen
    Zhang, An
    Wang, Xiang
    Li, Longfei
    Zhou, Jun
    Chua, Tat-seng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2025, 19 (02)
  • [3] Gated Self-attentive Encoder for Neural Machine Translation
    Wei, Xiangpeng
    Hu, Yue
    Xing, Luxi
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2019, PT I, 2019, 11775 : 655 - 666
  • [4] Self-Attentive Moving Average for Time Series Prediction
    Su, Yaxi
    Cui, Chaoran
    Qu, Hao
    APPLIED SCIENCES-BASEL, 2022, 12 (07):
  • [5] Explicit Sparse Self-Attentive Network for CTR Prediction
    Luo, Yu
    Peng, Wanwan
    Fan, Youping
    Pang, Hong
    Xu, Xiang
    Wu, Xiaohua
    PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE OF INFORMATION AND COMMUNICATION TECHNOLOGY, 2021, 183 : 690 - 695
  • [6] BRec the Bank: Context-aware Self-attentive Encoder for Banking Products Recommendation
    Liu, Davide
    Farajalla, George Philippe
    Boulenger, Alexandre
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] SAEA: Self-Attentive Heterogeneous Sequence Learning Model for Entity Alignment
    Chen, Jia
    Gu, Binbin
    Li, Zhixu
    Zhao, Pengpeng
    Liu, An
    Zhao, Lei
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT I, 2020, 12112 : 452 - 467
  • [8] Self-Attentive Feature-level Fusion for Multimodal Emotion Detection
    Hazarika, Devamanyu
    Gorantla, Sruthi
    Poria, Soujanya
    Zimmermann, Roger
    IEEE 1ST CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2018), 2018, : 196 - 201
  • [9] Goal-driven Self-Attentive Recurrent Networks for Trajectory Prediction
    Chiara, Luigi Filippo
    Coscia, Pasquale
    Das, Sourav
    Calderara, Simone
    Cucchiara, Rita
    Ballan, Lamberto
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 2517 - 2526
  • [10] Non-local Self-attentive Autoencoder for Genetic Functionality Prediction
    Li, Yun
    Liu, Zhe
    Yao, Lina
    He, Zihuai
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2117 - 2120