RDKG: A Reinforcement Learning Framework for Disease Diagnosis on Knowledge Graph

被引:1
|
作者
Guo, Shipeng [1 ,2 ]
Liu, Kunpeng [3 ]
Wang, Pengfei [1 ,2 ]
Dai, Weiwei [4 ]
Du, Yi [1 ,2 ]
Zhou, Yuanchun [1 ,2 ]
Cui, Wenjuan [1 ,2 ]
机构
[1] Chinese Acad Sci, Comp Network Informat Ctr, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Portland State Univ, Portland, OR USA
[4] Changsha Amer Eye Hosp, Changsha, Peoples R China
基金
北京市自然科学基金;
关键词
Electronic Medical Records; medical knowledge graph; reinforcement learning; automatic disease diagnosis;
D O I
10.1109/ICDM58522.2023.00122
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic disease diagnosis from symptoms has attracted much attention in medical practices. It can assist doctors and medical practitioners in narrowing down disease candidates, reducing testing costs, improving diagnosis efficiency, and more importantly, saving human lives. Existing research has made significant progress in diagnosing disease but was limited by the gap between interpretability and accuracy. To fill this gap, in this paper, we propose a method called Reinforced Disease Diagnosis on Knowlege Graph (RDKG). Specifically, we first construct a knowledge graph containing all information from electronic medical records. To capture informative embeddings, we propose an enhanced knowledge graph embedding method that can embed information outside the knowledge graph into entity embedding. Then we transform the automatic disease diagnosis task into a Markov decision process on the knowledge graph. After that, we design a reinforcement learning method with a soft reward mechanism and a pruning strategy to solve the Markov decision process. We accomplish automated disease diagnosis by finding a path from symptoms to disease. The experimental results show that our model can effectively utilize heterogeneous information in the knowledge graph to complete the automatic disease diagnosis. Besides, our model demonstrates supreme performance in both accuracy and interpretability.
引用
收藏
页码:1049 / 1054
页数:6
相关论文
共 50 条
  • [1] DKDR: An Approach of Knowledge Graph and Deep Reinforcement Learning for Disease Diagnosis
    Jia, Yuanyuan
    Tan, Zhiren
    Zhang, Junxing
    [J]. 2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1303 - 1308
  • [2] MemoryPath: A deep reinforcement learning framework for incorporating memory component into knowledge graph reasoning
    Li, Shuangyin
    Wang, Heng
    Pan, Rong
    Mao, Mingzhi
    [J]. NEUROCOMPUTING, 2021, 419 : 273 - 286
  • [3] ADRL: An attention-based deep reinforcement learning framework for knowledge graph reasoning
    Wang, Qi
    Hao, Yongsheng
    Cao, Jie
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 197
  • [4] Causal Reinforcement Learning for Knowledge Graph Reasoning
    Li, Dezhi
    Lu, Yunjun
    Wu, Jianping
    Zhou, Wenlu
    Zeng, Guangjun
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (06):
  • [5] Survey of Knowledge Graph Based on Reinforcement Learning
    Ma, Ang
    Yu, Yanhua
    Yang, Shengli
    Shi, Chuan
    Li, Jie
    Cai, Xiuxiu
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2022, 59 (08): : 1694 - 1722
  • [6] Step by step: A hierarchical framework for multi-hop knowledge graph reasoning with reinforcement learning
    Zhu, Anjie
    Ouyang, Deqiang
    Liang, Shuang
    Shao, Jie
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 248
  • [7] Diagnosis Method of Thyroid Disease Combining Knowledge Graph and Deep Learning
    Chai, Xuqing
    [J]. IEEE ACCESS, 2020, 8 : 149787 - 149795
  • [8] TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecasting
    Sun, Haohai
    Zhong, Jialun
    Ma, Yunpu
    Han, Zhen
    He, Kun
    [J]. 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 8306 - 8319
  • [9] Disease Diagnosis of Dairy Cow by Deep Learning Based on Knowledge Graph and Transfer Learning
    Gao, Meng
    Wang, Haodong
    Shen, Weizheng
    Su, Zhongbin
    Liu, Huihuan
    Yin, Yanling
    Zhang, Yonggen
    Zhang, Yi
    [J]. International Journal Bioautomation, 2021, 25 (01) : 87 - 100
  • [10] Knowledgebra: An Algebraic Learning Framework for Knowledge Graph
    Yang, Tong
    Wang, Yifei
    Sha, Long
    Engelbrecht, Jan
    Hong, Pengyu
    [J]. MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2022, 4 (02): : 432 - 445