Hyperbolic graph convolutional neural network with contrastive learning for automated ICD coding

被引:0
|
作者
Wu, Yuzhou [1 ,2 ]
Chen, Xuechen [1 ]
Yao, Xin [1 ]
Yu, Yongang [1 ]
Chen, Zhigang [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410012, Peoples R China
[2] China Mobile Chengdu Ind Res Inst, Chengdu 610041, Peoples R China
关键词
International classification of diseases; Automatic ICD coding; Code hierarchy; Contrastive learning; Imbalanced label distribution;
D O I
10.1016/j.compbiomed.2023.107797
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The International Classification of Diseases (ICD) is a widely used criterion for disease classification, health monitoring, and medical data analysis. Deep learning-based automated ICD coding has gained attention due to the time-consuming and costly nature of manual coding. The main challenges of automated ICD coding include imbalanced label distribution, code hierarchy and noisy texts. Recent works have considered using code hierarchy or description for better label representation to solve the problem of imbalanced label distribution. However, these methods are still ineffective and redundant since they only interact with a constant label representation. In this work, we introduce a novel Hyperbolic Graph Convolutional Network with Contrastive Learning (HGCN-CL) to solve the above problems and the shortcomings of the previous methods. We adopt a Hyperbolic graph convolutional network on ICD coding to capture the hierarchical structure of codes, which can solve the problem of large distortions when embedding hierarchical structure with graph convolutional network. Besides, we introduce contrastive learning for automatic ICD coding by injecting code features into text encoder to generate hierarchical-aware positive samples to solve the problem of interacting with constant code features. We conduct experiments on the public MIMIC-III and MIMIC-II datasets. The results on MIMIC III show that HGCN-CL outperforms previous state-of-art methods for automatic ICD coding, which achieves a 2.7% and 3.6% improvement respectively compared to previous best results (Hypercore). We also provide ablation experiments and hierarchy visualization to verify the effectiveness of components in our model.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A Computational Framework for Predicting Novel Drug Indications Using Graph Convolutional Network With Contrastive Learning
    Luo, Yuxun
    Shan, Wenyu
    Peng, Li
    Luo, Lingyun
    Ding, Pingjian
    Liang, Wei
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (08) : 4503 - 4511
  • [42] A Survey on Graph Convolutional Neural Network
    Xu, Bing-Bing
    Cen, Ke-Ting
    Huang, Jun-Jie
    Shen, Hua-Wei
    Cheng, Xue-Qi
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2020, 43 (05): : 755 - 780
  • [43] Dual Contrastive Learning Network for Graph Clustering
    Peng, Xin
    Cheng, Jieren
    Tang, Xiangyan
    Liu, Jingxin
    Wu, Jiahua
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 10846 - 10856
  • [44] Graph Contrastive Learning with Generative Adversarial Network
    Wu, Cheng
    Wang, Chaokun
    Xu, Jingcao
    Liu, Ziyang
    Zheng, Kai
    Wang, Xiaowei
    Song, Yang
    Gai, Kun
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2721 - 2730
  • [45] Knowledge graph completion method based on hyperbolic representation learning and contrastive learning
    Zhang, Xiaodong
    Wang, Meng
    Zhong, Xiuwen
    An, Feixu
    [J]. EGYPTIAN INFORMATICS JOURNAL, 2023, 24 (04)
  • [46] GraphCDR: a graph neural network method with contrastive learning for cancer drug response prediction
    Liu, Xuan
    Song, Congzhi
    Huang, Feng
    Fu, Haitao
    Xiao, Wenjie
    Zhang, Wen
    [J]. BRIEFINGS IN BIOINFORMATICS, 2022, 23 (01)
  • [47] Motif-Aware Riemannian Graph Neural Network with Generative-Contrastive Learning
    Sun, Li
    Huang, Zhenhao
    Wang, Zixi
    Wang, Feiyang
    Peng, Hao
    Yu, Philip
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 9044 - 9052
  • [48] ICD Coding from Clinical Text Using Multi-Filter Residual Convolutional Neural Network
    Li, Fei
    Yu, Hong
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 8180 - 8187
  • [49] Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning
    Wang, Xiao
    Liu, Nian
    Han, Hui
    Shi, Chuan
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1726 - 1736
  • [50] Convolutional Neural Network Outperforms Graph Neural Network on the Spatially Variant Graph Data
    Boronina, Anna
    Maksimenko, Vladimir
    Hramov, Alexander E. E.
    [J]. MATHEMATICS, 2023, 11 (11)