Hyperbolic graph convolutional neural network with contrastive learning for automated ICD coding

被引:0
|
作者
Wu, Yuzhou [1 ,2 ]
Chen, Xuechen [1 ]
Yao, Xin [1 ]
Yu, Yongang [1 ]
Chen, Zhigang [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410012, Peoples R China
[2] China Mobile Chengdu Ind Res Inst, Chengdu 610041, Peoples R China
关键词
International classification of diseases; Automatic ICD coding; Code hierarchy; Contrastive learning; Imbalanced label distribution;
D O I
10.1016/j.compbiomed.2023.107797
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The International Classification of Diseases (ICD) is a widely used criterion for disease classification, health monitoring, and medical data analysis. Deep learning-based automated ICD coding has gained attention due to the time-consuming and costly nature of manual coding. The main challenges of automated ICD coding include imbalanced label distribution, code hierarchy and noisy texts. Recent works have considered using code hierarchy or description for better label representation to solve the problem of imbalanced label distribution. However, these methods are still ineffective and redundant since they only interact with a constant label representation. In this work, we introduce a novel Hyperbolic Graph Convolutional Network with Contrastive Learning (HGCN-CL) to solve the above problems and the shortcomings of the previous methods. We adopt a Hyperbolic graph convolutional network on ICD coding to capture the hierarchical structure of codes, which can solve the problem of large distortions when embedding hierarchical structure with graph convolutional network. Besides, we introduce contrastive learning for automatic ICD coding by injecting code features into text encoder to generate hierarchical-aware positive samples to solve the problem of interacting with constant code features. We conduct experiments on the public MIMIC-III and MIMIC-II datasets. The results on MIMIC III show that HGCN-CL outperforms previous state-of-art methods for automatic ICD coding, which achieves a 2.7% and 3.6% improvement respectively compared to previous best results (Hypercore). We also provide ablation experiments and hierarchy visualization to verify the effectiveness of components in our model.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Retrieve and rerank for automated ICD coding via Contrastive Learning
    Niu, Kunying
    Wu, Yifan
    Li, Yaohang
    Li, Min
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2023, 143
  • [2] Label Contrastive Coding Based Graph Neural Network for Graph Classification
    Ren, Yuxiang
    Bai, Jiyang
    Zhang, Jiawei
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 123 - 140
  • [3] DRCNNTLe: A deep recurrent convolutional neural network with transfer learning through pre-trained embeddings for automated ICD coding
    Bhutto, Sajida Raz
    Wu, Yifan
    Zeng, Min
    Dogar, Abdul Wahab
    Ullah, Kaleem
    Li, Min
    [J]. METHODS, 2022, 205 : 97 - 105
  • [4] A multi-view mask contrastive learning graph convolutional neural network for age estimation
    Zhang, Yiping
    Shou, Yuntao
    Meng, Tao
    Ai, Wei
    Li, Keqin
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2024, 66 (11) : 7137 - 7162
  • [5] GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training
    Qiu, Jiezhong
    Chen, Qibin
    Dong, Yuxiao
    Zhang, Jing
    Yang, Hongxia
    Ding, Ming
    Wang, Kuansan
    Tang, Jie
    [J]. KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 1150 - 1160
  • [6] Contrastive Graph Learning with Graph Convolutional Networks
    Nagendar, G.
    Sitaram, Ramachandrula
    [J]. DOCUMENT ANALYSIS SYSTEMS, DAS 2022, 2022, 13237 : 96 - 110
  • [7] Graph Contrastive Learning Automated
    You, Yuning
    Chen, Tianlong
    Shen, Yang
    Wang, Zhangyang
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [8] A Hyperbolic-to-Hyperbolic Graph Convolutional Network
    Dai, Jindou
    Wu, Yuwei
    Gao, Zhi
    Jia, Yunde
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 154 - 163
  • [9] A Neural Architecture for Automated ICD Coding
    Xie, Pengtao
    Shi, Haoran
    Zhang, Ming
    Xing, Eric P.
    [J]. PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 1066 - 1076
  • [10] Hyperbolic Graph Convolutional Neural Networks
    Chami, Ines
    Ying, Rex
    Re, Christopher
    Leskovec, Jure
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32