Multi-disease Detection in Retinal Images Guided by Disease Causal Estimation

被引:0
|
作者
Xie, Jianyang [1 ]
Chen, Xiuju [2 ]
Zhao, Yitian [3 ]
Meng, Yanda [5 ]
Zhao, He [1 ]
Anh Nguyen [4 ]
Li, Xiaoxin [2 ]
Zheng, Yalin [1 ]
机构
[1] Univ Liverpool, Eye & Vis Sci Dept, Liverpool, Merseyside, England
[2] Xiamen Univ, Xiamen Eye Ctr, Xiamen, Peoples R China
[3] Chinese Acad Sci, Ningbo Inst Mat Technol & Engn, Ningbo, Peoples R China
[4] Univ Liverpool, Comp Sci Dept, Liverpool, Merseyside, England
[5] Univ Exeter, Comp Sci Dept, Exeter, Devon, England
来源
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT I | 2024年 / 15001卷
关键词
Retinal image; Multi-disease detection; Disease causal estimation; Disease-specific features; Disease-feature interaction;
D O I
10.1007/978-3-031-72378-0_69
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There have been significant advancements in analyzing retinal images for the diagnosis of eye diseases and other systemic conditions. However, a key challenge is multi-disease detection, particularly in addressing the demands of real-world applications where a patient may have more than one condition. To address this challenge, this study introduces a novel end-to-end approach to multi-disease detection using retinal images guided by disease causal estimation. This model leverages disease-specific features, integrating disease causal relationships and interactions between image features and disease conditions. Specifically, 1) the interactions between disease and image features are captured by cross-attention in a transformer decoder. 2) The causal relationships among diseases are automatically estimated as the directed acyclic graph (DAG) based on the dataset itself and are utilized to regularize disease-specific feature learning with disease causal interaction. 3) A novel retinal multi-disease dataset of 500 patients, including six lesion labels, was generated for evaluation purposes. Compared with other methods, the proposed approach not only achieves multi-disease diagnosis with high performance but also provides a method to estimate the causal relationships among diseases. We evaluated our method on two retinal datasets: a public colour fundus photography and an in-house fundus fluorescein angiography (FFA). The results show that the proposed method outperforms other state-of-the-art multi-label models. Our FFA database and code have been released (https://github.com/davelailai/multi-disease-detection-guided-by-causal-estimation.git).
引用
收藏
页码:743 / 753
页数:11
相关论文
共 50 条
  • [1] Retinal Fundus Multi-Disease Image Dataset (RFMiD): A Dataset for Multi-Disease Detection Research
    Pachade, Samiksha
    Porwal, Prasanna
    Thulkar, Dhanshree
    Kokare, Manesh
    Deshmukh, Girish
    Sahasrabuddhe, Vivek
    Giancardo, Luca
    Quellec, Gwenole
    Meriaudeau, Fabrice
    DATA, 2021, 6 (02) : 1 - 14
  • [2] RFMiD: Retinal Image Analysis for multi-Disease Detection challenge
    Pachade, Samiksha
    Porwal, Prasanna
    Kokare, Manesh
    Deshmukh, Girish
    Sahasrabuddhe, Vivek
    Luo, Zhengbo
    Han, Feng
    Sun, Zitang
    Li, Qihan
    Kamata, Sei-ichiro
    Ho, Edward
    Wang, Edward
    Sivajohan, Asaanth
    Youn, Saerom
    Lane, Kevin
    Chun, Jin
    Wang, Xinliang
    Gu, Yunchao
    Lu, Sixu
    Oh, Young-tack
    Park, Hyunjin
    Lee, Chia-Yen
    Yeh, Hung
    Cheng, Kai-Wen
    Wang, Haoyu
    Ye, Jin
    He, Junjun
    Gu, Lixu
    Mueller, Dominik
    Soto-Rey, Inaki
    Kramer, Frank
    Arai, Hidehisa
    Ochi, Yuma
    Okada, Takami
    Giancardo, Luca
    Quellec, Gwenole
    Meriaudeau, Fabrice
    MEDICAL IMAGE ANALYSIS, 2025, 99
  • [3] Unraveling the complexity: deep learning for imbalanced retinal lesion detection and multi-disease identification
    Alfonso-Francia, Gendry
    Pedraza-Ortega, Jesus Carlos
    Toledano-Ayala, Manuel
    Aceves-Fernandez, Marco Antonio
    Ko, Seok-Bum
    Tovar-Arriaga, Saul
    NETWORK MODELING AND ANALYSIS IN HEALTH INFORMATICS AND BIOINFORMATICS, 2023, 13 (01):
  • [4] Automatic multi-disease classification on retinal images using multilevel glowworm swarm convolutional neural network
    Chavan R.
    Pete D.
    Journal of Engineering and Applied Science, 2024, 71 (01):
  • [5] Multi-disease detection system with X-ray images using deep learning techniques
    Basha, M. Suleman
    Prasad, K. Rajendra
    Mouleeswaran, S. K.
    Poonia, Ramesh Chandra
    Sebastian, Shiju
    JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2024, 45 (05): : 1379 - 1388
  • [6] Integrating Heterogeneous Data for a Multi-disease Outbreak Detection Framework
    Villanueva-Miranda, Ismael
    Akbar, Monika
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 2828 - 2837
  • [7] Segment Anything Model and Fully Convolutional Data Description for Plant Multi-Disease Detection on Field Images
    Moupojou, Emmanuel
    Retraint, Florent
    Tapamo, Hyppolite
    Nkenlifack, Marcellin
    Kacfah, Cheikh
    Tagne, Appolinaire
    IEEE ACCESS, 2024, 12 : 102592 - 102605
  • [8] Dynamic wave tunnel lining GPR images multi-disease detection method based on deep learning
    Zhao, Liang
    Xu, Qiuhao
    Song, Zhanping
    Meng, Shuaiqi
    Liu, Shipeng
    NDT and E International, 2024, 144
  • [9] Dynamic wave tunnel lining GPR images multi-disease detection method based on deep learning
    Zhao, Liang
    Xu, Qiuhao
    Song, Zhanping
    Meng, Shuaiqi
    Liu, Shipeng
    NDT & E INTERNATIONAL, 2024, 144
  • [10] Multi-Disease Deep Brain Stimulation
    Parastarfeizabadi, Mahboubeh
    Sillitoe, Roy, V
    Kouzani, Abbas Z.
    IEEE ACCESS, 2020, 8 : 216933 - 216947