A deep learning model for generating fundus autofluorescence images from color fundus photography

被引:3
|
作者
Song, Fan [1 ,2 ]
Zhang, Weiyi [1 ,2 ]
Zheng, Yingfeng [3 ]
Shi, Danli [1 ,2 ]
He, Mingguang [1 ,2 ]
机构
[1] Hong Kong Polytech Univ, Sch Optometry, Expt Ophthalmol, Hong Kong, Peoples R China
[2] Hong Kong Polytech Univ, Res Ctr SHARP Vision, Hong Kong, Peoples R China
[3] Sun Yat Sen Univ, Zhongshan Ophthalm Ctr, Guangdong Prov Clin Res Ctr Ocular Dis, State Key Lab Ophthalmol,Guangdong Prov Key Lab Op, Guangzhou, Peoples R China
来源
关键词
Generative adversarial networks; Color fundus to fundus autofluorescence; generation; Age-related macular degeneration; Deep learning; GEOGRAPHIC ATROPHY; CLASSIFICATION; PATTERNS;
D O I
10.1016/j.aopr.2023.11.001
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Background: Fundus Autofluorescence (FAF) is a valuable imaging technique used to assess metabolic alterations in the retinal pigment epithelium (RPE) associated with various age-related and disease-related changes. The practical uses of FAF are ever-growing. This study aimed to evaluate the effectiveness of a generative deep learning (DL) model in translating color fundus (CF) images into synthetic FAF images and explore its potential for enhancing screening of age-related macular degeneration (AMD). Methods: A generative adversarial network (GAN) model was trained on pairs of CF and FAF images to generate synthetic FAF images. The quality of synthesized FAF images was assessed objectively by common generation metrics. Additionally, the clinical effectiveness of the generated FAF images in AMD classification was evaluated by measuring the area under the curve (AUC), using the LabelMe dataset. Results: A total of 8410 FAF images from 2586 patients were analyzed. The synthesized FAF images exhibited an impressive objectively assessed quality, achieving a multi-scale structural similarity index (MS-SSIM) of 0.67. When evaluated on the LabelMe dataset, the combination of generated FAF images and CF images resulted in a noteworthy improvement in AMD classification accuracy, with the AUC increasing from 0.931 to 0.968. Conclusions: This study presents the first attempt to use a generative deep learning model to create authentic and high-quality FAF images from CF images. The incorporation of the translated FAF images on top of CF images improved the accuracy of AMD classification. Overall, this study presents a promising approach to enhance largescale AMD screening.
引用
收藏
页码:192 / 198
页数:7
相关论文
共 50 条
  • [1] Deep Learning Automated Detection of Reticular Pseudodrusen from Fundus Autofluorescence Images or Color Fundus Photographs in AREDS2
    Keenan, Tiarnan D. L.
    Chen, Qingyu
    Peng, Yifan
    Domalpally, Amitha
    Agron, Elvira
    Hwang, Christopher K.
    Thavikulwat, Alisa T.
    Lee, Debora H.
    Li, Daniel
    Wong, Wai T.
    Lu, Zhiyong
    Chew, Emily Y.
    [J]. OPHTHALMOLOGY, 2020, 127 (12) : 1674 - 1687
  • [2] Deep learning based GA segmentation in fundus autofluorescence images
    Manivannan, Niranchana
    Makedonsky, Katherine
    Lyu, Cancan
    Gregori, Giovanni
    Rosenfeld, Philip J.
    Durbin, Mary K.
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2019, 60 (09)
  • [3] Prediction of Causative Genes in Inherited Retinal Disorders from Fundus photography and Fundus Autofluorescence Imaging Utilising Deep Learning Techniques
    Fujinami-Yokokawa, Yu
    Ninomiya, Hideki
    Liu, Xiao
    Yang, Lizhu
    Pontikos, Nikolas
    Yoshitake, Kazutoshi
    Iwata, Takeshi
    Sato, Yasunori
    Hashimoto, Takeshi
    Miyata, Hiroaki
    Fujinami, Kaoru
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2021, 62 (08)
  • [4] Discriminating Healthy Optic Discs and Visible Optic Disc Drusen on Fundus Autofluorescence and Color Fundus Photography Using Deep Learning-A Pilot Study
    Diener, Raphael
    Lauermann, Jost Lennart
    Eter, Nicole
    Treder, Maximilian
    [J]. JOURNAL OF CLINICAL MEDICINE, 2023, 12 (05)
  • [5] Learning Deep Similarity in Fundus Photography
    Chudzik, Piotr
    Al-Diri, Bashir
    Caliva, Francesco
    Ometto, Giovanni
    Hunter, Andrew
    [J]. MEDICAL IMAGING 2017: IMAGE PROCESSING, 2017, 10133
  • [6] An evaluation of fundus photography and fundus autofluorescence in the diagnosis of cuticular drusen
    Hoeg, Tracy B.
    Moldow, Birgitte
    Klein, Ronald
    La Cour, Morten
    Klemp, Kristian
    Erngaard, Ditte
    Ellervik, Christina
    Buch, Helena
    [J]. BRITISH JOURNAL OF OPHTHALMOLOGY, 2016, 100 (03) : 378 - 382
  • [7] COMPARISON OF COLOR FUNDUS PHOTOGRAPHS AND FUNDUS AUTOFLUORESCENCE IMAGES IN MEASURING GEOGRAPHIC ATROPHY AREA
    Khanifar, Aziz A.
    Lederer, David E.
    Ghodasra, Jason H.
    Stinnett, Sandra S.
    Lee, Jane J.
    Cousins, Scott W.
    Bearelly, Srilaxmi
    [J]. RETINA-THE JOURNAL OF RETINAL AND VITREOUS DISEASES, 2012, 32 (09): : 1884 - 1891
  • [8] Fundus autofluorescence measurement with digital fundus camera photography.
    Bloom, AH
    Spaide, RF
    Riff, M
    Hassan, L
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2001, 42 (04) : S704 - S704
  • [9] Deep learning to predict future region of growth of geographic atrophy from fundus autofluorescence images
    Anegondi, Neha
    Salvi, Anish
    Cluceru, Julia
    Yang, Qi
    Ferrara, Daniela
    Rabe, Christina
    Gao, Simon S.
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2023, 64 (08)
  • [10] Refined image quality assessment for color fundus photography based on deep learning
    Guo, Tianjiao
    Liu, Kun
    Zou, Haidong
    Xu, Xun
    Yang, Jie
    Yu, Qi
    [J]. DIGITAL HEALTH, 2024, 10