Joint conditional generative adversarial networks for eyelash artifact removal in ultra-wide-field fundus images

被引:2
|
作者
Zhang, Jiong [1 ,2 ]
Sha, Dengfeng [1 ,3 ]
Ma, Yuhui [1 ]
Zhang, Dan [4 ]
Tan, Tao [5 ]
Xu, Xiayu [6 ,7 ]
Yi, Quanyong [2 ]
Zhao, Yitian [1 ,2 ]
机构
[1] Chinese Acad Sci, Cixi Inst Biomed Engn, Ningbo Inst Mat Technol & Engn, Ningbo, Peoples R China
[2] Wenzhou Med Univ, Affiliated Ningbo Eye Hosp, Ningbo, Peoples R China
[3] Ningbo Univ, Fac Elect Engn & Comp Sci, Ningbo, Peoples R China
[4] Ningbo Univ Technol, Sch Cyber Sci & Engn, Ningbo, Peoples R China
[5] Macao Polytech Univ, Faulty Appl Sci, Macau, Peoples R China
[6] Xi An Jiao Tong Univ, Sch Life Sci & Technol, Key Lab Biomed Informat Engn Minist Educ, Xian, Peoples R China
[7] Xi An Jiao Tong Univ, Zhejiang Res Inst, Hangzhou, Peoples R China
关键词
retina; ultra-wide-field fundus images; artifact removal; conditional GAN; vessel segmentation; SHADOW REMOVAL; OPTOS OPTOMAP; SENSITIVITY;
D O I
10.3389/fcell.2023.1181305
中图分类号
Q2 [细胞生物学];
学科分类号
071009 ; 090102 ;
摘要
Background: Ultra-Wide-Field (UWF) fundus imaging is an essential diagnostic tool for identifying ophthalmologic diseases, as it captures detailed retinal structures within a wider field of view (FOV). However, the presence of eyelashes along the edge of the eyelids can cast shadows and obscure the view of fundus imaging, which hinders reliable interpretation and subsequent screening of fundus diseases. Despite its limitations, there are currently no effective methods or datasets available for removing eyelash artifacts from UWF fundus images. This research aims to develop an effective approach for eyelash artifact removal and thus improve the visual quality of UWF fundus images for accurate analysis and diagnosis.Methods: To address this issue, we first constructed two UWF fundus datasets: the paired synthetic eyelashes (PSE) dataset and the unpaired real eyelashes (uPRE) dataset. Then we proposed a deep learning architecture called Joint Conditional Generative Adversarial Networks (JcGAN) to remove eyelash artifacts from UWF fundus images. JcGAN employs a shared generator with two discriminators for joint learning of both real and synthetic eyelash artifacts. Furthermore, we designed a background refinement module that refines background information and is trained with the generator in an end-to-end manner.Results: Experimental results on both PSE and uPRE datasets demonstrate the superiority of the proposed JcGAN over several state-of-the-art deep learning approaches. Compared with the best existing method, JcGAN improves PSNR and SSIM by 4.82% and 0.23%, respectively. In addition, we also verified that eyelash artifact removal via JcGAN could significantly improve vessel segmentation performance in UWF fundus images. Assessment via vessel segmentation illustrates that the sensitivity, Dice coefficient and area under curve (AUC) of ResU-Net have respectively increased by 3.64%, 1.54%, and 1.43% after eyelash artifact removal using JcGAN.Conclusion: The proposed JcGAN effectively removes eyelash artifacts in UWF images, resulting in improved visibility of retinal vessels. Our method can facilitate better processing and analysis of retinal vessels and has the potential to improve diagnostic outcomes.
引用
收藏
页数:13
相关论文
共 50 条
  • [11] Ultra-Wide-Field Fundus Autofluorescence in Multiple Evanescent White Dot Syndrome
    Hashimoto, Hideaki
    Kishi, Shoji
    [J]. AMERICAN JOURNAL OF OPHTHALMOLOGY, 2015, 159 (04) : 698 - 706
  • [12] Efficacy of the newly invented Eyelid Clamper in ultra-wide-field fundus imaging
    Ozawa, Nobuhiro
    Mori, Kiwako
    Katada, Yusaku
    Tsubota, Kazuo
    Kurihara, Toshihide
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2019, 60 (09)
  • [13] Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks
    Li, Wanyue
    Kong, Wen
    Chen, Yiwei
    Wang, Jing
    He, Yi
    Shi, Guohua
    Deng, Guohua
    [J]. MEDICAL IMAGING WITH DEEP LEARNING, VOL 121, 2020, 121 : 424 - 439
  • [14] Deep learning system for screening AIDS-related cytomegalovirus retinitis with ultra-wide-field fundus images
    Du, Kuifang
    Dong, Li
    Zhang, Kai
    Guan, Meilin
    Chen, Chao
    Xie, Lianyong
    Kong, Wenjun
    Li, Heyan
    Zhang, Ruiheng
    Zhou, Wenda
    Wu, Haotian
    Dong, Hongwei
    Wei, Wenbin
    [J]. HELIYON, 2024, 10 (10)
  • [15] The application of ultra-wide-field fundus autofluorescence in early metastatic choroidal tumor screening
    Ye, Pan-Pan
    Xu, Jia
    Su, Zhi-Tao
    Fang, Xiao-Yun
    Yao, Ke
    [J]. INTERNATIONAL JOURNAL OF OPHTHALMOLOGY, 2019, 12 (12) : 1978 - 1981
  • [16] Source-free active domain adaptation for diabetic retinopathy grading based on ultra-wide-field fundus images
    Ran J.
    Zhang G.
    Xia F.
    Zhang X.
    Xie J.
    Zhang H.
    [J]. Computers in Biology and Medicine, 2024, 174
  • [17] Deep learning for identification of peripheral retinal degeneration using ultra-wide-field fundus images: is it sufficient for clinical translation?
    Tan, Tien-En
    Ting, Daniel Shu Wei
    Wong, Tien Yin
    Sim, Dawn A.
    [J]. ANNALS OF TRANSLATIONAL MEDICINE, 2020, 8 (10)
  • [18] ULTRA-WIDE-FIELD IMAGING AND INTRAVENOUS FUNDUS FLUORESCEIN ANGIOGRAPHY IN INFANTS WITH RETINOPATHY OF PREMATURITY
    Mao, Jianbo
    Shao, Yirun
    Lao, Jimeng
    Yu, Xueting
    Chen, Yiqi
    Zhang, Caiyun
    Li, Hanxiao
    Shen, Lijun
    [J]. RETINA-THE JOURNAL OF RETINAL AND VITREOUS DISEASES, 2020, 40 (12): : 2357 - 2365
  • [19] DeepUWF: An Automated Ultra-Wide-Field Fundus Screening System via Deep Learning
    Zhang, Wei
    Zhao, Xiujuan
    Chen, Yuanyuan
    Zhong, Jie
    Yi, Zhang
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (08) : 2988 - 2996
  • [20] The application of ultra-wide-field fundus autofluorescence in early metastatic choroidal tumor screening
    Pan-Pan Ye
    Jia Xu
    Zhi-Tao Su
    Xiao-Yun Fang
    Ke Yao
    [J]. International Journal of Ophthalmology, 2019, (12) : 1978 - 1981