Joint conditional generative adversarial networks for eyelash artifact removal in ultra-wide-field fundus images

被引:2
|
作者
Zhang, Jiong [1 ,2 ]
Sha, Dengfeng [1 ,3 ]
Ma, Yuhui [1 ]
Zhang, Dan [4 ]
Tan, Tao [5 ]
Xu, Xiayu [6 ,7 ]
Yi, Quanyong [2 ]
Zhao, Yitian [1 ,2 ]
机构
[1] Chinese Acad Sci, Cixi Inst Biomed Engn, Ningbo Inst Mat Technol & Engn, Ningbo, Peoples R China
[2] Wenzhou Med Univ, Affiliated Ningbo Eye Hosp, Ningbo, Peoples R China
[3] Ningbo Univ, Fac Elect Engn & Comp Sci, Ningbo, Peoples R China
[4] Ningbo Univ Technol, Sch Cyber Sci & Engn, Ningbo, Peoples R China
[5] Macao Polytech Univ, Faulty Appl Sci, Macau, Peoples R China
[6] Xi An Jiao Tong Univ, Sch Life Sci & Technol, Key Lab Biomed Informat Engn Minist Educ, Xian, Peoples R China
[7] Xi An Jiao Tong Univ, Zhejiang Res Inst, Hangzhou, Peoples R China
关键词
retina; ultra-wide-field fundus images; artifact removal; conditional GAN; vessel segmentation; SHADOW REMOVAL; OPTOS OPTOMAP; SENSITIVITY;
D O I
10.3389/fcell.2023.1181305
中图分类号
Q2 [细胞生物学];
学科分类号
071009 ; 090102 ;
摘要
Background: Ultra-Wide-Field (UWF) fundus imaging is an essential diagnostic tool for identifying ophthalmologic diseases, as it captures detailed retinal structures within a wider field of view (FOV). However, the presence of eyelashes along the edge of the eyelids can cast shadows and obscure the view of fundus imaging, which hinders reliable interpretation and subsequent screening of fundus diseases. Despite its limitations, there are currently no effective methods or datasets available for removing eyelash artifacts from UWF fundus images. This research aims to develop an effective approach for eyelash artifact removal and thus improve the visual quality of UWF fundus images for accurate analysis and diagnosis.Methods: To address this issue, we first constructed two UWF fundus datasets: the paired synthetic eyelashes (PSE) dataset and the unpaired real eyelashes (uPRE) dataset. Then we proposed a deep learning architecture called Joint Conditional Generative Adversarial Networks (JcGAN) to remove eyelash artifacts from UWF fundus images. JcGAN employs a shared generator with two discriminators for joint learning of both real and synthetic eyelash artifacts. Furthermore, we designed a background refinement module that refines background information and is trained with the generator in an end-to-end manner.Results: Experimental results on both PSE and uPRE datasets demonstrate the superiority of the proposed JcGAN over several state-of-the-art deep learning approaches. Compared with the best existing method, JcGAN improves PSNR and SSIM by 4.82% and 0.23%, respectively. In addition, we also verified that eyelash artifact removal via JcGAN could significantly improve vessel segmentation performance in UWF fundus images. Assessment via vessel segmentation illustrates that the sensitivity, Dice coefficient and area under curve (AUC) of ResU-Net have respectively increased by 3.64%, 1.54%, and 1.43% after eyelash artifact removal using JcGAN.Conclusion: The proposed JcGAN effectively removes eyelash artifacts in UWF images, resulting in improved visibility of retinal vessels. Our method can facilitate better processing and analysis of retinal vessels and has the potential to improve diagnostic outcomes.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Conditional Generative Adversarial Networks for Metal Artifact Reduction in CT Images of the Ear
    Wang, Jianing
    Zhao, Yiyuan
    Noble, Jack H.
    Dawant, Benoit M.
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 3 - 11
  • [2] Ultra-wide-field fluorescein angiography of the ocular fundus
    Manivannan, A
    Plskova, J
    Farrow, A
    Mckay, S
    Sharp, PF
    Forrester, JV
    [J]. AMERICAN JOURNAL OF OPHTHALMOLOGY, 2005, 140 (03) : 525 - 527
  • [3] Ultra-wide-field fundus autofluorescence and asteroid hyalosis
    Mishra, Chitaranjan
    Sen, Sagnik
    Kannan, Naresh Babu
    Ramasamy, Kim
    [J]. NATIONAL MEDICAL JOURNAL OF INDIA, 2021, 34 (03): : 186 - 186
  • [4] Heightmap Reconstruction of Macula on Color Fundus Images Using Conditional Generative Adversarial Networks
    Tahghighi, Peyman
    Zoroofi, Reza A.
    Safi, Sare
    Ramezani, Alireza
    Ahmadieh, Hamid
    [J]. 2021 26TH INTERNATIONAL COMPUTER CONFERENCE, COMPUTER SOCIETY OF IRAN (CSICC), 2021,
  • [5] Retinal Disease Diagnosis Using Deep Learning on Ultra-Wide-Field Fundus Images
    Nguyen, Toan Duc
    Le, Duc-Tai
    Bum, Junghyun
    Kim, Seongho
    Song, Su Jeong
    Choo, Hyunseung
    [J]. DIAGNOSTICS, 2024, 14 (01)
  • [6] Rain Streak Removal for Single Images Using Conditional Generative Adversarial Networks
    Hettiarachchi, Prasad
    Nawaratne, Rashmika
    Alahakoon, Damminda
    De Silva, Daswin
    Chilamkurti, Naveen
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (05): : 1 - 11
  • [7] Artifact Mitigation for High-Resolution Near-Field SAR Images by Means of Conditional Generative Adversarial Networks
    Laviada, Jaime
    Alvarez-Narciandi, Guillermo
    Las-Heras, Fernando
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [8] Early detection of diabetic retinopathy based on deep learning and ultra-wide-field fundus images
    Oh, Kangrok
    Kang, Hae Min
    Leem, Dawoon
    Lee, Hyungyu
    Seo, Kyoung Yul
    Yoon, Sangchul
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [9] Early detection of diabetic retinopathy based on deep learning and ultra-wide-field fundus images
    Kangrok Oh
    Hae Min Kang
    Dawoon Leem
    Hyungyu Lee
    Kyoung Yul Seo
    Sangchul Yoon
    [J]. Scientific Reports, 11
  • [10] Screening chronic kidney disease through deep learning utilizing ultra-wide-field fundus images
    Zhao, Xinyu
    Gu, Xingwang
    Meng, Lihui
    Chen, Yongwei
    Zhao, Qing
    Cheng, Shiyu
    Zhang, Wenfei
    Cheng, Tiantian
    Wang, Chuting
    Shi, Zhengming
    Jiao, Shengyin
    Jiang, Changlong
    Jiao, Guofang
    Teng, Da
    Sun, Xiaolei
    Zhang, Bilei
    Li, Yakun
    Lu, Huiqin
    Chen, Changzheng
    Zhang, Hao
    Yuan, Ling
    Su, Chang
    Zhang, Han
    Xia, Song
    Liang, Anyi
    Li, Mengda
    Zhu, Dan
    Xue, Meirong
    Sun, Dawei
    Li, Qiuming
    Zhang, Ziwu
    Zhang, Donglei
    Lv, Hongbin
    Ahmat, Rishet
    Wang, Zilong
    Sabanayagam, Charumathi
    Ding, Xiaowei
    Wong, Tien Yin
    Chen, Youxin
    [J]. npj Digital Medicine, 2024, 7 (01)