OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing

被引:1
|
作者
Zhu, Wenhui [1 ]
Qiu, Peijie [2 ]
Dumitrascu, Oana M. [3 ]
Sobczak, Jacob M. [3 ]
Farazi, Mohammad [1 ]
Yang, Zhangsihao [1 ]
Nandakumar, Keshav [1 ]
Wang, Yalin [1 ]
机构
[1] Arizona State Univ, Sch Comp & Augmented Intelligence, Tempe, AZ 85281 USA
[2] Washington Univ St Louis, McKeley Sch Engn, St Louis, MO USA
[3] Mayo Clin, Dept Neurol, Scottsdale, AZ USA
关键词
Retinal color fundus photography; Image enhancement; Optimal transport; Regularization by enhancing; Unsupervised learning;
D O I
10.1007/978-3-031-34048-2_32
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Non-mydriatic retinal color fundus photography (CFP) is widely available due to the advantage of not requiring pupillary dilation, however, is prone to poor quality due to operators, systemic imperfections, or patient-related causes. Optimal retinal image quality ismandated for accurate medical diagnoses and automated analyses. Herein, we leveraged the Optimal Transport (OT) theory to propose an unpaired image-to-image translation scheme for mapping low-quality retinal CFPs to highquality counterparts. Furthermore, to improve the flexibility, robustness, and applicability of our image enhancement pipeline in the clinical practice, we generalized a state-of-the-art model-based image reconstruction method, regularization by denoising, by plugging in priors learned by our OT-guided image-to-image translation network. We named it as regularization by enhancing (RE). We validated the integrated framework, OTRE, on three publicly available retinal image datasets by assessing the quality after enhancement and their performance on various downstream tasks, including diabetic retinopathy grading, vessel segmentation, and diabetic lesion segmentation. The experimental results demonstrated the superiority of our proposed framework over some state-of-the-art unsupervised competitors and a state-of-the-art supervised method.
引用
收藏
页码:415 / 427
页数:13
相关论文
共 50 条
  • [41] Trans-Cycle: Unpaired Image-to-Image Translation Network by Transformer
    Tian, Kai
    Pan, Mengze
    Lu, Zongqing
    Liao, Qingmin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 576 - 587
  • [42] Enhanced Unpaired Image-to-Image Translation via Transformation in Saliency Domain
    Shibasaki, Kei
    Ikehara, Masaaki
    IEEE ACCESS, 2023, 11 : 137495 - 137505
  • [43] Domain Bridge for Unpaired Image-to-Image Translation and Unsupervised Domain Adaptation
    Pizzati, Fabio
    de Charette, Raoul
    Zaccaria, Michela
    Cerri, Pietro
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2979 - 2987
  • [44] UNPAIRED IMAGE-TO-IMAGE TRANSLATION BASED DOMAIN ADAPTATION FOR POLYP SEGMENTATION
    Xiong, Xinyu
    Li, Siying
    Li, Guanbin
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [45] Background-focused contrastive learning for unpaired image-to-image translation
    Shao, Mingwen
    Han, Minggui
    Meng, Lingzhuang
    Liu, Fukang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (04)
  • [46] UNPAIRED IMAGE-TO-IMAGE TRANSLATION WITH LIMITED DATA TO REVEAL SUBTLE PHENOTYPES
    Bourou, Anis
    Daupin, Kevin
    Dubreuil, Veronique
    De Thonel, Aurelie
    Mezger-Lallemand, Valerie
    Genovesio, Auguste
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [47] Exploring Double Cross Cyclic Interpolation in Unpaired Image-to-Image Translation
    Lopez, Jorge
    Mauricio, Antoni
    Camara, Guillermo
    2019 32ND SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2019, : 124 - 130
  • [48] Unpaired Image-to-Image Translation Using Negative Learning for Noisy Patches
    Hung, Yu-Hsiang
    Tan, Julianne
    Huang, Tai-Ming
    Hsu, Shang-Che
    Chen, Yi-Ling
    Hua, Kai-Lung
    IEEE MULTIMEDIA, 2022, 29 (04) : 59 - 68
  • [49] Learning Image-to-Image Translation Using Paired and Unpaired Training Samples
    Tripathy, Soumya
    Kannala, Juho
    Rahtu, Esa
    COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 : 51 - 66
  • [50] Image-to-Image Translation with Multi-Path Consistency Regularization
    Lin, Jianxin
    Xia, Yingce
    Wang, Yijun
    Qin, Tao
    Chen, Zhibo
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2980 - 2986