Accurate tissue interface segmentation via adversarial pre-segmentation of anterior segment OCT images

被引:25
|
作者
Ouyang, Jiahong [1 ]
Mathai, Tejas Sudharshan [1 ]
Lathrop, Kira [2 ,3 ]
Galeotti, John [1 ,2 ]
机构
[1] Carnegie Mellon Univ, Robot Inst, Pittsburgh, PA 15213 USA
[2] Univ Pittsburgh, Dept Bioengn, Pittsburgh, PA 15213 USA
[3] Univ Pittsburgh, Dept Ophthalmol, Pittsburgh, PA 15213 USA
基金
美国国家卫生研究院;
关键词
OPTICAL COHERENCE TOMOGRAPHY; SPECKLE NOISE-REDUCTION; RETINAL LAYER SEGMENTATION; AUTOMATIC SEGMENTATION; IN-VIVO; GRAPH-THEORY; REMOVAL; SDOCT; BOUNDARIES; EPITHELIUM;
D O I
10.1364/BOE.10.005291
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Optical Coherence Tomography (OCT) is an imaging modality that has been widely adopted for visualizing corneal, retinal and limbal tissue structure with micron resolution. It can be used to diagnose pathological conditions of the eye, and for developing pre-operative surgical plans. In contrast to the posterior retina, imaging the anterior tissue structures, such as the limbus and cornea, results in B-scans that exhibit increased speckle noise patterns and imaging artifacts. These artifacts, such as shadowing and specularity, pose a challenge during the analysis of the acquired volumes as they substantially obfuscate the location of tissue interfaces. To deal with the artifacts and speckle noise patterns and accurately segment the shallowest tissue interface, we propose a cascaded neural network framework, which comprises of a conditional Generative Adversarial Network (cGAN) and a Tissue Interface Segmentation Network (TISN). The cGAN pre-segments OCT B-scans by removing undesired specular artifacts and speckle noise patterns just above the shallowest tissue interface, and the TISN combines the original OCT image with the pre-segmentation to segment the shallowest interface. We show the applicability of the cascaded framework to corneal datasets, demonstrate that it precisely segments the shallowest corneal interface, and also show its generalization capacity to limbal datasets. We also propose a hybrid framework, wherein the cGAN pre-segmentation is passed to a traditional image analysis-based segmentation algorithm, and describe the improved segmentation performance. To the best of our knowledge, this is the first approach to remove severe specular artifacts and speckle noise patterns (prior to the shallowest interface) that affects the interpretation of anterior segment OCT datasets, thereby resulting in the accurate segmentation of the shallowest tissue interface. To the best of our knowledge, this is the first work to show the potential of incorporating a cGAN into larger deep learning frameworks for improved corneal and limbal OCT image segmentation. Our cGAN design directly improves the visualization of corneal and limbal OCT images from OCT scanners, and improves the performance of current OCT segmentation algorithms. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码:5291 / 5324
页数:34
相关论文
共 50 条
  • [21] RETINAL FLUID SEGMENTATION IN OCT IMAGES USING ADVERSARIAL LOSS BASED CONVOLUTIONAL NEURAL NETWORKS
    Tennakoon, Ruwan
    Gostar, Amirali K.
    Hoseinnezhad, Reza
    Bab-Hadiashar, Alireza
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 1436 - 1440
  • [22] AN ADVERSARIAL COLLABORATIVE-LEARNING APPROACH FOR CORNEAL SCAR SEGMENTATION WITH OCULAR ANTERIOR SEGMENT PHOTOGRAPHY
    Wang, Ke
    Wang, Guangyu
    Zhang, Kang
    Chen, Ting
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1 - 5
  • [23] Fast segmentation of anterior segment optical coherence tomography images using graph cut
    Williams, Dominic
    Zheng, Yalin
    Bao, Fangjun
    Elsheikh, Ahmed
    EYE AND VISION, 2015, 2
  • [24] Fast segmentation of anterior segment optical coherence tomography images using graph cut
    Dominic Williams
    Yalin Zheng
    Fangjun Bao
    Ahmed Elsheikh
    Eye and Vision, 2
  • [25] Application of artificial intelligence for automatic cataract staging based on anterior segment images: comparing automatic segmentation approaches to manual segmentation
    Gan, Fan
    Liu, Hui
    Qin, Wei-Guo
    Zhou, Shui-Lian
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [26] Angle-closure assessment in anterior segment OCT images via deep learning
    Hao, Huaying
    Zhao, Yitian
    Yan, Qifeng
    Higashita, Risa
    Zhang, Jiong
    Zhao, Yifan
    Xu, Yanwu
    Li, Fei
    Zhang, Xiulan
    Liu, Jiang
    MEDICAL IMAGE ANALYSIS, 2021, 69
  • [27] Towards Accurate Segmentation of Retinal Vessels and the Optic Disc in Fundoscopic Images with Generative Adversarial Networks
    Son, Jaemin
    Park, Sang Jun
    Jung, Kyu-Hwan
    JOURNAL OF DIGITAL IMAGING, 2019, 32 (03) : 499 - 512
  • [28] Towards Accurate Segmentation of Retinal Vessels and the Optic Disc in Fundoscopic Images with Generative Adversarial Networks
    Jaemin Son
    Sang Jun Park
    Kyu-Hwan Jung
    Journal of Digital Imaging, 2019, 32 : 499 - 512
  • [29] Accurate Segmentation of Subcutaneous and Intermuscular Adipose Tissue From MR Images of the Thigh
    Positano, Vincenzo
    Christiansen, Tore
    Santarelli, Maria Filomena
    Ringgaard, Steffen
    Landini, Luigi
    Gastaldelli, Amalia
    JOURNAL OF MAGNETIC RESONANCE IMAGING, 2009, 29 (03) : 677 - 684
  • [30] Deep learning-based detection of regions of interest from whole slide images enables rapid and accurate pre-segmentation for automated analyses of bone marrow smears
    Schneider, M.
    Schulze, F.
    Schmittmann, T.
    Riechert, S.
    Gediga, M. H. E.
    Sockel, K.
    Kroschinsky, F.
    Wendt, K.
    Bornhaeuser, M.
    Middeke, J. M.
    Eckardt, J. -N.
    ONCOLOGY RESEARCH AND TREATMENT, 2023, 46 : 308 - 309