Accurate tissue interface segmentation via adversarial pre-segmentation of anterior segment OCT images

被引:25
|
作者
Ouyang, Jiahong [1 ]
Mathai, Tejas Sudharshan [1 ]
Lathrop, Kira [2 ,3 ]
Galeotti, John [1 ,2 ]
机构
[1] Carnegie Mellon Univ, Robot Inst, Pittsburgh, PA 15213 USA
[2] Univ Pittsburgh, Dept Bioengn, Pittsburgh, PA 15213 USA
[3] Univ Pittsburgh, Dept Ophthalmol, Pittsburgh, PA 15213 USA
基金
美国国家卫生研究院;
关键词
OPTICAL COHERENCE TOMOGRAPHY; SPECKLE NOISE-REDUCTION; RETINAL LAYER SEGMENTATION; AUTOMATIC SEGMENTATION; IN-VIVO; GRAPH-THEORY; REMOVAL; SDOCT; BOUNDARIES; EPITHELIUM;
D O I
10.1364/BOE.10.005291
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Optical Coherence Tomography (OCT) is an imaging modality that has been widely adopted for visualizing corneal, retinal and limbal tissue structure with micron resolution. It can be used to diagnose pathological conditions of the eye, and for developing pre-operative surgical plans. In contrast to the posterior retina, imaging the anterior tissue structures, such as the limbus and cornea, results in B-scans that exhibit increased speckle noise patterns and imaging artifacts. These artifacts, such as shadowing and specularity, pose a challenge during the analysis of the acquired volumes as they substantially obfuscate the location of tissue interfaces. To deal with the artifacts and speckle noise patterns and accurately segment the shallowest tissue interface, we propose a cascaded neural network framework, which comprises of a conditional Generative Adversarial Network (cGAN) and a Tissue Interface Segmentation Network (TISN). The cGAN pre-segments OCT B-scans by removing undesired specular artifacts and speckle noise patterns just above the shallowest tissue interface, and the TISN combines the original OCT image with the pre-segmentation to segment the shallowest interface. We show the applicability of the cascaded framework to corneal datasets, demonstrate that it precisely segments the shallowest corneal interface, and also show its generalization capacity to limbal datasets. We also propose a hybrid framework, wherein the cGAN pre-segmentation is passed to a traditional image analysis-based segmentation algorithm, and describe the improved segmentation performance. To the best of our knowledge, this is the first approach to remove severe specular artifacts and speckle noise patterns (prior to the shallowest interface) that affects the interpretation of anterior segment OCT datasets, thereby resulting in the accurate segmentation of the shallowest tissue interface. To the best of our knowledge, this is the first work to show the potential of incorporating a cGAN into larger deep learning frameworks for improved corneal and limbal OCT image segmentation. Our cGAN design directly improves the visualization of corneal and limbal OCT images from OCT scanners, and improves the performance of current OCT segmentation algorithms. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码:5291 / 5324
页数:34
相关论文
共 50 条
  • [1] Segmentation of anterior segment boundaries in swept source OCT images
    Marin, Yoel Garcia
    Skrok, Marta
    Siedlecki, Damian
    Vincent, Stephen J.
    Collins, Michael J.
    Alonso-Caneiro, David
    BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2021, 41 (03) : 903 - 915
  • [2] Automatic Segmentation of Cortex and Nucleus in Anterior Segment OCT Images
    Yin, Pengshuai
    Tan, Mingkui
    Min, Huaqing
    Xu, Yanwu
    Xu, Guanghui
    Wu, Qingyao
    Tong, Yunfei
    Risa, Higashita
    Liu, Jiang
    COMPUTATIONAL PATHOLOGY AND OPHTHALMIC MEDICAL IMAGE ANALYSIS, 2018, 11039 : 269 - 276
  • [3] Adversarial convolutional network for esophageal tissue segmentation on OCT images
    Wang, Cong
    Gan, Meng
    Zhang, Miao
    Li, Deyin
    BIOMEDICAL OPTICS EXPRESS, 2020, 11 (06) : 3095 - 3110
  • [4] CONTOUR SEGMENT ANALYSIS FOR HUMAN SILHOUETTE PRE-SEGMENTATION
    Migniot, Cyrille
    Bertolino, Pascal
    Chassery, Jean-Marc
    VISAPP 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, 2010, : 74 - 80
  • [5] HIERARCHY-CONSTRAINED NETWORK FOR CORNEAL TISSUE SEGMENTATION BASED ON ANTERIOR SEGMENT OCT IMAGES
    Liu, Yang
    Li, Dongfang
    Guo, Yan
    Zhou, Xia
    Dong, Yanling
    Guo, Zhen
    Xie, Guotong
    Lv, Chuanfeng
    Lv, Bin
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 1579 - 1582
  • [6] Biomedical Image Segmentation via Constrained Graph Cuts and Pre-segmentation
    Yu, Zeyun
    Xu, Ming
    Gao, Zhanheng
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 5714 - 5717
  • [7] Efficient Pre-Segmentation Algorithm for Sidescan-Sonar Images
    Lehmann, B.
    Siantidis, K.
    Aleksi, I.
    Kraus, D.
    PROCEEDINGS OF THE 7TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2011), 2011, : 471 - 475
  • [8] Pre-segmentation of high resolution images thanks to the morphological pyramid
    Laporterie-Déjean, F
    Lopez-Ornelas, E
    Flouzat, G
    IGARSS 2003: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS I - VII, PROCEEDINGS: LEARNING FROM EARTH'S SHAPES AND SIZES, 2003, : 2042 - 2044
  • [9] ACCELERATING DIFFUSION MODELS VIA PRE-SEGMENTATION DIFFUSION SAMPLING FOR MEDICAL IMAGE SEGMENTATION
    Guo, Xutao
    Yang, Yanwu
    Ye, Chenfei
    Lu, Shang
    Peng, Bo
    Huang, Hua
    Xiang, Yang
    Ma, Ting
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [10] Automated Iris Segmentation from Anterior Segment OCT Images with Occludable Angles via Local Phase Tensor
    Shang, Qiaoling
    Zhao, Yitian
    Chen, Zhili
    Hao, Huaying
    Lei, Fei
    Zhang, Xiulan
    Liu, Jiang
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 4745 - 4749