Interactive Deep Learning-Based Retinal OCT Layer Segmentation Refinement by Regressing Translation Maps

被引:0
|
作者
Aresta, Guilherme [1 ]
Araujo, Teresa [1 ]
Fazekas, Botond [1 ]
Mai, Julia [1 ]
Schmidt-Erfurth, Ursula [1 ]
Bogunovic, Hrvoje [1 ]
机构
[1] Med Univ Vienna, Dept Ophthalmol & Optometry, Christian Doppler Lab Artificial Intelligence Reti, A-1090 Vienna, Austria
关键词
Image segmentation; interactive annotation; deep learning; human-in-the-loop; optical coherence tomography; retina; OPTICAL COHERENCE TOMOGRAPHY; AUTOMATIC SEGMENTATION; MULTIPLE-SCLEROSIS; IMAGES; BOUNDARIES;
D O I
10.1109/ACCESS.2024.3379015
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Retinal layer segmentation in optical coherence tomography (OCT) is essential for the diagnosis and follow-up of several diseases. Despite the success of deep learning approaches for this task, their clinical applicability is limited, since they neither account for pathologies other than those present in the training set nor for the specialists' subjectivity. Thus, we propose an interactive layer segmentation approach that allows to obtain an initial segmentation and, more importantly, to interactively correct those segmentations. Our deep learning-based approach predicts the translation required to correct layer boundary segmentations by regressing pixel-wise translation maps that account for the user input. The method is designed to allow for segmentation correction by interactions with point-clicks or line-scribbles. Additionally, the system outputs a coordinate-wise confidence, allowing to automatically identify regions of possible segmentation failure that may require user attention. We extensively validate our approach on multiple private and public datasets with different pathomorphological complexities, achieving state-of-the-art performance, while allowing for a simple and efficient user interaction.
引用
收藏
页码:47009 / 47023
页数:15
相关论文
共 50 条
  • [1] Deep learning based retinal OCT segmentation
    Pekala, M.
    Joshi, N.
    Liu, T. Y. Alvin
    Bressler, N. M.
    DeBuc, D. Cabrera
    Burlina, P.
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2019, 114
  • [2] Deep learning-based automatic segmentation of retinal cavitations on OCT images of MacTel2
    Loo, Jessica
    Cai, Cindy Xinji
    Chew, Emily
    Friedlander, Martin
    Jaffe, Glenn J.
    Farsiu, Sina
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2020, 61 (07)
  • [3] A Deep Ensemble Learning-Based CNN Architecture for Multiclass Retinal Fluid Segmentation in OCT Images
    Rahil, Mohammad
    Anoop, B. N.
    Girish, G. N.
    Kothari, Abhishek R.
    Koolagudi, Shashidhar G.
    Rajan, Jeny
    [J]. IEEE ACCESS, 2023, 11 : 17241 - 17251
  • [4] A Deep Learning-based Method for Retinal Layer and Drusen Segmentation on Optical Coherence Tomography
    Guo, Yukun
    Hormel, Tristan
    Gao, Min
    Hwang, Thomas S.
    Bailey, Steven T.
    Jia, Yali
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2022, 63 (07)
  • [5] Deep learning-based retinal layer reconstruction from OCT scans for anomaly detection and localization
    Zerihun, Bisrat
    Reisman, Charles A.
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2020, 61 (07)
  • [6] A Deep Learning-Based Interactive Medical Image Segmentation Framework
    Mikhailov, Ivan
    Chauveau, Benoit
    Bourdel, Nicolas
    Bartoli, Adrien
    [J]. APPLICATIONS OF MEDICAL ARTIFICIAL INTELLIGENCE, AMAI 2022, 2022, 13540 : 98 - 107
  • [7] Anomaly Detection Based on Uncertainty of Retinal Layer Boundary Segmentation in OCT Images using Deep Learning
    Miyazaki, Sohei
    Shiba, Ryosuke
    Takeno, Naoki
    Kumagai, Yoshiki
    Sakashita, Yusuke
    Shibata, Naohisa
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2019, 60 (09)
  • [8] Deep Learning-Based Retinal Layer Segmentation in Optical Coherence Tomography Scans of Patients with Inherited Retinal Diseases
    Eckardt, Franziska
    Mittas, Robin
    Horlava, Nastassya
    Schiefelbein, Johannes
    Ben Asani
    Michalakis, Stylianos
    Gerhardt, Maximilian
    Priglinger, Claudia
    Keeser, Daniel
    Koutsouleris, Nikolaos
    Priglinger, Siegfried
    Theis, Fabian
    Peng, Tingying
    Schworm, Benedikt
    [J]. KLINISCHE MONATSBLATTER FUR AUGENHEILKUNDE, 2024,
  • [9] Joint deep matching model of OCT retinal layer segmentation
    Yang, Mei
    Zheng, Yuanjie
    Jia, Weikuan
    He, Yunlong
    Che, Tongtong
    Cong, Jinyu
    [J]. Computers, Materials and Continua, 2020, 63 (03): : 1485 - 1498
  • [10] Joint Deep Matching Model of OCT Retinal Layer Segmentation
    Yang, Mei
    Zheng, Yuanjie
    Jia, Weikuan
    He, Yunlong
    Che, Tongtong
    Cong, Jinyu
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2020, 63 (03): : 1485 - 1498