2D and 3D image reconstruction from slice data based on a constrained bilateral smoothing and dynamic mode decomposition

被引:2
|
作者
Jo, Gwanghyun [1 ]
Lee, Young Ju [2 ]
Ojeda-Ruiz, Ivan [2 ]
机构
[1] Kunsan Natl Univ, Kunsan, South Korea
[2] Texas State Univ, Dept Math, San Marcos, TX 78666 USA
基金
新加坡国家研究基金会;
关键词
Dynamic mode decomposition; Constrained bilateral smoothing; Image segmentation; Image inpainting;
D O I
10.1016/j.amc.2021.126877
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we present an algebraic, graph theoretic and data-based image inpainting algorithm . The algorithm is applied to reconstruct area or volume from one-dimensional and two-dimensional slice data. Given one-dimensional or two-dimensional slice data, our algorithm first performs a simple algebraic presmoothing of the data, e.g., Gaussian filters. The second step is to obtain, from these smoothed data, an operator that reconstructs them via Dynamic Mode Decomposition. Dynamic Mode Decomposition is an equation-free modeler, which is designed to construct the discrete dynamical operator considering slice data as a time series data. We interpret the DMD as a solution to the inverse problem and apply an appropriate continuous extension of DMD to fill the missing time series data. The last step is to smooth the outcome from the second step using a Constraint Bilateral Smoother. The Constraint Bilateral Smoother is designed to smooth the boundary of area or volume, respecting the given slice data. We demonstrate the performance of the proposed algorithm, in several test cases, which include an Magnetic Resonance Imaging of a two-year-old and a Computed Tomography scan of a Covid-19 patient. We also show that a couple of test results are better than those from some competitive alternative techniques up to 50%. Our tests also show that the inpainting computation time increases linearly as a function of the number of pixels or voxels with slope just around 0.5. (C) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Retinal image registration from 2D to 3D
    Lin, Yuping
    Medioni, Gerard
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 2830 - 2837
  • [42] Data fusion in 2D and 3D image processing: An overview
    Bloch, I
    Maitre, H
    X BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 1997, : 127 - 134
  • [43] Shape reconstruction from 3D and 2D data using PDE-based deformable surfaces
    Duan, Y
    Yang, L
    Qin, H
    Samaras, D
    COMPUTER VISION - ECCV 2004, PT 3, 2004, 3023 : 238 - 251
  • [44] Constrained 3D navigation with 2D controllers
    Hanson, AJ
    Wernert, EA
    VISUALIZATION '97 - PROCEEDINGS, 1997, : 175 - +
  • [45] Image scanners: 2D and 3D
    Handley, R.
    Advanced Imaging, 2001, 16 (07) : 28 - 33
  • [46] 2D and 3D image processing
    2D- und 3D-Bildverarbeitung
    Materialpruefung/Materials Testing, 2001, 43 (05):
  • [47] Voxel-Based 3D Object Reconstruction from Single 2D Image Using Variational Autoencoders
    Tahir, Rohan
    Sargano, Allah Bux
    Habib, Zulfiqar
    MATHEMATICS, 2021, 9 (18)
  • [48] 3D TOMOGRAPHIC RECONSTRUCTION FROM 2D DATA USING SPHERICAL HARMONICS.
    Pecora, Louis M.
    IEEE Transactions on Nuclear Science, 1987, NS-34 (02) : 642 - 650
  • [49] Analysis of 2D/3D image data for 3D visualization during image-guided interventions
    Department of Neurosurgery, Toshiba Stroke Research Center, State University of New York at Buffalo, 3435 Main Street, Buffalo, NY 14214
    Inf Disp, 2006, 7 (10-15):