2D and 3D image reconstruction from slice data based on a constrained bilateral smoothing and dynamic mode decomposition

被引:2
|
作者
Jo, Gwanghyun [1 ]
Lee, Young Ju [2 ]
Ojeda-Ruiz, Ivan [2 ]
机构
[1] Kunsan Natl Univ, Kunsan, South Korea
[2] Texas State Univ, Dept Math, San Marcos, TX 78666 USA
基金
新加坡国家研究基金会;
关键词
Dynamic mode decomposition; Constrained bilateral smoothing; Image segmentation; Image inpainting;
D O I
10.1016/j.amc.2021.126877
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we present an algebraic, graph theoretic and data-based image inpainting algorithm . The algorithm is applied to reconstruct area or volume from one-dimensional and two-dimensional slice data. Given one-dimensional or two-dimensional slice data, our algorithm first performs a simple algebraic presmoothing of the data, e.g., Gaussian filters. The second step is to obtain, from these smoothed data, an operator that reconstructs them via Dynamic Mode Decomposition. Dynamic Mode Decomposition is an equation-free modeler, which is designed to construct the discrete dynamical operator considering slice data as a time series data. We interpret the DMD as a solution to the inverse problem and apply an appropriate continuous extension of DMD to fill the missing time series data. The last step is to smooth the outcome from the second step using a Constraint Bilateral Smoother. The Constraint Bilateral Smoother is designed to smooth the boundary of area or volume, respecting the given slice data. We demonstrate the performance of the proposed algorithm, in several test cases, which include an Magnetic Resonance Imaging of a two-year-old and a Computed Tomography scan of a Covid-19 patient. We also show that a couple of test results are better than those from some competitive alternative techniques up to 50%. Our tests also show that the inpainting computation time increases linearly as a function of the number of pixels or voxels with slope just around 0.5. (C) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] 3D RECONSTRUCTION FROM 2D CRYSTAL IMAGE AND DIFFRACTION DATA
    Schenk, Andreas D.
    Castano-Diez, Daniel
    Gipson, Bryant
    Arheit, Marcel
    Zeng, Xiangyan
    Stahlberg, Henning
    METHODS IN ENZYMOLOGY, VOL 482: CRYO-EM, PART B: 3-D RECONSTRUCTION, 2010, 482 : 101 - 129
  • [2] Reconstruction-based 3D/2D image registration
    Tomazevic, D
    Likar, B
    Pernus, F
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2005, PT 2, 2005, 3750 : 231 - 238
  • [3] 3D Reconstruction of Garment from a Single 2D Image
    Liu, Hongyan
    PROCEEDINGS OF THE FIBER SOCIETY 2009 SPRING CONFERENCE, VOLS I AND II, 2009, : 1165 - 1168
  • [4] 3D IMAGE RECONSTRUCTION FROM 2D CT SLICES
    Kamencay, Patrik
    Zachariasova, Martina
    Hudec, Robert
    Benco, Miroslav
    Radil, Roman
    2014 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2014,
  • [5] From 2D PET to 3D PET: Issues of Data Representation and Image Reconstruction
    Gundlich, Brigitte
    Musmann, Patrick
    Weber, Simone
    Nix, Oliver
    Semmler, Wolfhard
    ZEITSCHRIFT FUR MEDIZINISCHE PHYSIK, 2006, 16 (01): : 31 - 46
  • [6] The 3D Edge Reconstruction from 2D Image by Using Correlation Based Algorithm
    Patoommakesorn, Kanuengnit
    Vignat, Frederic
    Villeneuve, Francois
    2019 IEEE 6TH INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND APPLICATIONS (ICIEA), 2019, : 372 - 376
  • [7] Automatic 3D face reconstruction based on single 2D image
    Guan, Yepeng
    MUE: 2007 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND UBIQUITOUS ENGINEERING, PROCEEDINGS, 2007, : 1216 - 1219
  • [8] 3D facial reconstruction from a single 2D rasterstereography image
    Behlim, Sadaf I.
    Syed, Tahir Q.
    2014 4TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2014, : 303 - 307
  • [9] 3D SURFACE RECONSTRUCTION FROM A SINGLE UNCALIBRATED 2D IMAGE
    Sobani, Siti Syazalina Mohd
    Mahmood, Nasrul Humaimi
    Zakaria, Nor Aini
    JURNAL TEKNOLOGI, 2016, 78 (7-5): : 161 - 166
  • [10] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287