FFT-BASED FILTERING APPROACH TO FUSE PHOTOGRAMMETRY AND PHOTOMETRIC STEREO 3D DATA

被引:3
|
作者
Karami, A. [1 ,2 ]
Varshosaz, M. [3 ]
Menna, F.
Remondino, F. [1 ]
Luhmann, T. [4 ]
机构
[1] Bruno Kessler Fdn FBK, 3D Opt Metrol 3DOM Unit, Trento, Italy
[2] Univ Trento, Trento, Italy
[3] KN Toosi Univ Technol, Geomat Engn Fac, Tehran, Iran
[4] Jade Univ Appl Sci, Inst Appl Photogrammetry & Geoinformat, Oldenburg, Germany
关键词
Photogrammetry; Photometric stereo; High-resolution 3D reconstruction; Fast Fourier Transform (FFT); Fusion; LOW-COST; RECONSTRUCTION; SYSTEM; SHAPE;
D O I
10.5194/isprs-annals-X-4-W1-2022-363-2023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image-based 3D reconstruction has been successfully employed for micro-measurements and industrial quality control purposes. However, obtaining a highly-detailed and reliable 3D reconstruction and inspection of non-collaborative surfaces is still an open issue. Photometric stereo (PS) offers the high spatial frequencies of the surface, but the low frequency is erroneous due to the mathematical model's assumptions and simplifications on how light interacts with the object surface. Photogrammetry, on the other hand, gives precise low-frequency information but fails to utilize high frequencies. As a result, in this research, we present a fusion strategy in Fourier domain to replace the low spatial frequencies of PS with the corresponding photogrammetric frequencies in order to have correct low frequencies while maintaining high frequencies from PS. The proposed method was tested on three different objects. Different cloud-to-cloud comparisons were provided between reference data and the 3D points derived from the proposed method to evaluate high and low frequency information. The obtained 3D findings demonstrated how the proposed methodology generates a high-detail 3D reconstruction of the surface topography (below 20 mu m) while maintaining low-frequency information (0.09 mu m on average for three different testingobjects) by fusingphotogrammetric and PSdepth datawith the proposed FFT-based method.
引用
收藏
页码:363 / 370
页数:8
相关论文
共 50 条
  • [31] Combinatorial photometric stereo and its application in 3D modeling of melanoma
    Yu Zhou
    Melvyn L. Smith
    Lyndon Smith
    Robert Warr
    Machine Vision and Applications, 2012, 23 : 1029 - 1045
  • [32] Contactless robust 3D palmprint identification using photometric stereo
    Smith, Lyndon N.
    Langhof, Max P.
    Hansen, Mark F.
    Smith, Melvyn L.
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLIV, 2021, 11842
  • [33] 3D Digitization of Selected Collection Items Using Photometric Stereo
    Valach, Jaroslav
    Bryscejn, Jan
    Fila, Tomas
    Vavrik, Daniel
    Stefcova, Petra
    DIGITAL CULTURAL HERITAGE, 2018, 10605 : 31 - 36
  • [34] Using photometric stereo to refine the geometry of a 3D surface model
    Janko, Zsolt
    VISAPP 2007: PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOLUME IU/MTSV, 2007, : 355 - 362
  • [35] 3D Modeling Of A Document Surface Topography With A Photometric Stereo Method
    Baz, Ipek
    Kilic, Cihan
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [36] Underwater 3D reconstruction using a photometric stereo with illuminance estimation
    HUANG, S. A. N. A. O.
    SHI, Y. I. N. G. J. I. E.
    LI, M. I. N. G.
    QIAN, J. I. N. G. W. E. I.
    XU, K. E.
    APPLIED OPTICS, 2023, 62 (03) : 612 - 619
  • [37] Microscopic Photometric Stereo: A Dense Microstructure 3D Measurement Method
    Li, Zhongwei
    Li, Y. F.
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [38] 3D Reconstruction in Laparoscopy with Close-Range Photometric Stereo
    Collins, Toby
    Bartolli, Adrien
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2012, PT II, 2012, 7511 : 634 - 642
  • [39] Combinatorial photometric stereo and its application in 3D modeling of melanoma
    Zhou, Yu
    Smith, Melvyn L.
    Smith, Lyndon
    Warr, Robert
    MACHINE VISION AND APPLICATIONS, 2012, 23 (05) : 1029 - 1045
  • [40] Hybrid MPI plus OpenMP parallelization of an FFT-based 3D Poisson solver with one periodic direction
    Gorobets, A.
    Trias, F. X.
    Borrell, R.
    Lehmkuhl, O.
    Oliva, A.
    COMPUTERS & FLUIDS, 2011, 49 (01) : 101 - 109