FFT-BASED FILTERING APPROACH TO FUSE PHOTOGRAMMETRY AND PHOTOMETRIC STEREO 3D DATA

被引:3
|
作者
Karami, A. [1 ,2 ]
Varshosaz, M. [3 ]
Menna, F.
Remondino, F. [1 ]
Luhmann, T. [4 ]
机构
[1] Bruno Kessler Fdn FBK, 3D Opt Metrol 3DOM Unit, Trento, Italy
[2] Univ Trento, Trento, Italy
[3] KN Toosi Univ Technol, Geomat Engn Fac, Tehran, Iran
[4] Jade Univ Appl Sci, Inst Appl Photogrammetry & Geoinformat, Oldenburg, Germany
关键词
Photogrammetry; Photometric stereo; High-resolution 3D reconstruction; Fast Fourier Transform (FFT); Fusion; LOW-COST; RECONSTRUCTION; SYSTEM; SHAPE;
D O I
10.5194/isprs-annals-X-4-W1-2022-363-2023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image-based 3D reconstruction has been successfully employed for micro-measurements and industrial quality control purposes. However, obtaining a highly-detailed and reliable 3D reconstruction and inspection of non-collaborative surfaces is still an open issue. Photometric stereo (PS) offers the high spatial frequencies of the surface, but the low frequency is erroneous due to the mathematical model's assumptions and simplifications on how light interacts with the object surface. Photogrammetry, on the other hand, gives precise low-frequency information but fails to utilize high frequencies. As a result, in this research, we present a fusion strategy in Fourier domain to replace the low spatial frequencies of PS with the corresponding photogrammetric frequencies in order to have correct low frequencies while maintaining high frequencies from PS. The proposed method was tested on three different objects. Different cloud-to-cloud comparisons were provided between reference data and the 3D points derived from the proposed method to evaluate high and low frequency information. The obtained 3D findings demonstrated how the proposed methodology generates a high-detail 3D reconstruction of the surface topography (below 20 mu m) while maintaining low-frequency information (0.09 mu m on average for three different testingobjects) by fusingphotogrammetric and PSdepth datawith the proposed FFT-based method.
引用
收藏
页码:363 / 370
页数:8
相关论文
共 50 条
  • [21] 3D point filtering algorithm for 3d object detection based on stereo image processing
    Kim J.-M.
    Park J.-M.
    Lee J.-W.
    Journal of Institute of Control, Robotics and Systems, 2021, 27 (09): : 676 - 684
  • [22] 3D DIGITIZATION OF HERITAGE: PHOTOMETRIC STEREO CAN HELP
    Melou, Jean
    Laurent, Antoine
    Fritz, Carole
    Durou, Jean-Denis
    7TH INTERNATIONAL WORKSHOP LOWCOST 3D - SENSORS, ALGORITHMS, APPLICATIONS, 2022, 48-2 (W1): : 145 - 152
  • [23] The Effect of Crystal Defects on 3D High-Resolution Diffraction Peaks: A FFT-Based Method
    Eloh, Komlavi Senyo
    Jacques, Alain
    Ribarik, Gabor
    Berbenni, Stephane
    MATERIALS, 2018, 11 (09)
  • [24] Robust 3D face capture using example-based photometric stereo
    Saracchini, Rafael F. V.
    Stolfi, Jorge
    Leitao, Helena C. G.
    Atkinson, Gary A.
    Smith, Melvyn L.
    COMPUTERS IN INDUSTRY, 2013, 64 (09) : 1399 - 1410
  • [25] FCN-Based 3D Reconstruction with Multi-Source Photometric Stereo
    Wang, Ruixin
    Wang, Xin
    He, Di
    Wang, Lei
    Xu, Ke
    APPLIED SCIENCES-BASEL, 2020, 10 (08):
  • [26] Online detection technique of 3D defects for steel strips based on photometric stereo
    Wang, Lei
    Xu, Ke
    Zhou, Peng
    PROCEEDINGS 2016 EIGHTH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION ICMTMA 2016, 2016, : 428 - 432
  • [27] Mobile photometric stereo with keypoint-based SLAM for dense 3D reconstruction
    Maxence, Remy
    Uchiyama, Hideaki
    Kawasaki, Hiroshi
    Thomas, Diego
    Nozick, Vincent
    Saito, Hideo
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 574 - 582
  • [28] 3D seismic data fusion and filtering using a PDE-based approach
    Pop, Sorin
    Terebes, Romulus
    Borda, Monica
    Guillon, Sebastien
    Keskes, Naamen
    Baylou, Pierre
    Lavialle, Olivier
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 1813 - +
  • [29] Acceleration of 3D Measurement of Large Structures with Ring Laser and Camera via FFT-based Template Matching
    Kawata, Momoko
    Higuchi, Hiroshi
    Fujii, Hiromitsu
    Taniguchi, Atsushi
    Watanabe, Masahiro
    Yamashita, Atsushi
    Asama, Hajime
    2019 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2019, : 11 - 16
  • [30] gEMfitter: A highly parallel FFT-based 3D density fitting tool with GPU texture memory acceleration
    Hoang, Thai V.
    Cavin, Xavier
    Ritchie, David W.
    JOURNAL OF STRUCTURAL BIOLOGY, 2013, 184 (02) : 348 - 354