FFT-BASED FILTERING APPROACH TO FUSE PHOTOGRAMMETRY AND PHOTOMETRIC STEREO 3D DATA

被引:3
|
作者
Karami, A. [1 ,2 ]
Varshosaz, M. [3 ]
Menna, F.
Remondino, F. [1 ]
Luhmann, T. [4 ]
机构
[1] Bruno Kessler Fdn FBK, 3D Opt Metrol 3DOM Unit, Trento, Italy
[2] Univ Trento, Trento, Italy
[3] KN Toosi Univ Technol, Geomat Engn Fac, Tehran, Iran
[4] Jade Univ Appl Sci, Inst Appl Photogrammetry & Geoinformat, Oldenburg, Germany
关键词
Photogrammetry; Photometric stereo; High-resolution 3D reconstruction; Fast Fourier Transform (FFT); Fusion; LOW-COST; RECONSTRUCTION; SYSTEM; SHAPE;
D O I
10.5194/isprs-annals-X-4-W1-2022-363-2023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image-based 3D reconstruction has been successfully employed for micro-measurements and industrial quality control purposes. However, obtaining a highly-detailed and reliable 3D reconstruction and inspection of non-collaborative surfaces is still an open issue. Photometric stereo (PS) offers the high spatial frequencies of the surface, but the low frequency is erroneous due to the mathematical model's assumptions and simplifications on how light interacts with the object surface. Photogrammetry, on the other hand, gives precise low-frequency information but fails to utilize high frequencies. As a result, in this research, we present a fusion strategy in Fourier domain to replace the low spatial frequencies of PS with the corresponding photogrammetric frequencies in order to have correct low frequencies while maintaining high frequencies from PS. The proposed method was tested on three different objects. Different cloud-to-cloud comparisons were provided between reference data and the 3D points derived from the proposed method to evaluate high and low frequency information. The obtained 3D findings demonstrated how the proposed methodology generates a high-detail 3D reconstruction of the surface topography (below 20 mu m) while maintaining low-frequency information (0.09 mu m on average for three different testingobjects) by fusingphotogrammetric and PSdepth datawith the proposed FFT-based method.
引用
收藏
页码:363 / 370
页数:8
相关论文
共 50 条
  • [1] Combining Photogrammetry and Photometric Stereo to Achieve Precise and Complete 3D Reconstruction
    Karami, Ali
    Menna, Fabio
    Remondino, Fabio
    SENSORS, 2022, 22 (21)
  • [2] The Photometric Stereo Approach and the Visualization of 3D Face Reconstruction
    Khan, Muhammad Sajid
    Ullah, Zabeeh
    Butt, Maria Shahid
    Arshad, Zohaib
    Yousaf, Sobia
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (02) : 217 - 221
  • [3] Fast FFT-Based Inference in 3D Convolutional Neural Networks
    Xie, Bo
    Zhang, Guidong
    Shen, Yongjun
    Liu, Shun
    Ge, Yabin
    INNOVATIVE MOBILE AND INTERNET SERVICES IN UBIQUITOUS COMPUTING, IMIS-2018, 2019, 773 : 420 - 431
  • [4] 3D Reconstruction of Tongue Surface based on Photometric Stereo
    Lv, Huijuan
    Cai, Yiheng
    Guo, Song
    PROCEEDINGS OF 2012 IEEE 11TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP) VOLS 1-3, 2012, : 1668 - 1671
  • [5] Noniterative 3D face reconstruction based on photometric stereo
    Lee, Sang-Woong
    Wang, Patrick S. P.
    Yanushkevich, Svetlana N.
    Lee, Seong-Whan
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2008, 22 (03) : 389 - 410
  • [6] 3D shape measurement of moving object with FFT-based spatial matching
    Guo, Qinghua
    Ruan, Yuxi
    Xi, Jiangtao
    Song, Limei
    Zhu, Xinjun
    Yu, Yanguang
    Tong, Jun
    OPTICS AND LASER TECHNOLOGY, 2018, 100 : 325 - 331
  • [7] Accurate 3D Reconstruction of Face Image Based on Photometric Stereo
    Lei, Yongqing
    Sun, Yujuan
    Wu, Zeju
    Wang, Zengfeng
    COMPUTATIONAL INTELLIGENCE AND INTELLIGENT SYSTEMS, (ISICA 2015), 2016, 575 : 418 - 423
  • [8] Fast 3D face reconstruction based on uncalibrated photometric stereo
    Yujuan Sun
    Junyu Dong
    Muwei Jian
    Lin Qi
    Multimedia Tools and Applications, 2015, 74 : 3635 - 3650
  • [9] Object 3D Reconstruction based on Photometric Stereo and Inverted Rendering
    Khadka, Anish R.
    Remagnino, Paolo
    Argyriou, Vasileios
    2018 14TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS (SITIS), 2018, : 208 - 215
  • [10] Fast 3D face reconstruction based on uncalibrated photometric stereo
    Sun, Yujuan
    Dong, Junyu
    Jian, Muwei
    Qi, Lin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (11) : 3635 - 3650