Real-Scale 3-D Reconstruction With Monocular Zoom Technology

被引:0
|
作者
Song, Jinao [1 ]
Li, Jie [1 ]
Fan, Hao [1 ]
Qi, Lin [1 ]
Zhang, Shu [1 ]
Chen, Yong [1 ]
Dong, Junyu [1 ]
机构
[1] Ocean Univ China, Dept Informat Sci & Technol, Qingdao 266000, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Accuracy; Structure from motion; Design methodology; Cameras; Image restoration; Image reconstruction; Monocular zooming; optical flow; real-scale 3-D reconstruction;
D O I
10.1109/TIM.2024.3497052
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a method that is able to use the monocular zoom technology for real-scale 3-D reconstruction of the scene. To reconstruct the scene, we take a sequence of zoomed-in and zoomed-out figures. First, we can estimate zoomed-in camera parameters using the known zoomed-out camera parameters, which avoids calibrating the camera parameters twice. Then, we use the structure from motion (SfM) method (COLMAP) to reconstruct free-scale translations among these figures. After that, as we have pairs of zoom frames in the same scene, we can calculate the true scale of the scene by comparing the ratio between the free-scale translation of a pair of zoom frames and the difference in zoomed-out and the zoomed-in focal length. Finally, we use RAFT-stereo to compute the depth of the scene. In detail, we select two adjacent figures taken at the same focal length, make a stereo correction for them, and remove the nonco-vision area of the corrected images. This way, we obtain a more accurate matching of these images and then get a dense real-scale 3-D reconstruction. Experimental results have demonstrated that our method achieves good performance on monocular 3-D reconstruction with the real scale.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Real-Scale 3D Reconstruction with Monocular Zoom Technology
    Song, Jinao
    Li, Jie
    Fan, Hao
    Qi, Lin
    Zhang, Shu
    Chen, Yong
    Dong, Junyu
    IEEE Transactions on Instrumentation and Measurement, 2024,
  • [2] MonoPLFlowNet: Permutohedral Lattice FlowNet for Real-Scale 3D Scene Flow Estimation with Monocular Images
    Li, Runfa
    Nguyen, Truong
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 322 - 339
  • [3] 3-D Analysis of Electromagnetic Forces of a Real-Scale Superconducting Linear Synchronous Motor for EDS Train
    Zhao, Zhengwei
    Ma, Guangtong
    Liu, Kang
    Su, Zhenhua
    Luo, Jun
    Sun, Zhenyao
    Zhang, Han
    Li, Jing
    Xu, Shuai
    Wang, Liyun
    Su, Mingle
    IEEE TRANSACTIONS ON APPLIED SUPERCONDUCTIVITY, 2021, 31 (05)
  • [4] Shape Basis Interpretation for Monocular Deformable 3-D Reconstruction
    Agudo, Antonio
    Moreno-Noguer, Francesc
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (04) : 821 - 834
  • [5] Statistical bias in 3-D reconstruction from a monocular video
    Roy-Chowdhury, AK
    Chellappa, R
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2005, 14 (08) : 1057 - 1062
  • [6] Monocular 3D scene reconstruction at absolute scale
    Woehler, Christian
    d'Angelo, Pablo
    Krueger, Lars
    Kuhl, Annika
    Gross, Horst-Michael
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2009, 64 (06) : 529 - 540
  • [7] 3-D biomodelling technology for maxillofacial reconstruction
    Oliveira, Manuel
    Hussain, N. Sooraj
    Dias, A. G.
    Lopes, M. A.
    Azevedo, Luis
    Zenha, Horacio
    Costa, Horacio
    Santos, J. D.
    MATERIALS SCIENCE & ENGINEERING C-BIOMIMETIC AND SUPRAMOLECULAR SYSTEMS, 2008, 28 (08): : 1347 - 1351
  • [8] 3-d reconstruction from sparse views using monocular vision
    Saxena, Ashutosh
    Sun, Min
    Ng, Andrew Y.
    2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 3020 - 3027
  • [9] 3-D GRAPHICS GO ZOOM
    LOVERIA, G
    BYTE, 1995, 20 (09): : 243 - 244
  • [10] Obstacle detection and road segmentation by 3-D reconstruction based on monocular vision
    Yu, Hong
    Wang, Zhengyou
    Hong, Ruxia
    Journal of Chemical and Pharmaceutical Research, 2014, 6 (07) : 1333 - 1340