Real-Scale 3-D Reconstruction With Monocular Zoom Technology

被引:0
|
作者
Song, Jinao [1 ]
Li, Jie [1 ]
Fan, Hao [1 ]
Qi, Lin [1 ]
Zhang, Shu [1 ]
Chen, Yong [1 ]
Dong, Junyu [1 ]
机构
[1] Ocean Univ China, Dept Informat Sci & Technol, Qingdao 266000, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Accuracy; Structure from motion; Design methodology; Cameras; Image restoration; Image reconstruction; Monocular zooming; optical flow; real-scale 3-D reconstruction;
D O I
10.1109/TIM.2024.3497052
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a method that is able to use the monocular zoom technology for real-scale 3-D reconstruction of the scene. To reconstruct the scene, we take a sequence of zoomed-in and zoomed-out figures. First, we can estimate zoomed-in camera parameters using the known zoomed-out camera parameters, which avoids calibrating the camera parameters twice. Then, we use the structure from motion (SfM) method (COLMAP) to reconstruct free-scale translations among these figures. After that, as we have pairs of zoom frames in the same scene, we can calculate the true scale of the scene by comparing the ratio between the free-scale translation of a pair of zoom frames and the difference in zoomed-out and the zoomed-in focal length. Finally, we use RAFT-stereo to compute the depth of the scene. In detail, we select two adjacent figures taken at the same focal length, make a stereo correction for them, and remove the nonco-vision area of the corrected images. This way, we obtain a more accurate matching of these images and then get a dense real-scale 3-D reconstruction. Experimental results have demonstrated that our method achieves good performance on monocular 3-D reconstruction with the real scale.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Monocular 3-D Gait Tracking in Surveillance Scenes
    Rogez, Gregory
    Rihan, Jonathan
    Guerrero, Jose J.
    Orrite, Carlos
    IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (06) : 894 - 909
  • [32] 3-D LiDAR and Monocular Camera Calibration: A Review
    Zhang, Haoxin
    Li, Shuaixin
    Zhu, Xiaozhou
    Chen, Hongbo
    Yao, Wen
    IEEE SENSORS JOURNAL, 2025, 25 (07) : 10530 - 10555
  • [34] NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video
    Sun, Jiaming
    Xie, Yiming
    Chen, Linghao
    Zhou, Xiaowei
    Bao, Hujun
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15593 - 15602
  • [35] PanoRecon: Real-Time Panoptic 3D Reconstruction from Monocular Video
    Wu, Dong
    Yan, Zike
    Zha, Hongbin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 21507 - 21518
  • [36] A High-Performance Learning-Based Framework for Monocular 3-D Point Cloud Reconstruction
    Zamani, AmirHossein
    Ghaffari, Kamran
    Aghdam, Amir G.
    IEEE JOURNAL OF RADIO FREQUENCY IDENTIFICATION, 2024, 8 : 695 - 712
  • [37] Monocular-based 3-D seafloor reconstruction and ortho-mosaicing by piecewise planar representation
    Nicosevici, Tudor
    Negahdaripour, Shahriar
    Garcia, Rafael
    OCEANS 2005, VOLS 1-3, 2005, : 1279 - 1286
  • [38] Reconstruction of 3-D horizons from 3-D seismic datasets
    Blinov, A
    Petrou, M
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (06): : 1421 - 1431
  • [39] Review of the 3D reconstruction technology based on optical flow of monocular image sequence
    Zhang C.-X.
    Chen Z.
    Li M.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2016, 44 (12): : 3044 - 3052
  • [40] MuSR: MULTI-SCALE 3D SCENES RECONSTRUCTION BASED ON MONOCULAR VIDEO
    Gao, Han
    Wu, Hao
    Dong, Peiwen
    Xu, Yixin
    Xu, Fengyuan
    Zhong, Sheng
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 2840 - 2844