Real-Scale 3-D Reconstruction With Monocular Zoom Technology

被引:0
|
作者
Song, Jinao [1 ]
Li, Jie [1 ]
Fan, Hao [1 ]
Qi, Lin [1 ]
Zhang, Shu [1 ]
Chen, Yong [1 ]
Dong, Junyu [1 ]
机构
[1] Ocean Univ China, Dept Informat Sci & Technol, Qingdao 266000, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Accuracy; Structure from motion; Design methodology; Cameras; Image restoration; Image reconstruction; Monocular zooming; optical flow; real-scale 3-D reconstruction;
D O I
10.1109/TIM.2024.3497052
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a method that is able to use the monocular zoom technology for real-scale 3-D reconstruction of the scene. To reconstruct the scene, we take a sequence of zoomed-in and zoomed-out figures. First, we can estimate zoomed-in camera parameters using the known zoomed-out camera parameters, which avoids calibrating the camera parameters twice. Then, we use the structure from motion (SfM) method (COLMAP) to reconstruct free-scale translations among these figures. After that, as we have pairs of zoom frames in the same scene, we can calculate the true scale of the scene by comparing the ratio between the free-scale translation of a pair of zoom frames and the difference in zoomed-out and the zoomed-in focal length. Finally, we use RAFT-stereo to compute the depth of the scene. In detail, we select two adjacent figures taken at the same focal length, make a stereo correction for them, and remove the nonco-vision area of the corrected images. This way, we obtain a more accurate matching of these images and then get a dense real-scale 3-D reconstruction. Experimental results have demonstrated that our method achieves good performance on monocular 3-D reconstruction with the real scale.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Real-Time Stereo Vision for Road Surface 3-D Reconstruction
    Fan, Rui
    Liu, Yanan
    Yang, Xingrui
    Bocus, Mohammud Junaid
    Dahnoun, Naim
    Tancock, Scott
    2018 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2018, : 63 - 68
  • [42] Real-Time 3-D Video Reconstruction for Guidance of Transventricular Neurosurgery
    Vagdargi, Prasad
    Uneri, Ali
    Zhang, Xiaoxuan
    Jones, Craig K.
    Wu, Pengwei
    Han, Runze
    Sisniega, Alejandro
    Lee, Junghoon
    Helm, Patrick
    Luciano, Mark
    Anderson, William S.
    Hager, Gregory D.
    Siewerdsen, Jeffrey H.
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2023, 5 (03): : 669 - 682
  • [43] Real-Time 3-D Surface Reconstruction from Multiple Cameras
    Liu, Yongchun
    Gong, Huajun
    Zhang, Zhaoxing
    ADVANCES IN VISUAL COMPUTING, PT II (ISVC 2015), 2015, 9475 : 93 - 101
  • [44] 3-D reconstruction of real-world objects using extended voxels
    Steinbach, E
    Girod, B
    Eisert, P
    Betz, A
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2000, : 569 - 572
  • [45] Monocular 3D Fingerprint Reconstruction and Unwarping
    Cui, Zhe
    Feng, Jianjiang
    Zhou, Jie
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (07) : 8679 - 8695
  • [46] Monocular 3D Reconstruction of Human Body
    Zhang, Yuqi
    Li, Dewei
    Jin, Bihui
    Ku, Yunwen
    Xue, Shibei
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7889 - 7894
  • [47] A Comprehensive Exploration of Real-Time 3-D View Reconstruction Methods
    Agrawal, Arya
    Sharma, Teena
    Verma, Nishchal K.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (12): : 5915 - 5927
  • [48] Monocular Visual Odometry and 3D Reconstruction
    Prozorov, Alexandr
    Volokhov, Vladimir
    Priorov, Andrew
    PROCEEDINGS OF THE 15TH CONFERENCE OF OPEN INNOVATIONS ASSOCIATION FRUCT, 2014, : 112 - 118
  • [49] Mobile3DRecon: Real-time Monocular 3D Reconstruction on a Mobile Phone
    Yang, Xingbin
    Zhou, Liyang
    Jiang, Hanqing
    Tang, Zhongliang
    Wang, Yuanbo
    Bao, Hujun
    Zhang, Guofeng
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (12) : 3446 - 3456
  • [50] 3-D GRAPHICS TECHNOLOGY
    DEJESUS, EX
    BYTE, 1995, 20 (07): : 101 - 101