Real-Scale 3-D Reconstruction With Monocular Zoom Technology

被引:0
|
作者
Song, Jinao [1 ]
Li, Jie [1 ]
Fan, Hao [1 ]
Qi, Lin [1 ]
Zhang, Shu [1 ]
Chen, Yong [1 ]
Dong, Junyu [1 ]
机构
[1] Ocean Univ China, Dept Informat Sci & Technol, Qingdao 266000, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Accuracy; Structure from motion; Design methodology; Cameras; Image restoration; Image reconstruction; Monocular zooming; optical flow; real-scale 3-D reconstruction;
D O I
10.1109/TIM.2024.3497052
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a method that is able to use the monocular zoom technology for real-scale 3-D reconstruction of the scene. To reconstruct the scene, we take a sequence of zoomed-in and zoomed-out figures. First, we can estimate zoomed-in camera parameters using the known zoomed-out camera parameters, which avoids calibrating the camera parameters twice. Then, we use the structure from motion (SfM) method (COLMAP) to reconstruct free-scale translations among these figures. After that, as we have pairs of zoom frames in the same scene, we can calculate the true scale of the scene by comparing the ratio between the free-scale translation of a pair of zoom frames and the difference in zoomed-out and the zoomed-in focal length. Finally, we use RAFT-stereo to compute the depth of the scene. In detail, we select two adjacent figures taken at the same focal length, make a stereo correction for them, and remove the nonco-vision area of the corrected images. This way, we obtain a more accurate matching of these images and then get a dense real-scale 3-D reconstruction. Experimental results have demonstrated that our method achieves good performance on monocular 3-D reconstruction with the real scale.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] A wafer-scale 3-D circuit integration technology
    Burns, James A.
    Aull, Brian F.
    Chen, Chenson K.
    Chen, Chang-Lee
    Keast, Craig L.
    Knecht, Jeffrey M.
    Suntharalingam, Vyshnavi
    Warner, Keith
    Wyatt, Peter W.
    Yost, Donna-Ruth W.
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2006, 53 (10) : 2507 - 2516
  • [22] 3-D model localization using high-resolution reconstruction of monocular image sequences
    Serra, B
    Berthod, M
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 1997, 6 (01) : 175 - 188
  • [23] 3-D Semantic Terrain Reconstruction of Monocular Close-Up Images of Martian Terrains
    Tian, Pengzhi
    Yao, Meibao
    Xiao, Xueming
    Zheng, Bo
    Cao, Tao
    Xi, Yurong
    Liu, Haiqiang
    Cui, Hutao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [24] Computational Analysis of 3D Lattice Structures for Skin in Real-Scale Camber Morphing Aircraft
    Alsaidi, Bashir
    Joe, Woong Yeol
    Akbar, Muhammad
    AEROSPACE, 2019, 6 (07)
  • [25] Real-time depth warping for 3-D scene reconstruction
    UNC Chapel Hill, Chapel Hill, United States
    IEEE Aerosp Appl Conf Proc, (413-419):
  • [26] A 3D Biohybrid Real-Scale Model of the Brain Cancer Microenvironment for Advanced In Vitro Testing
    Tricinci, Omar
    De Pasquale, Daniele
    Marino, Attilio
    Battaglini, Matteo
    Pucci, Carlotta
    Ciofani, Gianni
    ADVANCED MATERIALS TECHNOLOGIES, 2020, 5 (10):
  • [27] Concurrent 3-D motion segmentation and 3-D interpretation of temporal sequences of monocular images
    Sekkati, H
    Mitiche, A
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (03) : 641 - 653
  • [28] 3-D Reconstruction System
    Cseri, O. E.
    Kerti, A.
    Vamossy, Z.
    2009 7TH INTERNATIONAL SYMPOSIUM ON INTELLIGENT SYSTEMS AND INFORMATICS, 2009, : 156 - 160
  • [29] MonoPSTR: Monocular 3-D Object Detection With Dynamic Position and Scale-Aware Transformer
    Yang, Fan
    He, Xuan
    Chen, Wenrui
    Zhou, Pengjie
    Li, Zhiyong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 1
  • [30] 3-D head pose estimation for monocular image
    Pan, YJ
    Zhu, H
    Ji, RR
    FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, PT 2, PROCEEDINGS, 2005, 3614 : 293 - 301