LAMP: 3D layered, adaptive-resolution, and multi-perspective panorama - a new scene representation

被引:12
|
作者
Zhu, ZG [1 ]
Hanson, AR
机构
[1] CUNY City Coll, Dept Comp Sci, New York, NY 10031 USA
[2] Univ Massachusetts, Dept Comp Sci, Amherst, MA 01003 USA
基金
美国国家科学基金会;
关键词
image-based modeling and rendering; layered representation; multi-resolution; multi-image processing; spatio-temporal image; epipolar plane image;
D O I
10.1016/j.cviu.2004.03.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A compact visual representation, called the 3D layered, adaptive-resolution, and multi-perspective panorama (LAMP), is proposed for representing large-scale 3D scenes with large variations of depths and obvious occlusions. Two kinds of 3D LAMP representations are proposed: the relief-like LAMP and the image-based LAMP. Both types of LAMPs concisely represent almost all the information from a long image sequence. Methods to construct LAMP representations from video sequences with dominant translation are provided. The relief-like LAMP is basically a single extended multi-perspective panoramic view image. Each pixel has a pair of texture and depth values, but each pixel may also have multiple pairs of texture-depth values to represent occlusion in layers, in addition to adaptive resolution changing with depth. The image-based LAMP, on the other hand, consists of a set of multi-perspective layers, each of which has a pair of 2D texture and depth maps, but with adaptive time-sampling scales depending on depths of scene points. Several examples of 3D LAMP construction for real image sequences are given. The 3D LAMP is a concise and powerful representation for image-based rendering. (C) 2004 Elsevier Inc. All rights reserved.
引用
收藏
页码:294 / 326
页数:33
相关论文
共 50 条
  • [31] Deep fusion of multi-view and multimodal representation of ALS point cloud for 3D terrain scene recognition
    Qin, Nannan
    Hu, Xiangyun
    Dai, Hengming
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 143 : 205 - 212
  • [32] 3D Move to See: Multi-perspective visual servoing towards the next best view within unstructured and occluded environments
    Lehnert, Chris
    Tsai, Dorian
    Eriksson, Anders
    McCool, Chris
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 3890 - 3897
  • [33] MFGaussian: multi-modal data fusion based 3D Gaussian splatting for accurate and robust scene representation
    Yang, Ran
    Liu, Yang
    Zhong, Ruofei
    Wei, Zhanying
    Xu, Mengbing
    Liu, Shuai
    Yan, Peng
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2025, 18 (01)
  • [34] Adaptive multi-resolution 3D Hartree-Fock-Bogoliubov solver for nuclear structure
    Pei, J. C.
    Fann, G. I.
    Harrison, R. J.
    Nazarewicz, W.
    Shi, Yue
    Thornton, S.
    PHYSICAL REVIEW C, 2014, 90 (02):
  • [35] Adaptive Multi-Resolution Method for 3D Reactive Flows with Level Set Front Capturing
    Ma, Wenhua
    Luo, Dongmi
    Ying, Wenjun
    Ni, Guoxi
    Xiao, Min
    Chen, Yibing
    COMMUNICATIONS IN COMPUTATIONAL PHYSICS, 2023, 33 (03) : 849 - 883
  • [36] A MULTI-PERSPECTIVE APPROACH TO INTERPRETING SPATIO-SEMANTIC CHANGES OF LARGE 3D CITY MODELS IN CITYGML USING A GRAPH DATABASE
    Nguyen, Son H.
    Kolbe, Thomas H.
    ISPRS TC IV 3RD BIM/GIS INTEGRATION WORKSHOP AND 15TH 3D GEOINFO CONFERENCE 2020, 2020, 6-4 (W1): : 143 - 150
  • [37] Generating Orthorectified Multi-Perspective 2.5D Maps to Facilitate Web GIS-Based Visualization and Exploitation of Massive 3D City Models
    Liang, Jianming
    Gong, Jianhua
    Liu, Jin
    Zou, Yuling
    Zhang, Jinming
    Sun, Jun
    Chen, Shuisen
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2016, 5 (11):
  • [38] Local Multi-Resolution Representation for 6D Motion Estimation and Mapping with a Continuously Rotating 3D Laser Scanner
    Droeschel, David
    Stueckler, Joerg
    Behnke, Sven
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2014, : 5221 - 5226
  • [39] Learning High-Resolution Vector Representation from Multi-camera Images for 3D Object Detection
    Chen, Zhili
    Xu, Shuangjie
    Ye, Maosheng
    Qian, Zian
    Zou, Xiaoyi
    Yeung, Dit-Yan
    Chen, Qifeng
    COMPUTER VISION-ECCV 2024, PT XXXV, 2025, 15093 : 385 - 403
  • [40] Large-Scale Semantic 3D Reconstruction: an Adaptive Multi-Resolution Model for Multi-Class Volumetric Labeling
    Blaha, Maros
    Vogel, Christoph
    Richard, Audrey
    Wegner, Jan D.
    Pock, Thomas
    Schindler, Konrad
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3176 - 3184