LAMP: 3D layered, adaptive-resolution, and multi-perspective panorama - a new scene representation

被引:12
|
作者
Zhu, ZG [1 ]
Hanson, AR
机构
[1] CUNY City Coll, Dept Comp Sci, New York, NY 10031 USA
[2] Univ Massachusetts, Dept Comp Sci, Amherst, MA 01003 USA
基金
美国国家科学基金会;
关键词
image-based modeling and rendering; layered representation; multi-resolution; multi-image processing; spatio-temporal image; epipolar plane image;
D O I
10.1016/j.cviu.2004.03.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A compact visual representation, called the 3D layered, adaptive-resolution, and multi-perspective panorama (LAMP), is proposed for representing large-scale 3D scenes with large variations of depths and obvious occlusions. Two kinds of 3D LAMP representations are proposed: the relief-like LAMP and the image-based LAMP. Both types of LAMPs concisely represent almost all the information from a long image sequence. Methods to construct LAMP representations from video sequences with dominant translation are provided. The relief-like LAMP is basically a single extended multi-perspective panoramic view image. Each pixel has a pair of texture and depth values, but each pixel may also have multiple pairs of texture-depth values to represent occlusion in layers, in addition to adaptive resolution changing with depth. The image-based LAMP, on the other hand, consists of a set of multi-perspective layers, each of which has a pair of 2D texture and depth maps, but with adaptive time-sampling scales depending on depths of scene points. Several examples of 3D LAMP construction for real image sequences are given. The 3D LAMP is a concise and powerful representation for image-based rendering. (C) 2004 Elsevier Inc. All rights reserved.
引用
收藏
页码:294 / 326
页数:33
相关论文
共 50 条
  • [1] PANORAMIC 3D RECONSTRUCTION USING STEREO MULTI-PERSPECTIVE PANORAMA
    Jiang, Wei
    Sugimoto, Shigeki
    Okutomi, Masatoshi
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2010, 24 (06) : 867 - 896
  • [2] 3D LAMP: A new layered panoramic representation
    Zhu, ZG
    Hanson, AR
    EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, 2001, : 723 - 730
  • [3] Multi-perspective 3D panoramas
    Pasewaldt, Sebastian
    Semmo, Amir
    Trapp, Matthias
    Doellner, Juergen
    INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2014, 28 (10) : 2030 - 2051
  • [4] Multi-perspective and multi-modality joint representation and recognition model for 3D action recognition
    Gao, Z.
    Zhang, H.
    Xu, G. P.
    Xue, Y. B.
    NEUROCOMPUTING, 2015, 151 : 554 - 564
  • [5] Multi-perspective SAR to 3D Translation using Generative AI
    Newey, Michael
    Kuczynski, James
    Laher, Rebecca
    Chan, Michael
    Vasile, Alexandru
    2024 IEEE RADAR CONFERENCE, RADARCONF 2024, 2024,
  • [6] 3D reconstruction of typical entities based on multi-perspective images
    Liang, Haiyun
    Liu, Ming
    Hui, Mei
    Zhao, Yuejin
    Dong, Liquan
    Kong, Lingqin
    OPTICAL METROLOGY AND INSPECTION FOR INDUSTRIAL APPLICATIONS IX, 2022, 12319
  • [7] 3D Measurement of Yarn Hairiness via Multi-perspective Images
    Wang, Lei
    Xu, Bugao
    Gao, Weidong
    OPTICS, PHOTONICS, AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS V, 2018, 10679
  • [8] Interactive Multi-Perspective Views of Virtual 3D Landscape and City Models
    Lorenz, Haik
    Trapp, Matthias
    Doellner, Juergen
    Jobst, Markus
    EUROPEAN INFORMATION SOCIETY: TAKING GEOINFORMATION SCIENCE ONE STEP FURTHER, 2009, : 301 - +
  • [9] A Multi-Perspective 3D Reconstruction Method with Single Perspective Instantaneous Target Attitude Estimation
    Xu, Dan
    Xing, Mengdao
    Xia, Xiang-Gen
    Sun, Guang-Cai
    Fu, Jixiang
    Su, Tao
    REMOTE SENSING, 2019, 11 (11)
  • [10] 3D Multi-perspective Depth Detection Using Point Clouds and Machine Learning
    Esteves, Andrew
    Bickford, Harry
    Yang, Jaesung
    Shen, Xin
    Sohn, Kiwon
    THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2024, 2024, 13041