Wand: 360? video projection mapping using a 360? camera

被引:0
|
作者
Lee, Jungjin [1 ]
机构
[1] Soongsil Univ, Global Sch Media, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Video projection; Projection mapping; Virtual reality; Multi-projector display; Automatic geometric registration; 360-degree camera; REGISTRATION;
D O I
10.1007/s10055-023-00791-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In a surrounding projection-based display environment (e.g., a dome theater), the viewers can enjoy a 360(?) video with a strong sense of immersion. Building a thriving immersive environment requires two sophisticated steps. First, to generate a single seamless screen, multiple projectors constituting the surrounding display should be carefully registered to the surface. Second, a 360(?) video should be mapped to the projection area by considering the display surface geometry and a sweet spot (i.e., a reference viewing position) to allow viewers to perceive the correct perspectives. In this study, Wand, a novel system utilizing a consumer 360(?) spherical camera as a calibration device, is proposed to efficiently solve these two issues. Wand first establishes correspondences between the 360(?) camera and projectors using structured light patterns, and then filters out any outliers using heuristic criteria. Next, by assuming that the camera is positioned in a sweet spot, Wand solves the geometric registration of the projectors by formulating it as a simple 2D grid mesh parameterization with the correspondence constraints. Consequently, each projector mesh is directly registered into the spherical coordinates, allowing each projector to easily render a perspective-correct view from a 360(?) video. We applied Wand to various environments of different dimensions and shapes. The results demonstrate that our method can be used to successfully build seamless and immersive displays and provide correct perspectives at a sweet spot.
引用
收藏
页码:2015 / 2027
页数:13
相关论文
共 50 条
  • [41] SALI360: Design and Implementation of Saliency based Video Compression for 360° Video Streaming
    Baek, Duin
    Kang, Hangil
    Ryoo, Jihoon
    MMSYS'20: PROCEEDINGS OF THE 2020 MULTIMEDIA SYSTEMS CONFERENCE, 2020, : 141 - 152
  • [42] Camera360的拒绝
    顾锐
    商界(评论), 2013, (02) : 130 - 132
  • [43] INTERACTIVE EDUCATIONAL EXPERIENCES: 360° CAMERA
    Pasqua, S.
    Moriconi, A.
    12TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION (ICERI2019), 2019, : 6445 - 6448
  • [44] Efficient Methods of Inactive Regions Padding for Segmented Sphere Projection (SSP) of 360 Video
    Yoon, Yong-Uk
    Ahn, Yong-Jo
    Sim, Donggyu
    Kim, Jae-Gon
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (11): : 2836 - 2839
  • [45] 360NorVic: 360-Degree Video Classification from Mobile Encrypted Video Traffic
    Kattadige, Chamara
    Raman, Aravindh
    Thilakarathna, Kanchana
    Lutu, Andra
    Perino, Diego
    PROCEEDINGS OF THE 31ST ACM WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO (NOSSDAV '21), 2021, : 59 - 65
  • [46] EGOK360: A 360 EGOCENTRIC KINETIC HUMAN ACTIVITY VIDEO DATASET
    Bhandari, Keshav
    DeLaGarza, Mario A.
    Zong, Ziliang
    Latapie, Hugo
    Yan, Yan
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 266 - 270
  • [47] 360-Degree Video Streaming Using Stitching Information
    Seo, Bong-Seok
    Jeong, Eunyoung
    Hyun, ChangJong
    You, Dongho
    Kim, Dong Ho
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2019,
  • [48] 360 DEGREES VIDEO CODING USING REGION ADAPTIVE SMOOTHING
    Budagavi, Madhukar
    Furton, John
    Jin, Guoxin
    Saxena, Ankur
    Wilkinson, Jeffrey
    Dickerson, Andrew
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 750 - 754
  • [49] Adaptive 360-Degree Video Streaming using Scalable Video Coding
    Nasrabadi, Afshin Taghavi
    Mahzari, Anahita
    Beshay, Joseph D.
    Prakash, Ravi
    PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1689 - 1697
  • [50] Adaptive 360-Degree Video Streaming using Layered Video Coding
    Nasrabadi, Afshin Taghavi
    Mahzari, Anahita
    Beshay, Joseph D.
    Prakash, Ravi
    2017 IEEE VIRTUAL REALITY (VR), 2017, : 347 - 348