Interactive free-viewpoint video generation

被引：2
|
作者：
Wang Y. [1 ]
Huang Z. [1 ]
Zhu H. [1 ]
Li W. [2 ]
Cao X. [1 ]
Yang R. [3 ]
机构：
[1] School of Electronic Science and Engineering, Nanjing University, Nanjing
[2] Center on Frontiers of Computing Studies, Peking University, Beijing
[3] Department of Computer Science, University of Kentucky, Lexington, 40506, KY
来源：
Virtual Reality and Intelligent Hardware | 2020年 / 2卷 / 03期
关键词：
Free-viewpoint video; Interactive interface; View interpolation;
D O I：
10.1016/j.vrih.2020.04.004
中图分类号：
学科分类号：
摘要：
Background: Free-viewpoint video (FVV) is processed video content in which viewers can freely select the viewing position and angle. FVV delivers an improved visual experience and can also help synthesize special effects and virtual reality content. In this paper, a complete FVV system is proposed to interactively control the viewpoints of video relay programs through multimedia terminals such as computers and tablets. Methods: The hardware of the FVV generation system is a set of synchronously controlled cameras, and the software generates videos in novel viewpoints from the captured video using view interpolation. The interactive interface is designed to visualize the generated video in novel viewpoints and enable the viewpoint to be changed interactively. Results: Experiments show that our system can synthesize plausible videos in intermediate viewpoints with a view range of up to 180°. © 2019 Beijing Zhongke Journal Publishing Co. Ltd
引用
收藏
页码：247 / 260
页数：13
相关论文
共 50 条
  • [1] Interactive collision detection for free-viewpoint video
    De Decker, Bert
    Mertens, Tom
    Bekaert, Philippe
    GRAPP 2007: PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL AS/IE, 2007, : 114 - 120
  • [2] A client driven interactive free-viewpoint video system
    Yang, You
    Yu, Mei
    Jiang, Gangyi
    Peng, Zongju
    RECENT ADVANCES IN SYSTEMS, COMMUNICATIONS AND COMPUTERS, 2008, : 206 - +
  • [3] Efficient Neural Radiance Fields for Interactive Free-viewpoint Video
    Lin, Haotong
    Peng, Sida
    Xu, Zhen
    Yan, Yunzhi
    Shuai, Qing
    Bao, Hujun
    Zhou, Xiaowei
    PROCEEDINGS SIGGRAPH ASIA 2022, 2022,
  • [4] Reflectance Estimation for Free-viewpoint Video
    Ash, George
    Tomori, Juraj
    Pelton, Mike
    Dupont, Charles
    SIGGRAPH '21: ACM SIGGRAPH 2021 POSTERS, 2021,
  • [5] Free-viewpoint video of human actors
    Carranza, J
    Theobalt, C
    Magnor, MA
    Seidel, HP
    ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03): : 569 - 577
  • [6] Rendering of Free-viewpoint Video on the Cloud
    Mallia, Mark
    Debono, Carl James
    17TH IEEE INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES - IEEE EUROCON 2017 CONFERENCE PROCEEDINGS, 2017, : 9 - 14
  • [7] Unconstrained free-viewpoint video coding
    Lamboray, E
    Würmlin, S
    Waschbüsch, M
    Gross, M
    Pfister, H
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 3261 - 3264
  • [8] Free-viewpoint Image Generation from a Video Captured by a Handheld Camera
    Takeuchi, Kota
    Fukushima, Norishige
    Yendo, Tomohiro
    Tehrani, Mehrdad Panahpour
    Fujii, Toshiaki
    Tanimoto, Masayuki
    STEREOSCOPIC DISPLAYS AND APPLICATIONS XXII, 2011, 7863
  • [9] FreeCast: Graceful Free-Viewpoint Video Delivery
    Fujihashi, Takuya
    Koike-Akino, Toshiaki
    Watanabe, Takashi
    Orlik, Philip V.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (04) : 1000 - 1010
  • [10] OPTIMIZATION OF DISTRIBUTED FREE-VIEWPOINT VIDEO SYNTHESIS
    Huszak, Arpad
    2014 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2014,
12345