Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality

被引:3
|
作者
Zhang, Hanqi [1 ]
Wang, Jing [1 ]
Li, Zhuoran [2 ]
Li, Jingxin [3 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Beijing 100811, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100045, Peoples R China
[3] China Elect Standardizat Inst, Beijing 101102, Peoples R China
基金
中国国家自然科学基金;
关键词
virtual reality; immersive communication; VR conference room; panoramic live broadcast; spatial audio; PANORAMIC VIDEO; CONFERENCES;
D O I
10.3390/electronics12051134
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the impact of the COVID-19 pandemic in recent years, remote communication has become increasingly common, which has also spawned many online solutions. Compared with an in-person scenario, the feeling of immersion and participation is lacking in these solutions, and the effect is thus not ideal. In this study, we focus on two typical virtual reality (VR) application scenarios with immersive audio and video experience: VR conferencing and panoramic live broadcast. We begin by introducing the core principles of traditional video conferencing, followed by the existing research results of VR conferencing along with the similarities, differences, pros, and cons of each solution. Then, we outline our view about what elements a virtual conferencing room should have. After that, a simple implementation scheme for VR conferencing is provided. Regarding panoramic video, we introduce the steps to produce and transmit a panoramic live broadcast and analyze several current mainstream encoding optimization schemes. By comparing traditional video streams, the various development bottlenecks of panoramic live broadcast are identified and summarized. A simple implementation of a panoramic live broadcast is presented in this paper. To conclude, the main points are illustrated along with the possible future directions of the two systems. The simple implementation of two immersive systems provides a research and application reference for VR audio and video transmission, which can guide subsequent relevant research studies.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Design and Implementation of an Immersive Virtual Reality System based on a Smartphone Platform
    Steed, Anthony
    Julier, Simon
    [J]. 2013 IEEE SYMPOSIUM ON 3D USER INTERFACES (3DUI), 2013, : 43 - 46
  • [2] Video Based Augmented Reality For Immersive Virtual Reality System
    Kim, Young-Yong
    Kim, Jun-Sik
    Park, Jung-Min
    [J]. 2015 12TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2015, : 177 - 181
  • [3] Headphone-Based Immersive Audio for Virtual Reality Headsets
    Yao, Shu-Nung
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2017, 63 (03) : 300 - 308
  • [4] Immersive audio programming in a virtual reality sandbox
    Andersson, Nikolaj
    Erkut, Cumhur
    Serafin, Stefania
    [J]. 2019 AES INTERNATIONAL CONFERENCE ON IMMERSIVE AND INTERACTIVE AUDIO, 2019,
  • [5] Implementation on the website design using immersive virtual reality technology
    Lin, Hung-Lin
    Lin, Tsung-Yi
    Huang, Xing-Cheng
    Tsai, Jen-Hao
    Wang, Ming-Bo
    Chen, Sheng-Yun
    Hong, Qian-Hui
    [J]. PROCEEDINGS OF THE 2017 IEEE INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATION AND ENGINEERING (IEEE-ICICE 2017), 2017, : 197 - 199
  • [6] Immersive virtual reality for science learning: Design, implementation, and evaluation
    Matovu, Henry
    Ungu, Dewi Ayu Kencana
    Won, Mihye
    Tsai, Chin-Chung
    Treagust, David F.
    Mocerino, Mauro
    Tasker, Roy
    [J]. STUDIES IN SCIENCE EDUCATION, 2023, 59 (02) : 205 - 244
  • [7] Application of Full Immersive Virtual Reality Technology to Architectural Design Communication
    Huang, Ying-Hua
    Chen, Jia-Qi
    [J]. Journal of the Chinese Institute of Civil and Hydraulic Engineering, 2019, 31 (02): : 141 - 152
  • [8] Principles for the design of a history and heritage game based on the evaluation of immersive virtual reality video games
    Egea-Vivancos, Alejandro
    Arias-Ferrer, Laura
    [J]. E-LEARNING AND DIGITAL MEDIA, 2021, 18 (04) : 383 - 402
  • [9] Multichannel Audio Implementation for Virtual Reality
    Kim, Sungsoo
    Sridhar, Sripathi
    [J]. 2019 AES INTERNATIONAL CONFERENCE ON IMMERSIVE AND INTERACTIVE AUDIO, 2019,
  • [10] "Dawn of South Lake"-Design and Implementation of Immersive Interactive System Based on Virtual Reality Technology
    Yan Huimin
    Liu Huaqun
    Lu Yang
    Li Tong
    Qiu Xiaofeng
    [J]. 2021 THE 3RD INTERNATIONAL CONFERENCE ON BIG DATA ENGINEERING AND TECHNOLOGY, BDET 2021, 2021, : 88 - 93