Immersive audio programming in a virtual reality sandbox

被引:0
|
作者
Andersson, Nikolaj [1 ]
Erkut, Cumhur [1 ]
Serafin, Stefania [1 ]
机构
[1] Aalborg Univ, Dept Architecture Design & Media Technol, Multisensory Experience Lab, Copenhagen, Denmark
关键词
OF-THE-ART;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] VRBox: A Virtual Reality Augmented Sandbox for Immersive Playfulness, Creativity and Exploration
    Froehlich, Thomas
    Alexandrovsky, Dmitry
    Stabbert, Timo
    Doering, Tanja
    Malaka, Rainer
    PROCEEDINGS OF THE 2018 ANNUAL SYMPOSIUM ON COMPUTER-HUMAN INTERACTION IN PLAY (CHI PLAY 2018), 2018, : 153 - 162
  • [2] Immersive WYSIWYG virtual meteorological sandbox
    Hu, Hao
    Wang, Song
    Chen, Yonghui
    2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY ADJUNCT (ISMAR-ADJUNCT 2022), 2022, : 131 - 138
  • [3] Headphone-Based Immersive Audio for Virtual Reality Headsets
    Yao, Shu-Nung
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2017, 63 (03) : 300 - 308
  • [4] PokeDotz: a fun, immersive and interactive mathematical sandbox with rich feature numbers representations in virtual reality
    Botana, Paloma L. H.
    Dias, Alexandre Y. G.
    da Costa, Luis G. F.
    Nagamura, Mario R.
    Barbosa, Ellen L.
    Vidal, Gabriela B.
    Lopes, Roseli D.
    Zuffo, Marcelo K.
    Borba, Eduardo Zilles
    2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW 2024, 2024, : 1104 - 1105
  • [5] MPEG-I Immersive Audio - Reference Model For The Virtual/Augmented Reality Audio Standard
    Herre, Juergen
    Disch, Sascha
    JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2023, 71 (05): : 229 - 240
  • [6] IVMS: An immersive virtual meteorological sandbox based on WYSIWYG
    Hu, Hao
    Wang, Song
    Chen, Yonghui
    VISUAL INFORMATICS, 2023, 7 (04) : 100 - 109
  • [7] Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality
    Zhang, Hanqi
    Wang, Jing
    Li, Zhuoran
    Li, Jingxin
    ELECTRONICS, 2023, 12 (05)
  • [8] Acoustic Filter New Virtual Reality Audio Format Pretends to Enhance Immersive Experience
    Llorca, Josep
    Redondo, Ernesto
    Valls, Francesc
    Fonseca, David
    Villagrasa, Sergi
    LEARNING AND COLLABORATION TECHNOLOGIES: NOVEL LEARNING ECOSYSTEMS, LCT 2017, PT I, 2017, 10295 : 22 - 33
  • [9] Immersive virtual reality and environmental noise assessment: An innovative audio-visual approach
    Ruotolo, Francesco
    Maffei, Luigi
    Di Gabriele, Maria
    Iachini, Tina
    Masullo, Massimiliano
    Ruggiero, Gennaro
    Senese, Vincenzo Paolo
    ENVIRONMENTAL IMPACT ASSESSMENT REVIEW, 2013, 41 : 10 - 20
  • [10] Immersive Experience and Virtual Reality
    Balcerak Jackson M.
    Balcerak Jackson B.
    Philosophy & Technology, 2024, 37 (1)