Alive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

被引:5
|
作者
Lyu, Zhuoyue [1 ]
Li, Jiannan [1 ]
Wang, Bryan [1 ]
机构
[1] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
关键词
artificial intelligence; virtual reality; human-computer interaction; sonification; visualization;
D O I
10.1109/AIVR52153.2021.00057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present Alive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". Alive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, Alive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.
引用
收藏
页码:251 / 255
页数:5
相关论文
共 50 条
  • [31] Evaluating geometrical properties of virtual shapes using interactive sonification
    Alonso, Miguel
    Shelley, Simon
    Hermes, Dik
    Kohlrausch, Armin
    2008 IEEE INTERNATIONAL WORKSHOP ON HAPTIC AUDIO VISUAL ENVIRONMENTS AND THEIR APPLICATIONS, 2008, : 154 - +
  • [32] VRPharmer: bringing virtual reality into pharmacophore-based virtual screening with interactive exploration and realistic visualization
    Liu, Shun
    Zhou, Jianchao
    Feng, Ziyan
    Zhang, Jiawen
    Li, Shuang
    Jin, Zilong
    Zhang, Chenfei
    Li, Shiliang
    He, Gaoqi
    Li, Honglin
    BIOINFORMATICS, 2022, 38 (21) : 4953 - 4955
  • [33] "Stayin' Alive": An Interactive Augmented - Reality CPR Tutorial
    Javaheri, Hamraz
    Gruenerbl, Agnes
    Monger, Eloise
    Gobbi, Mary
    Lukowicz, Paul
    PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT), 2018, : 365 - 368
  • [34] Virtual Reality in scientific visualization
    Bryson, S
    COMMUNICATIONS OF THE ACM, 1996, 39 (05) : 62 - 71
  • [35] Virtual Reality: Beyond Visualization
    El Beheiry, Mohamed
    Doutreligne, Sebastien
    Caporal, Clement
    Ostertag, Cecilia
    Dahan, Maxime
    Masson, Jean-Baptiste
    JOURNAL OF MOLECULAR BIOLOGY, 2019, 431 (07) : 1315 - 1321
  • [36] Virtual Reality for geosciences visualization
    Lin, CR
    Loftin, RB
    Stark, T
    3RD ASIA PACIFIC COMPUTER HUMAN INTERACTION, PROCEEDINGS, 1998, : 196 - 201
  • [37] Virtual reality in scientific visualization
    NASA Ames Research Cent, Moffett Field, United States
    Commun ACM, 5 (62-71):
  • [38] Interactive virtual reality on the grid
    Kranzlmüller, D
    Rosmanith, H
    Heinzlreiter, P
    Polak, M
    EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS, 2004, : 152 - 158
  • [39] Interactive Narrative in Virtual Reality
    Ostrin, Gilad
    Frey, Jeremy
    Cauchard, Jessica R.
    17TH INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS MULTIMEDIA (MUM 2018), 2018, : 463 - 467
  • [40] Embodying the Homunculus in Virtual Reality Creating an Interactive Laboratory Procedure for Brain Mapping and Visualization
    Munoz, John E.
    Montoya, Maria F.
    Lopez, David S.
    Henao, Oscar A.
    PROCEEDINGS OF THE 5TH WORKSHOP ON ICTS FOR IMPROVING PATIENTS REHABILITATION RESEARCH TECHNIQUES, REHAB'19, 2019, : 144 - 147