Alive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

被引：5
|
作者：
Lyu, Zhuoyue [1 ]
Li, Jiannan [1 ]
Wang, Bryan [1 ]
机构：
[1] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
来源：
2021 4TH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2021) | 2021年
关键词：
artificial intelligence; virtual reality; human-computer interaction; sonification; visualization;
D O I：
10.1109/AIVR52153.2021.00057
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present Alive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". Alive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, Alive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.
引用
收藏
页码：251 / 255
页数：5
相关论文
共 50 条
  • [1] Visualization of Neural Networks in Virtual Reality using UNREAL ENGINE
    Bock, Marcel
    Schreiber, Andreas
    24TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2018), 2018,
  • [2] Interactive visualization through applied virtual reality in construction
    Jones, B
    Webb, I
    1997 IEEE CONFERENCE ON INFORMATION VISUALIZATION, PROCEEDINGS: AN INTERNATIONAL CONFERENCE ON COMPUTER VISUALIZATION & GRAPHICS, 1997, : 166 - 172
  • [3] Interactive Visualization of Software Components with Virtual Reality Headsets
    Schreiber, Andreas
    Brueggemann, Marlene
    2017 IEEE WORKING CONFERENCE ON SOFTWARE VISUALIZATION (VISSOFT 2017), 2017, : 119 - 123
  • [4] Using Visualization of Convolutional Neural Networks in Virtual Reality for Machine Learning Newcomers
    Meissler, Nadine
    Wohlan, Annika
    Hochgeschwender, Nico
    Schreiber, Andreas
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR), 2019, : 152 - 158
  • [5] Virtual Reality Simulator for Sonification Studies
    Torres-Gil, M. A.
    Casanova-Gonzalez, O.
    Gonzalez-Mora, J. L.
    PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE, MAN-MACHINE SYSTEMS AND CYBERNETICS (CIMMACS '09), 2009, : 112 - +
  • [6] A Demonstrator for Interactive Image Clustering and Fine-Tuning Neural Networks in Virtual Reality
    Prange, Alexander
    Sonntag, Daniel
    ADVANCES IN ARTIFICIAL INTELLIGENCE, KI 2021, 2021, 12873 : 194 - 203
  • [7] NVIS: an interactive visualization tool for neural networks
    Streeter, M
    Ward, M
    Alvarez, SA
    VISUAL DATA EXPLORATION AND ANALYSIS VIII, 2001, 4302 : 234 - 241
  • [8] Exploration of CAD Virtual Reality Interactive Interface Design based on Deep Convolution Neural Networks
    Chen T.
    Zhang J.
    Computer-Aided Design and Applications, 2024, 21 (S25): : 124 - 140
  • [9] AN INTERACTIVE NANOMANIPULATION VISUALIZATION BASED ON MOLECULAR DYNAMICS SIMULATION AND VIRTUAL REALITY
    Chen, Chun-Ta
    Chen, Shin-Yong
    Liao, Chien-Hsiang
    Zeng, Shi-Chang
    TRANSACTIONS OF THE CANADIAN SOCIETY FOR MECHANICAL ENGINEERING, 2013, 37 (03) : 991 - 1000
  • [10] Interactive Visualization of the Retina in a 3-D Virtual Reality Environment
    Aaker, G. D.
    Myung, J. S.
    Gracia, L.
    Borcherding, V.
    Banfelder, J. R.
    D'Amico, D. J.
    Kiss, S.
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2010, 51 (13)
12345