Alive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

被引:5
|
作者
Lyu, Zhuoyue [1 ]
Li, Jiannan [1 ]
Wang, Bryan [1 ]
机构
[1] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
关键词
artificial intelligence; virtual reality; human-computer interaction; sonification; visualization;
D O I
10.1109/AIVR52153.2021.00057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present Alive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". Alive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, Alive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.
引用
收藏
页码:251 / 255
页数:5
相关论文
共 50 条
  • [41] Virtual reality hardware for use in interactive 3D data fusion and visualization
    Gourley, CS
    Abidi, MA
    SENSOR FUSION AND DECENTRALIZED CONTROL IN AUTONOMOUS ROBOTIC SYSTEMS, 1997, 3209 : 281 - 291
  • [42] Data and knowledge visualization with virtual reality spaces, neural networks and rough sets: Application to cancer and geophysical prospecting data
    Valdes, Julio J.
    Romero, Enrique
    Barton, Alan J.
    EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (18) : 13193 - 13201
  • [43] Interactive spatial sonification for non-visual exploration of virtual maps
    Geronazzo, Michele
    Bedin, Alberto
    Brayda, Luca
    Campus, Claudio
    Avanzini, Federico
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2016, 85 : 4 - 15
  • [44] Environmental Histories and Personal Memory Collaborative Works in Sonification and Virtual Reality
    Graham, Richard
    LEONARDO MUSIC JOURNAL, 2017, 27 : 51 - 53
  • [45] Story visualization for interactive virtual environment
    Mehdi, QH
    Zeng, X
    Gough, NE
    PROCEEDINGS OF THE ISCA 12TH INTERNATIONAL CONFERENCE INTELLIGENT AND ADAPTIVE SYSTEMS AND SOFTWARE ENGINEERING, 2003, : 20 - 24
  • [46] Retrofitting Realities: Affordances and Limitations in Porting an Interactive Geospatial Visualization from Augmented to Virtual Reality
    Richardson, Matt
    Jacoby, Derek
    Coady, Yvonne
    2018 IEEE 9TH ANNUAL INFORMATION TECHNOLOGY, ELECTRONICS AND MOBILE COMMUNICATION CONFERENCE (IEMCON), 2018, : 1081 - 1087
  • [47] Interactive virtual reality visualization for a three-dimensional earth's ionosphere simulation problem
    Al-Sharaeh, SH
    Montgomry, J
    COMPUTER APPLICATIONS IN INDUSTRY AND ENGINEERING, 2003, : 189 - 192
  • [48] Interactive stereoscopic full-color direct volume visualization for virtual reality applications in medicine
    Gées, VPD
    Machado, LD
    Cabral, MC
    Leitao, RBV
    Lopes, RD
    Zuffo, MK
    MEDICINE MEETS VIRTUAL REALITY 2001: OUTER SPACE, INNER SPACE, VIRTUAL SPACE, 2001, 81 : 161 - 167
  • [49] Visualization of Software Architectures in Virtual Reality and Augmented Reality
    Schreiber, Andreas
    Nafeie, Lisa
    Baranowski, Artur
    Seipel, Peter
    Misiak, Martin
    2019 IEEE AEROSPACE CONFERENCE, 2019,
  • [50] Virtual Reality for Crime Scene Visualization
    Engstrom, Philip
    THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2018, 2018, 10666