Alive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

被引:5
|
作者
Lyu, Zhuoyue [1 ]
Li, Jiannan [1 ]
Wang, Bryan [1 ]
机构
[1] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
关键词
artificial intelligence; virtual reality; human-computer interaction; sonification; visualization;
D O I
10.1109/AIVR52153.2021.00057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present Alive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". Alive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, Alive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.
引用
收藏
页码:251 / 255
页数:5
相关论文
共 50 条
  • [21] A walk in the black-box: 3D visualization of large neural networks in virtual reality
    Christoph Linse
    Hammam Alshazly
    Thomas Martinetz
    Neural Computing and Applications, 2022, 34 : 21237 - 21252
  • [22] Data and knowledge visualization with virtual reality spaces, neural networks and rough sets:: Application to geophysical prospecting
    Valdes, Julio J.
    Romero, Enrique
    Gonzalez, Ruben
    2007 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-6, 2007, : 160 - +
  • [23] The impact of data sonification in virtual reality robot teleoperation
    Bremner, Paul
    Mitchell, Thomas J.
    McIntosh, Verity
    FRONTIERS IN VIRTUAL REALITY, 2022, 3
  • [24] Interactive 3D protein structure visualization using virtual reality
    Moritz, E
    Meyer, J
    BIBE 2004: FOURTH IEEE SYMPOSIUM ON BIOINFORMATICS AND BIOENGINEERING, PROCEEDINGS, 2004, : 503 - 507
  • [25] VIRPI: A high-level toolkit for interactive scientific visualization in virtual reality
    Germans, D
    Spoelder, HJW
    Renambot, L
    Bal, HE
    IMMERSIVE PROJECTION TECHNOLOGY AND VIRTUAL ENVIRONMENTS 2001, 2001, : 109 - 120
  • [26] Virtual reality for intelligent and interactive operating-, training- and visualization systems
    Freund, E
    Rossmann, J
    Schluse, M
    SENSOR FUSION AND DECENTRALIZED CONTROL IN ROBOTIC SYSTEMS III, 2000, 4196 : 267 - 278
  • [27] A Proposed Framework for Interactive Virtual Reality In Situ Visualization of Parallel Numerical Simulations
    Gupta, Aryaman
    Guenther, Ulrik
    Incardona, Pietro
    Aydin, Ata Deniz
    Dachselt, Raimund
    Gumhold, Stefan
    Sbalzarini, Ivo F.
    2019 IEEE 9TH SYMPOSIUM ON LARGE DATA ANALYSIS AND VISUALIZATION (LDAV), 2019, : 95 - 96
  • [28] GeoVReality: A computational interactive virtual reality visualization framework and workflow for geophysical research
    Wang, Xianying
    Guo, Cong
    Yuen, David A.
    Luo, Gang
    PHYSICS OF THE EARTH AND PLANETARY INTERIORS, 2020, 298 (298)
  • [29] An Interactive Node-Link Visualization of Convolutional Neural Networks
    Harley, Adam W.
    ADVANCES IN VISUAL COMPUTING, PT I (ISVC 2015), 2015, 9474 : 867 - 877
  • [30] CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization
    Wang, Zijie J.
    Turko, Robert
    Shaikh, Omar
    Park, Haekyu
    Das, Nilaksh
    Hohman, Fred
    Kahng, Minsuk
    Chau, Duen Horng
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2021, 27 (02) : 1396 - 1406