Mixed Reality Storytelling Environments Based on Tangible User Interface: Take Origami as an Example

被引：0
|
作者：
Song, Yingjie
Zhou, Nianmei
Sun, Qianhui
Gai, Wei
Liu, Juan
Bian, Yulong
Liu, Shijun
Cui, Lizhen
Yang, Chenglei [1 ]
机构：
[1] Shandong Univ, Sch Software, Jinan, Shandong, Peoples R China
来源：
2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR) | 2019年
基金：
中国博士后科学基金; 中国国家自然科学基金;
关键词：
Handicraft; Storytelling; Tangible User Interface; Mixed Reality; Parent-child Interaction;
D O I：
10.1109/vr.2019.8798114
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents a mixed reality storytelling system, which takes handicrafts as tangible interaction tools. Via the system, users can learn handicraft and then use the handicraft pieces to design, create and tell stories with HoloLens iteratively. In order to overcome the limitations of HoloLens gesture interaction, the system uses hand tracking with Kinect to implement a touch-like effect on the desktop. User study shows that our system has good usability, and it is welcomed by users. In addition, it can stimulate users interest in handicraft and storytelling, and even promote parent-child interaction effectively.
引用
收藏
页码：1167 / 1168
页数：2
相关论文
共 50 条
  • [1] A COMPUTER VISION TANGIBLE USER INTERFACE FOR MIXED REALITY BILLIARDS
    Hammond, Brian
    2008 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-4, 2008, : 929 - 932
  • [2] A tangible user interface for remote collaboration system using mixed reality
    Bannai, Yuichi
    Tamaki, Hidekazu
    Suzuki, Yuji
    Shigeno, Hiroshi
    Okada, Kenichi
    ADVANCES IN ARTIFICIAL REALITY AND TELE-EXISTENCE, PROCEEDINGS, 2006, 4282 : 143 - 154
  • [3] Mixed reality storytelling environments
    V. Bayon
    J. R. Wilson
    D. Stanton
    A. Boltman
    Virtual Reality, 2003, 7 (1) : 54 - 63
  • [4] A Meta User Interface for Interaction with Mixed Reality Environments
    Mostafazadeh, Aida
    Shirehjini, Ali Asghar Nazari
    Daraei, Sara
    Khojasteh, Negar
    Shirmohammadi, Shervin
    2015 IEEE INTERNATIONAL WORKSHOP ON HAPTIC AUDIO-VISUAL ENVIRONMENTS AND GAMES (HAVE), 2015, : 35 - 40
  • [5] A framework for virtual reality with tangible augmented reality-based user interface
    Hong, D
    Woo, W
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2006, E89D (01): : 45 - 52
  • [6] Immersive storytelling in mixed reality environments
    Doyle, Denise
    PROCEEDINGS OF THE 2017 23RD INTERNATIONAL CONFERENCE ON VIRTUAL SYSTEM AND MULTIMEDIA (VSMM), 2017, : 418 - 421
  • [7] Mediate: A Spatial Tangible Interface for Mixed Reality
    Fitzgerald, Daniel
    Ishii, Hiroshi
    CHI 2018: EXTENDED ABSTRACTS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2018,
  • [8] User interaction in mixed reality interactive storytelling
    Cavazza, M
    Martin, O
    Charles, F
    Marichal, X
    Mead, SJ
    SECOND IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS, 2003, : 304 - 305
  • [9] A Tangible User Interface Using Spatial Augmented Reality
    Chan, Leith K. Y.
    Lau, Henry Y. K.
    IEEE SYMPOSIUM ON 3D USER INTERFACES (3DUI 2010), 2010, : 137 - 138
  • [10] Tangible Stickers: A Sensor Based Tangible User Interface
    Zatulovsky, Daniel
    El-Sana, Jihad
    VIRTUAL REALITY AND AUGMENTED REALITY, EUROVR 2019, 2019, 11883 : 297 - 304
12345