Mixed Reality Storytelling Environments Based on Tangible User Interface: Take Origami as an Example

被引：0
|
作者：
Song, Yingjie
Zhou, Nianmei
Sun, Qianhui
Gai, Wei
Liu, Juan
Bian, Yulong
Liu, Shijun
Cui, Lizhen
Yang, Chenglei [1 ]
机构：
[1] Shandong Univ, Sch Software, Jinan, Shandong, Peoples R China
来源：
2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR) | 2019年
基金：
中国博士后科学基金; 中国国家自然科学基金;
关键词：
Handicraft; Storytelling; Tangible User Interface; Mixed Reality; Parent-child Interaction;
D O I：
10.1109/vr.2019.8798114
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents a mixed reality storytelling system, which takes handicrafts as tangible interaction tools. Via the system, users can learn handicraft and then use the handicraft pieces to design, create and tell stories with HoloLens iteratively. In order to overcome the limitations of HoloLens gesture interaction, the system uses hand tracking with Kinect to implement a touch-like effect on the desktop. User study shows that our system has good usability, and it is welcomed by users. In addition, it can stimulate users interest in handicraft and storytelling, and even promote parent-child interaction effectively.
引用
收藏
页码：1167 / 1168
页数：2
相关论文
共 50 条
  • [41] An Automated Meeting Assistant: A Tangible Mixed Reality Interface for the AMIDA Automatic Content Linking Device
    Ehnes, Jochen
    ENTERPRISE INFORMATION SYSTEMS-BK, 2009, 24 : 952 - 962
  • [42] Mixed Reality with Hardware Acceleration: implementing the multimodal user interface vision
    Deligiannakis, Nektarios
    Pavlopoulou, Maria-Evangelia
    Papataxiarxis, Vassilis
    Hadjiefthymiades, Stathes
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR), 2022, : 157 - 160
  • [43] Designing a Tangible User Interface (TUI) for the Elderly Based on Their Motivations and Game Elements
    Salazar-Cardona, Johnny Alexander
    Cano, Sandra
    Gutierrez-Vela, Francisco Luis
    Arango, Jeferson
    SENSORS, 2023, 23 (23)
  • [44] Virtual Reality to Mixed Reality Graphic Conversion in Unity Preliminary Guidelines and Graphic User Interface
    Kirollos, Ramy
    Harriott, Martin
    HCI INTERNATIONAL 2021 - LATE BREAKING POSTERS, HCII 2021, PT I, 2021, 1498 : 357 - 363
  • [45] PRISME: Toward a model linking tangible interaction and domain-specific tasks in mixed reality environments
    Fazzari, Jean-Michel
    Kubicki, Sebastien
    Querrec, Ronan
    2020 22ND SYMPOSIUM ON VIRTUAL AND AUGMENTED REALITY (SVR 2020), 2020, : 210 - 219
  • [46] NFC-Based User Interface for Smart Environments
    Spinsante, Susanna
    Gambi, Ennio
    ADVANCES IN HUMAN-COMPUTER INTERACTION, 2015, 2015
  • [47] AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented Reality
    He, Fengming
    Hu, Xiyun
    Qian, Xun
    Zhu, Zhengzhe
    Ramani, Karthik
    Proceedings of the ACM on Human-Computer Interaction, 2024, 8 (ISS) : 44 - 69
  • [48] User Experience Analysis in Obstacle Clearance Tasks in Virtual and Mixed Reality Environments
    Paranthaman, Pratheep Kumar
    Vallabhajosula, Srikant
    Giordano, Alys
    Walton, Stacey
    Tuisa, Oliver
    Bajaj, Nikesh
    INTELLIGENT SUSTAINABLE SYSTEMS, WORLDS4 2022, VOL 2, 2023, 579 : 675 - 686
  • [49] The Virtuality Continuum and Storytelling: Simulation, Interactivity, User Experience and Interaction Design in Virtual and Mixed Environments. A STEAM Based Approach
    Luis Rubio-Tamayo, Jose
    Gertrudix Barrio, Manuel
    Garcia Garcia, Francisco
    ADVANCES IN HUMAN FACTORS IN SIMULATION AND MODELING (AHFE 2017), 2018, 591 : 345 - 353
  • [50] A Fingertip Gestural User Interface without Depth Data for Mixed Reality Applications
    Hegde, Srinidhi
    Garg, Gaurav
    Perla, Ramakrishna
    Hebbalaguppe, Ramya
    ADJUNCT PROCEEDINGS OF THE 2018 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2018, : 395 - 396
12345