Extended Reality Educational System with Virtual Teacher Interaction for Enhanced Learning

被引：1
|
作者：
Liarokapis, Fotis [1 ]
Milata, Vaclav [1 ]
Skola, Filip [1 ]
机构：
[1] CYENS Ctr Excellence, Res Ctr Interact Media Smart Syst & Emerging Techn, 23 Dimarchou Lellou Dimitriadi St, CY-1016 Nicosia, Cyprus
来源：
MULTIMODAL TECHNOLOGIES AND INTERACTION | 2024年 / 8卷 / 09期
基金：
欧盟地平线“2020”;
关键词：
extended reality; interactive learning environments; intelligent agents;
D O I：
10.3390/mti8090083
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Advancements in technology that can reshape educational paradigms, with Extended Reality (XR) have a pivotal role. This paper introduces an interactive XR intelligent assistant featuring a virtual teacher that interacts dynamically with PowerPoint presentations using OpenAI's ChatGPT API. The system incorporates Azure Cognitive Services for multilingual speech-to-text and text-to-speech capabilities, custom lip-syncing solutions, eye gaze, head rotation and gestures. Additionally, panoramic images can be used as a sky box giving the illusion that the AI assistant is located at another location. Findings from three pilots indicate that the proposed technology has a lot of potential to be used as an additional tool for enhancing the learning process. However, special care must be taken into privacy and ethical issues.
引用
收藏
页数：14
相关论文
共 50 条
  • [31] Learning to Teach with Virtual Reality: Lessons from One Elementary Teacher
    Timothy Patterson
    Insook Han
    TechTrends, 2019, 63 : 463 - 469
  • [32] Learning to Teach with Virtual Reality: Lessons from One Elementary Teacher
    Patterson, Timothy
    Han, Insook
    TECHTRENDS, 2019, 63 (04) : 463 - 469
  • [33] Virtual Reality Based Robotics Learning System
    Yang, Xiaoli
    Zhao, Yaqi
    Wu, Wei
    Wang, Hui
    2008 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS, VOLS 1-6, 2008, : 859 - 864
  • [34] Designing a Virtual Reality Learning Management System
    Gradinaru, Alexandru
    Moldoveanu, Alin
    Moldoveanu, Florica
    PROCEEDINGS OF THE 14TH INTERNATIONAL SCIENTIFIC CONFERENCE ELEARNING AND SOFTWARE FOR EDUCATION: ELEARNING CHALLENGES AND NEW HORIZONS, VOL 2, 2018, : 11 - 16
  • [35] Gamification of Educational Content by Using Virtual Teacher in Online Learning Environment
    Bondarenko, Tetiana
    Kovalenko, Denys
    Khotchenko, Iryna
    Zelenin, Hennadii
    Bozhko, Viktor
    TOWARDS A HYBRID, FLEXIBLE AND SOCIALLY ENGAGED HIGHER EDUCATION, VOL 3, ICL 2023, 2024, 901 : 447 - 454
  • [36] Computer Assisted Surgical Educational System Using Virtual Reality
    Uehara, Itto
    Higa, Hiroki
    2020 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATICS AND BIOMEDICAL SCIENCES (ICIIBMS 2020), 2020, : 94 - 98
  • [37] Designing a Virtual Reality (VR) Storytelling System for Educational Purposes
    Lau, Siew Yung
    Chen, Chwen Jen
    TECHNOLOGICAL DEVELOPMENTS IN EDUCATION AND AUTOMATION, 2010, : 135 - 138
  • [38] Development of an educational virtual reality training system for marine engineers
    Shen, Haosheng
    Zhang, Jundong
    Yang, Baicheng
    Jia, Baozhu
    COMPUTER APPLICATIONS IN ENGINEERING EDUCATION, 2019, 27 (03) : 580 - 602
  • [39] Virtual Reality as Educational Technology
    Popov, Stanislav
    Surchev, Stanimir
    Petkov, Todor
    Todorov, Milen
    Sotirova, Evdokia
    Sotirov, Sotir
    Bozov, Hristo
    Minkov, Minko
    Tankov, Ivaylo
    Mitkova, Magdalena
    2019 29TH ANNUAL CONFERENCE OF THE EUROPEAN ASSOCIATION FOR EDUCATION IN ELECTRICAL AND INFORMATION ENGINEERING (EAEEIE 2019), 2019,
  • [40] Extended Sliding in Virtual Reality
    Sun, Junwei
    Stuerzlinger, Wolfgang
    25TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2019), 2019,
12345