Extended Reality Educational System with Virtual Teacher Interaction for Enhanced Learning

被引：1
|
作者：
Liarokapis, Fotis [1 ]
Milata, Vaclav [1 ]
Skola, Filip [1 ]
机构：
[1] CYENS Ctr Excellence, Res Ctr Interact Media Smart Syst & Emerging Techn, 23 Dimarchou Lellou Dimitriadi St, CY-1016 Nicosia, Cyprus
来源：
MULTIMODAL TECHNOLOGIES AND INTERACTION | 2024年 / 8卷 / 09期
基金：
欧盟地平线“2020”;
关键词：
extended reality; interactive learning environments; intelligent agents;
D O I：
10.3390/mti8090083
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Advancements in technology that can reshape educational paradigms, with Extended Reality (XR) have a pivotal role. This paper introduces an interactive XR intelligent assistant featuring a virtual teacher that interacts dynamically with PowerPoint presentations using OpenAI's ChatGPT API. The system incorporates Azure Cognitive Services for multilingual speech-to-text and text-to-speech capabilities, custom lip-syncing solutions, eye gaze, head rotation and gestures. Additionally, panoramic images can be used as a sky box giving the illusion that the AI assistant is located at another location. Findings from three pilots indicate that the proposed technology has a lot of potential to be used as an additional tool for enhancing the learning process. However, special care must be taken into privacy and ethical issues.
引用
收藏
页数：14
相关论文
共 50 条
  • [21] Optimising the learning process with immersive virtual reality and non-immersive virtual reality in an educational environment
    Lee, Vivian W. Y.
    Hodgson, Paula
    Chan, Chung-Shing
    Fong, Agnes
    Cheung, Sonia W. L.
    INTERNATIONAL JOURNAL OF MOBILE LEARNING AND ORGANISATION, 2020, 14 (01) : 21 - 35
  • [22] VIRTUAL REALITY IN TEACHER TRAINING - DEVELOPING PRESENTATIONS IN VIRTUAL REALITY
    Bujdoso, Gyongyi
    ICERI2016: 9TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION, 2016, : 4900 - 4905
  • [23] A Learning Engagement Model of Educational Games based on Virtual Reality
    Gao, Nan
    Xie, Tao
    Liu, Geping
    2018 INTERNATIONAL JOINT CONFERENCE ON INFORMATION, MEDIA AND ENGINEERING (ICIME), 2018, : 1 - 5
  • [24] Learning with virtual reality: a market analysis of educational and training applications
    Smutny, Pavel
    INTERACTIVE LEARNING ENVIRONMENTS, 2023, 31 (10) : 6133 - 6146
  • [25] Editorial: themed issue on enhanced educational experience in virtual and augmented reality
    Daniela, Linda
    Lytras, Miltiadis D.
    VIRTUAL REALITY, 2019, 23 (04) : 325 - 327
  • [26] Editorial: themed issue on enhanced educational experience in virtual and augmented reality
    Linda Daniela
    Miltiadis D. Lytras
    Virtual Reality, 2019, 23 : 325 - 327
  • [27] Classrooms in the metaverse: educational applications and levels of learner interaction in virtual reality
    Gualano, Ria J.
    Campbell, Scott W.
    COMMUNICATION EDUCATION, 2024, 73 (02) : 212 - 225
  • [28] Setting the best view of a virtual teacher in a mixed reality physical-task learning support system
    Nawandah, Mamoun
    Inoue, Tomoo
    JOURNAL OF SYSTEMS AND SOFTWARE, 2013, 86 (07) : 1738 - 1750
  • [29] Extended reality (XR) virtual practical and educational eGaming to provide effective immersive environments for learning and teaching in forensic science
    Pringle, Jamie K.
    Stimpson, Ian G.
    Jeffery, Adam J.
    Wisniewski, Kristopher D.
    Grossey, Timothy
    Hobson, Luke
    Heaton, Vivienne
    Zholobenko, Vladimir
    Rogers, Steven L.
    SCIENCE & JUSTICE, 2022, 62 (06) : 696 - 707
  • [30] Augmented Reality and Virtual Reality for Learning: An Examination Using an Extended Technology Acceptance Model
    Jang, Jaehong
    Ko, Yujung
    Shin, Won Sug
    Han, Insook
    IEEE ACCESS, 2021, 9 : 6798 - 6809
12345