Improving Robot-Assisted Virtual Teaching Using Transformers, GANs, and Computer Vision

被引:0
|
作者
Xiong, Li [1 ,2 ]
Chen, Yuanyuan [1 ]
Peng, Yi [2 ]
Ghadi, Yazeed Yasin [3 ]
机构
[1] Cent China Normal Univ, Wuhan, Peoples R China
[2] Yangtze Univ, Jingzhou, Peoples R China
[3] Al Ain Univ, Al Ain, U Arab Emirates
关键词
computer vision assistance; multimodal perception; personalized learning path planning; robot decision making; transformer model; virtual robot teaching assistant;
D O I
10.4018/JOEUC.336481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study aims to enhance the efficacy of personalized learning paths by amalgamating transformer models, generative adversarial networks (GANs), and reinforcement learning techniques. To refine personalized learning trajectories, the authors integrated the transformer model for enhanced information assimilation and learning path planning. Through generative adversarial networks, the authors simulated the fusion and interaction of multi-modal information, refining the training of virtual teaching assistants. Lastly, reinforcement learning was employed to optimize the interaction strategies of these assistants, aligning them better with student needs. In the experimental phase, the authors benchmarked their approach against six state-of-the-art models to assess its effectiveness. The experimental outcomes highlight significant enhancements achieved by the authors' virtual teaching assistant compared to traditional methods. Precision improved to 95% and recall to 96%, and an F1 score exceeding 95% was attained.
引用
收藏
页数:32
相关论文
共 50 条
  • [41] A new novel virtual simulation system for robot-assisted orthopedic surgery
    State Key Laboratory of Robotics and Mechatronics, Harbin Institute of Technology, Harbin, Heilongjiang Province, 150001, China
    IEEE Int. Conf. Rob. Biomimetics - Conf. Proc., ROBIO, 2007, (366-370):
  • [42] Clinical application of virtual imaging guided Robot-assisted partial nephrectomy
    Shiozaki, Keito
    Kawanishi, Yasuo
    Sasaki, Yutaro
    Daizumoto, Kei
    Tsuda, Megumi
    Izumi, Kazuyoshi
    Kusuhara, Yoshito
    Fukawa, Tomoya
    Yamamoto, Yasuyo
    Yamaguchi, Kunihisa
    Takahashi, Masayuki
    Kanayama, Hiroomi
    JOURNAL OF MEDICAL INVESTIGATION, 2022, 69 (3-4): : 237 - 243
  • [43] Virtual Reality Robot-Assisted Welding Based on Human Intention Recognition
    Wang, Qiyue
    Jiao, Wenhua
    Yu, Rui
    Johnson, Michael T.
    Zhang, YuMing
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (02) : 799 - 808
  • [44] Immersive Virtual Reality Platform for Robot-Assisted Antenatal Ultrasound Scanning
    Shyam, A.
    Purayath, Aparna
    Keerthivasan, S.
    Akash, S. M.
    Govindaraju, Aswathaman
    Lakshmanan, Manojkumar
    Sivaprakasam, Mohanasankar
    2023 32ND IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, RO-MAN, 2023, : 1600 - 1605
  • [45] A new novel virtual simulation system for robot-assisted orthopedic surgery
    Zhang, Fengfeng
    Du, Zhijiang
    Sun, Lining
    Jia, Zhiheng
    2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS, VOLS 1-5, 2007, : 366 - 370
  • [46] A Bioinspired Virtual Reality Toolkit for Robot-Assisted Medical Application: BioVRbot
    Su, Hang
    Sheiban, Francesco Jamal
    Qi, Wen
    Ovur, Salih Ertug
    Alfayad, Samer
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2024, 54 (06) : 688 - 697
  • [47] The Validation of a Novel Robot-Assisted Radical Prostatectomy Virtual Reality Module
    Harrison, Patrick
    Raison, Nicholas
    Abe, Takashige
    Watkinson, William
    Dar, Falzon
    Challacombe, Ben
    Van Der Poel, Henk
    Khan, Muhammad Shamim
    Dasgupa, Prokar
    Ahmed, Kamran
    JOURNAL OF SURGICAL EDUCATION, 2018, 75 (03) : 758 - 766
  • [48] THE VALIDATION OF A NOVEL ROBOT-ASSISTED RADICAL PROSTATECTOMY VIRTUAL REALITY MODULE
    Harrison, P.
    Raison, N.
    Abe, T.
    Dasgupta, P.
    Ahmed, K.
    BRITISH JOURNAL OF SURGERY, 2018, 105 : 30 - 31
  • [49] Validating Advanced Robot-Assisted Laparoscopic Training Task in Virtual Reality
    Brown-Clerk, B.
    Siu, K-C
    Katsavelis, D.
    Lee, I.
    Oleynikov, D.
    Stergioui, N.
    MEDICINE MEETS VIRTUAL REALITY 16: PARALLEL, COMBINATORIAL, CONVERGENT: NEXTMED BY DESIGN, 2008, 132 : 45 - +
  • [50] Characterizing the Effects of Adding Virtual and Augmented Reality in Robot-Assisted Training
    Ai, Xupeng
    Santamaria, Victor
    Agrawal, Sunil K.
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 2709 - 2718