Improving Robot-Assisted Virtual Teaching Using Transformers, GANs, and Computer Vision

被引:0
|
作者
Xiong, Li [1 ,2 ]
Chen, Yuanyuan [1 ]
Peng, Yi [2 ]
Ghadi, Yazeed Yasin [3 ]
机构
[1] Cent China Normal Univ, Wuhan, Peoples R China
[2] Yangtze Univ, Jingzhou, Peoples R China
[3] Al Ain Univ, Al Ain, U Arab Emirates
关键词
computer vision assistance; multimodal perception; personalized learning path planning; robot decision making; transformer model; virtual robot teaching assistant;
D O I
10.4018/JOEUC.336481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study aims to enhance the efficacy of personalized learning paths by amalgamating transformer models, generative adversarial networks (GANs), and reinforcement learning techniques. To refine personalized learning trajectories, the authors integrated the transformer model for enhanced information assimilation and learning path planning. Through generative adversarial networks, the authors simulated the fusion and interaction of multi-modal information, refining the training of virtual teaching assistants. Lastly, reinforcement learning was employed to optimize the interaction strategies of these assistants, aligning them better with student needs. In the experimental phase, the authors benchmarked their approach against six state-of-the-art models to assess its effectiveness. The experimental outcomes highlight significant enhancements achieved by the authors' virtual teaching assistant compared to traditional methods. Precision improved to 95% and recall to 96%, and an F1 score exceeding 95% was attained.
引用
收藏
页数:32
相关论文
共 50 条
  • [31] Natural Teaching of Robot-Assisted Rearranging Exercises for Cognitive Training
    Andriella, Antonio
    Suarez-Hernandez, Alejandro
    Segovia-Aguas, Javier
    Torras, Carme
    Alenya, Guillem
    SOCIAL ROBOTICS, ICSR 2019, 2019, 11876 : 611 - 621
  • [32] CRANIO - computer-assisted planning for navigated and robot-assisted surgery on the skull
    Popovic, A
    Engelhardt, M
    Wu, T
    Portheine, F
    Schmieder, K
    Radermacher, K
    CARS 2003: COMPUTER ASSISTED RADIOLOGY AND SURGERY, PROCEEDINGS, 2003, 1256 : 1269 - 1275
  • [33] Toward Teaching by Demonstration for Robot-Assisted Minimally Invasive Surgery
    Su, Hang
    Mariani, Andrea
    Ovur, Salih Ertug
    Menciassi, Arianna
    Ferrigno, Giancarlo
    De Momi, Elena
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (02) : 484 - 494
  • [34] Brain-Computer Interface with Robot-Assisted Training for Neurorehabilitation
    Rosipal, Roman
    Porubcova, Natalia
    Barancok, Peter
    Cimrova, Barbora
    Teplan, Michal
    Farkas, Igor
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2017, PT I, 2017, 10613 : 418 - 418
  • [35] Computer-guided robot-assisted surgery in hip endoprostheses
    Borner, M
    Bauer, A
    Lahmer, A
    ORTHOPADE, 1997, 26 (03): : 251 - 257
  • [36] Virtual worlds using computer vision
    Narayanan, PJ
    Kanade, T
    COMPUTER VISION FOR VIRTUAL REALITY BASED HUMAN COMMUNICATIONS - 1998 IEEE AND ATR WORKSHOP PROCEEDINGS, 1998, : 2 - 13
  • [37] Improving Teleoperation Interfaces to Support Therapists in Robot-Assisted Therapy
    Elbeleidy, Saad
    EXTENDED ABSTRACTS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2022, 2022,
  • [38] Virtual reality simulator training equals mechanical robotic training in improving robot-assisted basic suturing skills
    Halvorsen, F. H.
    Elle, O. J.
    Dalinin, N. V.
    Mork, B. E.
    Sorhus, V.
    Rotnes, J. S.
    Fosse, E.
    SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2006, 20 (10): : 1565 - 1569
  • [39] Virtual reality simulator training equals mechanical robotic training in improving robot-assisted basic suturing skills
    F. H. Halvorsen
    O. J. Elle
    V. V. Dalinin
    B. E. Mørk
    V. Sørhus
    J. S. Røtnes
    E. Fosse
    Surgical Endoscopy And Other Interventional Techniques, 2006, 20 : 1565 - 1569
  • [40] Improving Gait in Multiple Sclerosis Using Robot-Assisted, Body Weight Supported Treadmill Training
    Lo, Albert C.
    Triche, Elizabeth W.
    NEUROREHABILITATION AND NEURAL REPAIR, 2008, 22 (06) : 661 - 671