Improving Robot-Assisted Virtual Teaching Using Transformers, GANs, and Computer Vision

被引:0
|
作者
Xiong, Li [1 ,2 ]
Chen, Yuanyuan [1 ]
Peng, Yi [2 ]
Ghadi, Yazeed Yasin [3 ]
机构
[1] Cent China Normal Univ, Wuhan, Peoples R China
[2] Yangtze Univ, Jingzhou, Peoples R China
[3] Al Ain Univ, Al Ain, U Arab Emirates
关键词
computer vision assistance; multimodal perception; personalized learning path planning; robot decision making; transformer model; virtual robot teaching assistant;
D O I
10.4018/JOEUC.336481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study aims to enhance the efficacy of personalized learning paths by amalgamating transformer models, generative adversarial networks (GANs), and reinforcement learning techniques. To refine personalized learning trajectories, the authors integrated the transformer model for enhanced information assimilation and learning path planning. Through generative adversarial networks, the authors simulated the fusion and interaction of multi-modal information, refining the training of virtual teaching assistants. Lastly, reinforcement learning was employed to optimize the interaction strategies of these assistants, aligning them better with student needs. In the experimental phase, the authors benchmarked their approach against six state-of-the-art models to assess its effectiveness. The experimental outcomes highlight significant enhancements achieved by the authors' virtual teaching assistant compared to traditional methods. Precision improved to 95% and recall to 96%, and an F1 score exceeding 95% was attained.
引用
收藏
页数:32
相关论文
共 50 条
  • [1] Development of Virtual Reality-Vision System in Robot-Assisted Laparoscopic Surgery
    Jo, Yeeun
    Kim, Yoon Jae
    Moon, Hye-Min
    Kim, Sungwan
    2018 18TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2018, : 1708 - 1712
  • [2] Tremor Assessment in Robot-Assisted Microlaryngeal Surgery Using Computer Vision-Based Tool Tracking
    Cho, Sue M.
    Joo, Henry H.
    Golla, Pranathi
    Sahu, Manish
    Shankar, Ahjeetha
    Trakimas, Danielle R.
    Creighton, Francis
    Akst, Lee
    Taylor, Russell H.
    Galaiya, Deepa
    OTOLARYNGOLOGY-HEAD AND NECK SURGERY, 2024, 171 (01) : 188 - 196
  • [3] Teaching and Training in Robot-assisted Surgery
    Schmelzle, Moritz
    Malinka, Thomas
    Bahra, Marcus
    Pratschke, Johann
    ZENTRALBLATT FUR CHIRURGIE, 2020, 145 (03): : 271 - 277
  • [4] Adaptive edge finishing process on distorted features through robot-assisted computer vision
    Gonzalez, Mikel
    Rodriguez, Adrian
    Lopez-Saratxaga, Unai
    Pereira, Octavio
    de Lacalle, Luis Norberto Lopez
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 74 : 41 - 54
  • [5] Virtual Reality Simulators for Robot-assisted Surgery
    Breda, Alberto
    Territo, Angelo
    EUROPEAN UROLOGY, 2016, 69 (06) : 1081 - 1082
  • [6] Haptic virtual fixtures for robot-assisted manipulation
    Abbott, Jake J.
    Marayong, Panadda
    Okamura, Allison M.
    ROBOTICS RESEARCH, 2007, 28 : 49 - +
  • [7] Computer- and robot-assisted urological surgery
    Troccaz, Jocelyne
    PROGRES EN UROLOGIE, 2006, 16 (02): : 112 - 120
  • [8] Improving the Evidence for Robot-assisted Radical Prostatectomy
    Dasgupta, Prokar
    EUROPEAN UROLOGY, 2015, 67 (04) : 671 - 672
  • [9] Toward Force Estimation in Robot-Assisted Surgery using Deep Learning with Vision and Robot State
    Chua, Zonghe
    Jarc, Anthony M.
    Okamura, Allison M.
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 12335 - 12341
  • [10] Improving the Adversarial Transferability of Vision Transformers with Virtual Dense Connection
    Zhang, Jianping
    Huang, Yizhan
    Xu, Zhuoer
    Wu, Weibin
    Lyu, Michael R.
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 7133 - 7141