Interaction by Hand-Tracking in a Virtual Reality Environment

被引:4
|
作者
de Castro, Mateus C. L. [1 ]
Xavier, Joao P. de A. [1 ]
Rosa, Paulo F. F. [1 ]
de Oliveira, Jauvane C. [2 ]
机构
[1] Inst Militar Engn IME, Comp Engn Dept, Rio De Janeiro, Brazil
[2] Lab Nacl Comp Cient, Coordinat Math & Computat Methods, Petropolis, RJ, Brazil
关键词
Neural Networks; Deep Learning; Virtual Reality; Real-time Systems; Image Processing; Pose Detection; Computer Vision;
D O I
10.1109/ICIT46573.2021.9453573
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This article describes the elaboration of a low-cost system that allows user interaction with VR environments modeled in Unity and viewed through Google Cardboard. The proposed system divides the processing in a client-server architecture in which the VR experience is executed on the client, while it sends pictures captured from the mobile device inside the Card Board to the server. This server processes the hand pose information and sends it to the client.
引用
收藏
页码:895 / 900
页数:6
相关论文
共 50 条
  • [1] MEgATrack: Monochrome Egocentric Articulated Hand-Tracking for Virtual Reality
    Han, Shangchen
    Liu, Beibei
    Cabezas, Randi
    Twigg, Christopher D.
    Zhang, Peizhao
    Petkau, Jeff
    Yu, Tsz-Ho
    Tai, Chun-Jung
    Akbay, Muzaffer
    Wang, Zheng
    Nitzan, Asaf
    Dong, Gang
    Ye, Yuting
    Tao, Lingling
    Wan, Chengde
    Wang, Robert
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (04):
  • [2] A Study on Affordable Manipulation in Virtual Reality Simulations: Hand-Tracking versus Controller-Based Interaction
    De Lorenzis, Federico
    Nadalin, Marina
    Scarrone, Francesca
    Fiorenza, Jacopo
    Migliorini, Massimo
    Lamberti, Fabrizio
    [J]. 2023 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW, 2023, : 103 - 107
  • [3] Exploration of the Virtual Reality Teleportation Methods Using Hand-Tracking, Eye-Tracking, and EEG
    Kim, Jinwook
    Jang, Hyunyoung
    Kim, Dooyoung
    Lee, Jeongmi
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2023, 39 (20) : 4112 - 4125
  • [4] A Comparative Study of the User Experience of Controller and Hand-Tracking Interactions in a Virtual Environment
    Kim, Aelee
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY ADJUNCT (ISMAR-ADJUNCT 2022), 2022, : 744 - 748
  • [5] Evaluation of Hand-Tracking Systems in Teleoperation and Virtual Dexterous Manipulation
    Mizera, C.
    Delrieu, T.
    Weistroffer, V
    Andriot, C.
    Decatoire, A.
    Gazeau, J-P
    [J]. IEEE SENSORS JOURNAL, 2020, 20 (03) : 1642 - 1655
  • [6] A methodological framework to assess the accuracy of virtual reality hand-tracking systems: A case study with the Meta Quest 2
    Diar Abdlkarim
    Massimiliano Di Luca
    Poppy Aves
    Mohamed Maaroufi
    Sang-Hoon Yeo
    R. Chris Miall
    Peter Holland
    Joeseph M. Galea
    [J]. Behavior Research Methods, 2024, 56 : 1052 - 1063
  • [7] A methodological framework to assess the accuracy of virtual reality hand-tracking systems: A case study with the Meta Quest 2
    Abdlkarim, Diar
    Di Luca, Massimiliano
    Aves, Poppy
    Maaroufi, Mohamed
    Yeo, Sang-Hoon
    Miall, R. Chris
    Holland, Peter
    Galea, Joeseph M.
    [J]. BEHAVIOR RESEARCH METHODS, 2024, 56 (02) : 1052 - 1063
  • [8] An upper limb mirror therapy environment with hand tracking in virtual reality
    Mazzola, Steven
    Prado, Antonio
    Agrawal, Sunil K.
    [J]. 2020 8TH IEEE RAS/EMBS INTERNATIONAL CONFERENCE FOR BIOMEDICAL ROBOTICS AND BIOMECHATRONICS (BIOROB), 2020, : 752 - 758
  • [9] Influence of Hand Tracking as a way of Interaction in Virtual Reality on User Experience
    Voigt-Antons, Jan-Niklas
    Kojic, Tanja
    Ali, Danish
    Moeller, Sebastian
    [J]. 2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
  • [10] Hand Tracking Interface for Virtual Reality Interaction Based on MARG sensors
    O-Larnnithipong, Nonnarit
    Ratchatanantakit, Neeranut
    Tangnimitchok, Sudarat
    Ortega, Francisco
    Barreto, Armando
    [J]. 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 1717 - 1722