Real-time body tracking in virtual reality using a Vive tracker

被引:66
|
作者
Caserman, Polona [1 ]
Garcia-Agundez, Augusto [1 ]
Konrad, Robert [1 ]
Goebel, Stefan [1 ]
Steinmetz, Ralf [1 ]
机构
[1] Tech Univ Darmstadt, Multimedia Commun Lab, D-64283 Darmstadt, Germany
关键词
Virtual reality; Real-time tracking; Full-body avatar; Low-latency; HTC Vive tracker; Inverse kinematics; LATENCY;
D O I
10.1007/s10055-018-0374-z
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Due to recent improvements in virtual reality (VR) technology, the number of novel applications for entertainment, education, and rehabilitation has increased. The primary goal of these applications is to enhance the sense of belief that the user is present in the virtual environment. By tracking the user's skeleton in real-time, it is possible to synchronize the avatar's motions with the user's motions. Although current common devices implement body tracking to a certain degree, most approaches are limited by either high latency or insufficient accuracy. Due to the lack of positional and rotation data, the current VR applications typically do not represent the user's motions. In this paper, we present an accurate, low-latency body tracking approach for VR-based applications using Vive Trackers. Using a HTC Vive headset and Vive Trackers, we have been able to create an immersive VR experience, by animating the motions of the avatar as smoothly, rapidly and as accurately as possible. An evaluation showed our solution is capable of tracking both joint rotation and position with reasonable accuracy and a very low end-to-latency of 6.71 +/- 0.80 ms. Due to this merely imperceptible delay and precise tracking, our solution can show the movements of the user in real-timein order to create deeper immersion.
引用
收藏
页码:155 / 168
页数:14
相关论文
共 50 条
  • [1] Real-time body tracking in virtual reality using a Vive tracker
    Polona Caserman
    Augusto Garcia-Agundez
    Robert Konrad
    Stefan Göbel
    Ralf Steinmetz
    [J]. Virtual Reality, 2019, 23 : 155 - 168
  • [2] Real-time Tracking of Laparoscopic Instruments Using Kinect for Training in Virtual Reality
    Owlia, Mohammadhasan
    Khabbazan, Mostafa
    Mirbagheri, M. M.
    Mirbagheri, Alireza
    [J]. 2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 3945 - 3948
  • [3] A real-time tracker for markerless augmented reality
    Comport, AI
    Marchand, E
    Chaumette, F
    [J]. SECOND IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS, 2003, : 36 - 45
  • [4] Virtual mirror: Real-time tracking of shoes in augmented reality environments
    Eisert, Peter
    Rurainsky, Juergen
    Fechteler, Philipp
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 1121 - 1124
  • [5] Real-time markerless tracking for augmented reality: The virtual visual servoing framework
    Comport, AI
    Marchand, E
    Pressigout, M
    Chaumette, F
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2006, 12 (04) : 615 - 628
  • [6] Real-time map projection in virtual reality using WebVR
    Letic, Marko
    Nenadic, Kosa
    Nikolic, Lazar
    [J]. 2018 41ST INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2018, : 1439 - 1443
  • [7] Real-time multiple object tracking using virtual shells
    [J]. 1600, Association for Scientific Research, P.O. Box 83, Manisa, 45040, Turkey (18):
  • [8] Markerless augmented reality with a real-time affine region tracker
    Ferrari, V
    Tuytelaars, T
    Van Gool, L
    [J]. IEEE AND ACM INTERNATIONAL SYMPOSIUM ON AUGMENTED REALITY, PROCEEDINGS, 2001, : 87 - 96
  • [9] 'Real-time' virtual reality and the limits of immersion
    Misek, Richard
    [J]. SCREEN, 2020, 61 (04) : 615 - 624
  • [10] Real-time Camera Tracking for Augmented Reality
    Yu, Jung-Jae
    Kim, Jae-Hean
    Kim, Hye-mi
    Choi, Il
    Jeong, Il-Kwon
    [J]. 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY, VOLS I-III, PROCEEDINGS,: UBIQUITOUS ICT CONVERGENCE MAKES LIFE BETTER!, 2009, : 1286 - +