GaitLock: Protect Virtual and Augmented Reality Headsets Using Gait

被引:29
|
作者
Shen, Yiran [1 ]
Wen, Hongkai [2 ]
Luo, Chengwen [3 ]
Xu, Weitao [3 ]
Zhang, Tao [1 ]
Hu, Wen [4 ]
Rus, Daniela [5 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
[2] Univ Warwick, Dept Comp Sci, Coventry CV4 7AL, W Midlands, England
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[4] Univ New South Wales, Sch Engn & Comp Sci, Sydney, NSW 2052, Australia
[5] MIT, Comp Sci & Artificial Intelligence Lab, 77 Massachusetts Ave, Cambridge, MA 02139 USA
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Gait recognition; VR/AR; sparse representation classification; dynamic time warping; FACE RECOGNITION; INTERNET;
D O I
10.1109/TDSC.2018.2800048
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the fast penetration of commercial Virtual Reality (VR) and Augmented Reality (AR) systems into our daily life, the security issues of those devices have attracted significant interests from both academia and industry. Modern VR/AR systems typically use head-mounted devices (i.e., headsets) to interact with users, and often store private user data, e.g., social network accounts, online transactions or even payment information. This poses significant security threats, since in practice the headset can be potentially obtained and accessed by unauthenticated parties, e.g., identity thieves, and thus cause catastrophic breach. In this paper, we propose a novel GaitLock system, which can reliably authenticate users using their gait signatures. Our system doesn't require extra hardware, e.g., fingerprint sensors or retina scanners, but only uses the on-board inertial measurement units (IMUs) equipped in almost all mainstream VR/AR headsets to authenticate the legitimate users from intruders, by simply asking them to walk a few steps. To achieve that, we propose a new gait recognition model Dynamic-SRC, which combines the strength of Dynamic Time Warping (DTW) and Sparse Representation Classifier (SRC), to extract unique gait patterns from the inertial signals during walking. We implement GaitLock on Google Glass (a typical AR headset), and extensive experiments show that GaitLock outperforms the state-of-the-art systems significantly in recognition accuracy (> 98 percent success in 5 steps), and is able to run in-situ on the resource-constrained VR/AR headsets without incurring high energy cost.
引用
收藏
页码:484 / 497
页数:14
相关论文
共 50 条
  • [1] Gaze estimation using EEG signals for HCI in augmented and virtual reality headsets
    Montenegro, Juan Manuel Fernandez
    Argyriou, Vasileios
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 1159 - 1164
  • [2] Potential Applications of New Headsets for Virtual and Augmented Reality in Urology
    Review, Mini
    Zattoni, Fabio
    Carletti, Filippo
    Randazzo, Gianmarco
    Tuminello, Arianna
    Betto, Giovanni
    Novara, Giacomo
    Moro, Fabrizio Dal
    EUROPEAN UROLOGY FOCUS, 2024, 10 (04): : 594 - 598
  • [3] Frontiers in Virtual Reality Headsets
    Hunt, Warren
    FRONTIERS OF ENGINEERING, 2017, : 13 - 16
  • [4] Modern Virtual Reality Headsets
    Angelov, Vladislav
    Petkov, Emiliyan
    Shipkovenski, Georgi
    Kalushkov, Teodor
    2ND INTERNATIONAL CONGRESS ON HUMAN-COMPUTER INTERACTION, OPTIMIZATION AND ROBOTIC APPLICATIONS (HORA 2020), 2020, : 520 - 524
  • [5] Video See-Through Pipelines for Virtual Reality Headsets and their Impact on Gait
    Petrovski, Daniel
    Tirosh, Oren
    McCarthy, Chris
    Kameneva, Tatiana
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [6] Virtual Reality and Gait Rehabilitation Augmented Feedback for the Lokomat
    Zimmerli, Lukas
    Duschau-Wicke, Alexander
    Mayr, Andreas
    Riener, Robert
    Luenenburger, Lars
    2009 VIRTUAL REHABILITATION INTERNATIONAL CONFERENCE, 2009, : 150 - +
  • [7] Secure Voice Input on Augmented Reality Headsets
    Shang, Jiacheng
    Wu, Jie
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (04) : 1420 - 1433
  • [8] Thermal comfort and virtual reality headsets
    Wang, Zihao
    He, Renke
    Chen, Ke
    APPLIED ERGONOMICS, 2020, 85
  • [9] Flat optics for augmented-reality headsets
    Wilkinson, T. D.
    NATURE MATERIALS, 2025, 24 (04) : 478 - 479
  • [10] Are augmented reality headsets in surgery a dead end?
    Ferrari, Vincenzo
    Carbone, Marina
    Condino, Sara
    Cutolo, Fabrizio
    EXPERT REVIEW OF MEDICAL DEVICES, 2019, 16 (12) : 999 - 1001