GaitLock: Protect Virtual and Augmented Reality Headsets Using Gait

被引:29
|
作者
Shen, Yiran [1 ]
Wen, Hongkai [2 ]
Luo, Chengwen [3 ]
Xu, Weitao [3 ]
Zhang, Tao [1 ]
Hu, Wen [4 ]
Rus, Daniela [5 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
[2] Univ Warwick, Dept Comp Sci, Coventry CV4 7AL, W Midlands, England
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[4] Univ New South Wales, Sch Engn & Comp Sci, Sydney, NSW 2052, Australia
[5] MIT, Comp Sci & Artificial Intelligence Lab, 77 Massachusetts Ave, Cambridge, MA 02139 USA
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Gait recognition; VR/AR; sparse representation classification; dynamic time warping; FACE RECOGNITION; INTERNET;
D O I
10.1109/TDSC.2018.2800048
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the fast penetration of commercial Virtual Reality (VR) and Augmented Reality (AR) systems into our daily life, the security issues of those devices have attracted significant interests from both academia and industry. Modern VR/AR systems typically use head-mounted devices (i.e., headsets) to interact with users, and often store private user data, e.g., social network accounts, online transactions or even payment information. This poses significant security threats, since in practice the headset can be potentially obtained and accessed by unauthenticated parties, e.g., identity thieves, and thus cause catastrophic breach. In this paper, we propose a novel GaitLock system, which can reliably authenticate users using their gait signatures. Our system doesn't require extra hardware, e.g., fingerprint sensors or retina scanners, but only uses the on-board inertial measurement units (IMUs) equipped in almost all mainstream VR/AR headsets to authenticate the legitimate users from intruders, by simply asking them to walk a few steps. To achieve that, we propose a new gait recognition model Dynamic-SRC, which combines the strength of Dynamic Time Warping (DTW) and Sparse Representation Classifier (SRC), to extract unique gait patterns from the inertial signals during walking. We implement GaitLock on Google Glass (a typical AR headset), and extensive experiments show that GaitLock outperforms the state-of-the-art systems significantly in recognition accuracy (> 98 percent success in 5 steps), and is able to run in-situ on the resource-constrained VR/AR headsets without incurring high energy cost.
引用
收藏
页码:484 / 497
页数:14
相关论文
共 50 条
  • [21] Affordable gait analysis using augmented reality markers
    Nagymate, Gergely
    Kiss, Rita M.
    PLOS ONE, 2019, 14 (02):
  • [22] Virtual humans for virtual reality and augmented reality
    Thalmann, D
    Magnenat-Thalmann, N
    IEEE VIRTUAL REALITY 2003, PROCEEDINGS, 2003, : 300 - 300
  • [23] TEACHING ARCHEOLOGY USING MIXED REALITY, AUGMENTED REALITY, VIRTUAL REALITY
    Fasolo, Michele
    ARCHEOMATICA-TECNOLOGIE PER I BENI CULTURALI, 2020, 11 (01): : 5 - 5
  • [24] Human gait simulation using virtual reality
    Hilal, I
    Burdin, V
    Stindel, E
    Roux, C
    Lefèvre, C
    PROCEEDINGS OF THE 20TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOL 20, PTS 1-6: BIOMEDICAL ENGINEERING TOWARDS THE YEAR 2000 AND BEYOND, 1998, 20 : 1250 - 1253
  • [25] Using Virtual and Augmented Reality with GIS Data
    Pavelka Jr, Karel
    Landa, Martin
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2024, 13 (07)
  • [26] USING VIRTUAL AND AUGMENTED REALITY IN GRAPHIC SUBJECT
    Cermakova, Ivana
    Martinik, Ivo
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE EFFICIENCY AND RESPONSIBILITY IN EDUCATION 2020 (ERIE 2020), 2020, : 54 - 61
  • [27] Learning History Using Virtual and Augmented Reality
    Remolar, Inmaculada
    Rebollo, Cristina
    Fernandez-Moyano, Jon A.
    COMPUTERS, 2021, 10 (11)
  • [28] USING VIRTUAL AND AUGMENTED REALITY IN THE CALCULUS CLASSROOM
    Vega, J.
    Nieto, A.
    Cordoba, C.
    Gil, G.
    Trefftz, H.
    Esteban, P.
    14TH INTERNATIONAL TECHNOLOGY, EDUCATION AND DEVELOPMENT CONFERENCE (INTED2020), 2020, : 7309 - 7317
  • [29] A Study of Virtual Reality Headsets and Physiological Extension Possibilities
    Siriborvornratanakul, Thitirat
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2016, PT II, 2016, 9787 : 497 - 508
  • [30] Interactive Visualization of Software Components with Virtual Reality Headsets
    Schreiber, Andreas
    Brueggemann, Marlene
    2017 IEEE WORKING CONFERENCE ON SOFTWARE VISUALIZATION (VISSOFT 2017), 2017, : 119 - 123