GaitLock: Protect Virtual and Augmented Reality Headsets Using Gait

被引:29
|
作者
Shen, Yiran [1 ]
Wen, Hongkai [2 ]
Luo, Chengwen [3 ]
Xu, Weitao [3 ]
Zhang, Tao [1 ]
Hu, Wen [4 ]
Rus, Daniela [5 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
[2] Univ Warwick, Dept Comp Sci, Coventry CV4 7AL, W Midlands, England
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[4] Univ New South Wales, Sch Engn & Comp Sci, Sydney, NSW 2052, Australia
[5] MIT, Comp Sci & Artificial Intelligence Lab, 77 Massachusetts Ave, Cambridge, MA 02139 USA
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Gait recognition; VR/AR; sparse representation classification; dynamic time warping; FACE RECOGNITION; INTERNET;
D O I
10.1109/TDSC.2018.2800048
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the fast penetration of commercial Virtual Reality (VR) and Augmented Reality (AR) systems into our daily life, the security issues of those devices have attracted significant interests from both academia and industry. Modern VR/AR systems typically use head-mounted devices (i.e., headsets) to interact with users, and often store private user data, e.g., social network accounts, online transactions or even payment information. This poses significant security threats, since in practice the headset can be potentially obtained and accessed by unauthenticated parties, e.g., identity thieves, and thus cause catastrophic breach. In this paper, we propose a novel GaitLock system, which can reliably authenticate users using their gait signatures. Our system doesn't require extra hardware, e.g., fingerprint sensors or retina scanners, but only uses the on-board inertial measurement units (IMUs) equipped in almost all mainstream VR/AR headsets to authenticate the legitimate users from intruders, by simply asking them to walk a few steps. To achieve that, we propose a new gait recognition model Dynamic-SRC, which combines the strength of Dynamic Time Warping (DTW) and Sparse Representation Classifier (SRC), to extract unique gait patterns from the inertial signals during walking. We implement GaitLock on Google Glass (a typical AR headset), and extensive experiments show that GaitLock outperforms the state-of-the-art systems significantly in recognition accuracy (> 98 percent success in 5 steps), and is able to run in-situ on the resource-constrained VR/AR headsets without incurring high energy cost.
引用
收藏
页码:484 / 497
页数:14
相关论文
共 50 条
  • [31] Virtual reality headsets for perimetry testing: a systematic review
    Kavin Selvan
    Mina Mina
    Hana Abdelmeguid
    Muhammad Gulsha
    Ajoy Vincent
    Abdullah Sarhan
    Eye, 2024, 38 : 1041 - 1064
  • [32] Virtual Lab Using Markerless Augmented Reality
    Abhishek, M. T.
    Aswin, P. S.
    Nihal, Akhil C.
    Souban, Ali
    Shafeeque, Muhammedali K.
    Vial, Alanna
    PROCEEDINGS OF 2018 IEEE INTERNATIONAL CONFERENCE ON TEACHING, ASSESSMENT, AND LEARNING FOR ENGINEERING (TALE), 2018, : 1150 - 1153
  • [33] Crime Data Visualization Using Virtual Reality and Augmented Reality
    Dronavalli, Sri Chandra
    Pesaladinne, Rishitha Reddy
    Sharma, Sharad
    2023 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE, CSCI 2023, 2023, : 646 - 651
  • [34] Preferred Model of Adaptation to Dark for Virtual Reality Headsets
    Wernikowski, Marek
    Mantiuk, Radoslaw
    Piorkowski, Rafal
    MULTIMEDIA MODELING (MMM 2019), PT I, 2019, 11295 : 118 - 129
  • [35] Examining the Presentation of Information in Augmented Reality Headsets for Situational Awareness
    Woodward, Julia
    Smith, Jesse
    Wang, Isaac
    Cuenca, Sofia
    Ruiz, Jaime
    PROCEEDINGS OF THE WORKING CONFERENCE ON ADVANCED VISUAL INTERFACES AVI 2020, 2020,
  • [36] Virtual reality headsets for perimetry testing: a systematic review
    Selvan, Kavin
    Mina, Mina
    Abdelmeguid, Hana
    Gulsha, Muhammad
    Vincent, Ajoy
    Sarhan, Abdullah
    EYE, 2024, 38 (06) : 1041 - 1064
  • [37] Virtual reality headsets in plastic surgery trauma assessment
    McCartney, Conor
    Martin-Smith, Jamie
    JOURNAL OF PLASTIC RECONSTRUCTIVE AND AESTHETIC SURGERY, 2024, 93 : 213 - 214
  • [38] Virtual and Augmented Reality
    Interrante, Victoria
    Hollerer, Tobias
    Lecuyer, Anatole
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2018, 38 (02) : 28 - 30
  • [39] Virtual Reality Headsets Make Their Way Into Construction and Design
    Hill, David
    CIVIL ENGINEERING, 2016, 86 (01): : 37 - 37
  • [40] Research on Immersion for Learning Using Virtual Reality, Augmented Reality and Mixed Reality
    Chang, Chun-Yen
    Chen, Chia-Li Debra
    Chang, Wei-Kai
    ENFANCE, 2019, (03) : 413 - 426