GaitLock: Protect Virtual and Augmented Reality Headsets Using Gait

被引:29
|
作者
Shen, Yiran [1 ]
Wen, Hongkai [2 ]
Luo, Chengwen [3 ]
Xu, Weitao [3 ]
Zhang, Tao [1 ]
Hu, Wen [4 ]
Rus, Daniela [5 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
[2] Univ Warwick, Dept Comp Sci, Coventry CV4 7AL, W Midlands, England
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[4] Univ New South Wales, Sch Engn & Comp Sci, Sydney, NSW 2052, Australia
[5] MIT, Comp Sci & Artificial Intelligence Lab, 77 Massachusetts Ave, Cambridge, MA 02139 USA
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Gait recognition; VR/AR; sparse representation classification; dynamic time warping; FACE RECOGNITION; INTERNET;
D O I
10.1109/TDSC.2018.2800048
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the fast penetration of commercial Virtual Reality (VR) and Augmented Reality (AR) systems into our daily life, the security issues of those devices have attracted significant interests from both academia and industry. Modern VR/AR systems typically use head-mounted devices (i.e., headsets) to interact with users, and often store private user data, e.g., social network accounts, online transactions or even payment information. This poses significant security threats, since in practice the headset can be potentially obtained and accessed by unauthenticated parties, e.g., identity thieves, and thus cause catastrophic breach. In this paper, we propose a novel GaitLock system, which can reliably authenticate users using their gait signatures. Our system doesn't require extra hardware, e.g., fingerprint sensors or retina scanners, but only uses the on-board inertial measurement units (IMUs) equipped in almost all mainstream VR/AR headsets to authenticate the legitimate users from intruders, by simply asking them to walk a few steps. To achieve that, we propose a new gait recognition model Dynamic-SRC, which combines the strength of Dynamic Time Warping (DTW) and Sparse Representation Classifier (SRC), to extract unique gait patterns from the inertial signals during walking. We implement GaitLock on Google Glass (a typical AR headset), and extensive experiments show that GaitLock outperforms the state-of-the-art systems significantly in recognition accuracy (> 98 percent success in 5 steps), and is able to run in-situ on the resource-constrained VR/AR headsets without incurring high energy cost.
引用
收藏
页码:484 / 497
页数:14
相关论文
共 50 条
  • [41] Reality Media: Augmented and Virtual Reality
    Murphy, Dooley
    NEW MEDIA & SOCIETY, 2022, 24 (09) : 2181 - 2183
  • [42] LAW, VIRTUAL REALITY, AND AUGMENTED REALITY
    Lemley, Mark A.
    Volokh, Eugene
    UNIVERSITY OF PENNSYLVANIA LAW REVIEW, 2018, 166 (05) : 1051 - 1138
  • [43] Augmented Reality und Virtual Reality
    Matthias Knoll
    Stefan Stieglitz
    HMD Praxis der Wirtschaftsinformatik, 2022, 59 (1) : 1 - 5
  • [44] Augmented Reality Based Virtual Reality
    Raajan, N. R.
    Suganya, S.
    Priya, M. V.
    Ramanan, Sruthi V.
    Janani, S.
    Nandini, N. S. Sarada
    Hemanand, R.
    Gayathri, S.
    INTERNATIONAL CONFERENCE ON MODELLING OPTIMIZATION AND COMPUTING, 2012, 38 : 1559 - 1565
  • [45] Virtual Reality and Augmented Reality in Education
    Bazavan, Lidia-Cristina
    Roibu, Horatiu
    Besnea, Florina
    Cismaru, Stefan Irinel
    George, Bizdoaca Nicu
    PROCEEDINGS OF THE 2021 30TH ANNUAL CONFERENCE OF THE EUROPEAN ASSOCIATION FOR EDUCATION IN ELECTRICAL AND INFORMATION ENGINEERING (EAEEIE), 2021, : 82 - 85
  • [46] Multimedia in Virtual Reality and Augmented Reality
    Chen, Shu-Ching
    IEEE MULTIMEDIA, 2021, 28 (02) : 5 - 7
  • [47] Cybersickness in Virtual Reality and Augmented Reality
    Lawson, Ben D.
    Stanney, Kay M.
    FRONTIERS IN VIRTUAL REALITY, 2021, 2
  • [48] Development of a Gait Recognition Visualization System Using Augmented Reality
    Hurtado, Josue
    Saint-Priest, Yana
    Caicedo, Eddier
    2019 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV), 2019, : 196 - 199
  • [49] Enhancing Bridges' Safety Training Using Augmented Reality and Virtual Reality
    El Rifaee, M.
    Bader, S.
    Abotaleb, I.
    Hosny, O.
    Nassar, K.
    PROCEEDINGS OF THE CANADIAN SOCIETY OF CIVIL ENGINEERING ANNUAL CONFERENCE 2022, VOL 1, CSCE 2022, 2023, 363 : 173 - 196
  • [50] Exploring the Potential of Using Augmented Reality and Virtual Reality for STEM Education
    Al-Azawi, Rula
    Albadi, Ali
    Moghaddas, Raziyeh
    Westlake, Jonathan
    LEARNING TECHNOLOGY FOR EDUCATION CHALLENGES, LTEC 2019, 2019, 1011 : 36 - 44