Towards Position-Independent Sensing for Gesture Recognition with Wi-Fi

被引:61
|
作者
Gao, Ruiyang [1 ]
Zhang, Mi [2 ]
Zhang, Jie [1 ]
Li, Yang [1 ]
Yi, Enze [1 ]
Wu, Dan [1 ]
Wang, Leye [1 ]
Zhang, Daqing [3 ,4 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Beijing, Peoples R China
[2] Michigan State Univ, E Lansing, MI 48824 USA
[3] Peking Univ, Minist Educ, Sch Elect Engn & Comp Sci, Key Lab High Confidence Software Technol, Beijing, Peoples R China
[4] Inst Polytech Paris, Telecom SudParis, Evry, France
关键词
Gesture Recognition; Wireless Sensing; Channel State Information (CSI);
D O I
10.1145/3463504
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Past decades have witnessed the extension of the Wi-Fi signals as a useful tool sensing human activities. One common assumption behind it is that there is a one-to-one mapping between human activities and Wi-Fi received signal patterns. However, this assumption does not hold when the user conducts activities in different locations and orientations. Actually, the received signal patterns of the same activity would become inconsistent when the relative location and orientation of the user with respect to transceivers change, leading to unstable sensing performance. This problem is known as the position-dependent problem, hindering the actual deployment of Wi-Fi-based sensing applications. In this paper, to tackle this fundamental problem, we develop a new position-independent sensing strategy and use gesture recognition as an application example to demonstrate its effectiveness. The key idea is to shift our observation from the traditional transceiver view to the hand-oriented view, and extract features that are irrespective of position-specific factors. Following the strategy, we design a position-independent feature, denoted as Motion Navigation Primitive(MNP). MNP captures the pattern of moving direction changes of the hand, which shares consistent patterns when the user performs the same gesture with different position-specific factors. By analyzing the pattern of MNP, we convert gestures into sequences of strokes(e.g, line, arc and corner) which makes them easy to be recognized. We build a prototype WiFi gesture recognition system,i.e., WiGesture to validate the effectiveness of the proposed strategy. Experiments show that our system can outperform the start-of-arts significantly in different settings. Given its novelty and superiority, we believe the proposed method symbolizes a major step towards gesture recognition and would inspire other solutions to position-independent activity recognition in the future.
引用
收藏
页数:28
相关论文
共 50 条
  • [31] Position-independent gesture recognition using sEMG signals via canonical correlation analysis
    Cheng, Juan
    Wei, Fulin
    Li, Chang
    Liu, Yu
    Liu, Aiping
    Chen, Xun
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2018, 103 : 44 - 54
  • [32] Towards Environment-Independent Activity Recognition Using Wi-Fi CSI with an Encoder-Decoder Network
    Sugimoto, Yu
    Rizk, Hamada
    Uchiyama, Akira
    Yamaguchi, Hirozumi
    [J]. PROCEEDINGS OF THE 2023 8TH WORKSHOP ON BODY-CENTRIC COMPUTING SYSTEMS, BODYSYS 2023, 2023, : 13 - 18
  • [33] Channel Independent Wi-Fi Backscatter Networks
    Kim, Taekyung
    Lee, Wonjun
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2019), 2019, : 262 - 270
  • [34] CARING: Towards Collaborative and Cross-Domain Wi-Fi Sensing: A Case Study for Human Activity Recognition
    Li, Xinyi
    Song, Fengyi
    Luo, Mina
    Li, Kang
    Chang, Liqiong
    Chen, Xiaojiang
    Wang, Zheng
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (02) : 1674 - 1688
  • [35] Eliminating the Barriers: Demystifying Wi-Fi Baseband Design and Introducing the PicoScenes Wi-Fi Sensing Platform
    Jiang, Zhiping
    Luan, Tom H.
    Ren, Xincheng
    Lv, Dongtao
    Hao, Han
    Wang, Jing
    Zhao, Kun
    Xi, Wei
    Xu, Yueshen
    Li, Rui
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (06) : 4476 - 4496
  • [36] Poster: Strobe - Towards Low Cost Soil Sensing Using Wi-Fi
    Ding, Jian
    Chandra, Ranveer
    [J]. MOBICOM'19: PROCEEDINGS OF THE 25TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING, 2019,
  • [37] Passive Human Sensing with COTS Wi-Fi
    Qian, Kun
    [J]. PHD FORUM '18: PROCEEDINGS OF THE 2018 WORKSHOP ON MOBISYS 2018 PH.D. FORUM, 2018, : 3 - 4
  • [38] Quantum Transfer Learning for Wi-Fi Sensing
    Koike-Akino, Toshiaki
    Wang, Pu
    Wang, Ye
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 654 - 659
  • [39] STROBE: TOWARDS LOW-COST SOIL SENSING USING WI-FI
    Ding, Jian
    Chandra, Ranveer
    [J]. GETMOBILE-MOBILE COMPUTING & COMMUNICATIONS REVIEW, 2019, 23 (04) : 30 - 33
  • [40] Device-Free Hand Gesture Recognition System Based on Commercial Wi-Fi Devices
    Tian, Zengshan
    Wang, Jiacheng
    Yang, Xiaolong
    Zhou, Mu
    [J]. PROCEEDINGS OF 5TH IEEE CONFERENCE ON UBIQUITOUS POSITIONING, INDOOR NAVIGATION AND LOCATION-BASED SERVICES (UPINLBS), 2018, : 350 - 355