Towards Position-Independent Sensing for Gesture Recognition with Wi-Fi

被引:61
|
作者
Gao, Ruiyang [1 ]
Zhang, Mi [2 ]
Zhang, Jie [1 ]
Li, Yang [1 ]
Yi, Enze [1 ]
Wu, Dan [1 ]
Wang, Leye [1 ]
Zhang, Daqing [3 ,4 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Beijing, Peoples R China
[2] Michigan State Univ, E Lansing, MI 48824 USA
[3] Peking Univ, Minist Educ, Sch Elect Engn & Comp Sci, Key Lab High Confidence Software Technol, Beijing, Peoples R China
[4] Inst Polytech Paris, Telecom SudParis, Evry, France
关键词
Gesture Recognition; Wireless Sensing; Channel State Information (CSI);
D O I
10.1145/3463504
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Past decades have witnessed the extension of the Wi-Fi signals as a useful tool sensing human activities. One common assumption behind it is that there is a one-to-one mapping between human activities and Wi-Fi received signal patterns. However, this assumption does not hold when the user conducts activities in different locations and orientations. Actually, the received signal patterns of the same activity would become inconsistent when the relative location and orientation of the user with respect to transceivers change, leading to unstable sensing performance. This problem is known as the position-dependent problem, hindering the actual deployment of Wi-Fi-based sensing applications. In this paper, to tackle this fundamental problem, we develop a new position-independent sensing strategy and use gesture recognition as an application example to demonstrate its effectiveness. The key idea is to shift our observation from the traditional transceiver view to the hand-oriented view, and extract features that are irrespective of position-specific factors. Following the strategy, we design a position-independent feature, denoted as Motion Navigation Primitive(MNP). MNP captures the pattern of moving direction changes of the hand, which shares consistent patterns when the user performs the same gesture with different position-specific factors. By analyzing the pattern of MNP, we convert gestures into sequences of strokes(e.g, line, arc and corner) which makes them easy to be recognized. We build a prototype WiFi gesture recognition system,i.e., WiGesture to validate the effectiveness of the proposed strategy. Experiments show that our system can outperform the start-of-arts significantly in different settings. Given its novelty and superiority, we believe the proposed method symbolizes a major step towards gesture recognition and would inspire other solutions to position-independent activity recognition in the future.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Preliminary Investigation of Position Independent Gesture Recognition Using Wi-Fi CSI
    Ohara, Kazuya
    Maekawa, Takuya
    Sigg, Stephan
    Youssef, Moustafa
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS), 2018,
  • [2] Towards Position-independent Gesture Recognition Based on WiFi by Subcarrier Selection and Gesture Code
    Yu, Xiao
    Jiang, Ting
    Ding, Xue
    Yao, Zhenxiong
    Zhou, Xinyi
    Zhong, Yi
    [J]. 2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [3] Hand Gesture Recognition Based on Wi-Fi Chipsets
    Fan, Tenglong
    Ye, Dexin
    Hangfu, Jiangtao
    Sun, Yongzhi
    Li, Changzhi
    Ran, Lixin
    [J]. 2017 IEEE RADIO AND WIRELESS SYMPOSIUM (RWS), 2017, : 98 - 100
  • [4] Algorithm for interference filtering of Wi-Fi gesture recognition
    Han W.
    Yu J.
    [J]. International Journal of Information and Communication Technology, 2024, 24 (01) : 1 - 20
  • [5] WiCatch: A Wi-Fi Based Hand Gesture Recognition System
    Tian, Zengshan
    Wang, Jiacheng
    Yang, Xiaolong
    Zhou, Mu
    [J]. IEEE ACCESS, 2018, 6 : 16911 - 16923
  • [6] Wi-Fi Sensing - The Next Big Evolution of Wi-Fi
    Manku, Taj
    Kravets, Oleksiy
    [J]. MICROWAVE JOURNAL, 2023, 66 (07) : 54 - 56
  • [7] On Position-Independency Passive Gesture Tracking With Commodity Wi-Fi
    Han, Zijun
    Lu, Zhaoming
    Hu, Zhiqun
    Chen, Yawen
    Wen, Xiangming
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (14) : 16264 - 16275
  • [8] Wi-Fi based Gesture Recognition Using Deep Transfer Learning
    Bu, Qirong
    Yang, Gang
    Feng, Jun
    Ming, Xingxia
    [J]. 2018 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI), 2018, : 590 - 595
  • [9] Gesture Recognition with mmWave Wi-Fi Access Points: Lessons Learned
    Bhat, Nabeel Nisar
    Berkvens, Rafael
    Famaey, Jeroen
    [J]. 2023 IEEE 24TH INTERNATIONAL SYMPOSIUM ON A WORLD OF WIRELESS, MOBILE AND MULTIMEDIA NETWORKS, WOWMOM, 2023, : 127 - 136
  • [10] UbiGest: Smartphone-Based Ubiquitous Gesture Recognition With Wi-Fi
    Pohang University of Science and Technology , Department of Computer Sceience and Engineering, Pohang, Korea, Republic of
    不详
    [J]. IEEE Internet Things J.,