XFall: Domain Adaptive Wi-Fi-Based Fall Detection With Cross-Modal Supervision

被引:3
|
作者
Chi, Guoxuan [1 ,2 ]
Zhang, Guidong [1 ,2 ]
Ding, Xuan [1 ,2 ]
Ma, Qiang [1 ,2 ]
Yang, Zheng [1 ,2 ]
Du, Zhenguo [3 ]
Xiao, Houfei [3 ]
Liu, Zhuang [3 ]
机构
[1] Tsinghua Univ, Sch Software, Beijing 100084, Peoples R China
[2] Tsinghua Univ, BNRist, Beijing 100084, Peoples R China
[3] Huawei Technol Co Ltd, Shenzhen 518129, Peoples R China
关键词
Fall detection; Feature extraction; Wireless fidelity; Sensors; Training; Wireless sensor networks; Wireless communication; Domain adaptation; fall detection; statistical electric field; transformer encoder; cross-modal supervision; DETECTION SYSTEM;
D O I
10.1109/JSAC.2024.3413997
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent years have witnessed an increasing demand for human fall detection systems. Among all existing methods, Wi-Fi-based fall detection has become one of the most promising solutions due to its pervasiveness. However, when applied to a new domain, existing Wi-Fi-based solutions suffer from severe performance degradation caused by low generalizability. In this paper, we propose XFall, a domain-adaptive fall detection system based on Wi-Fi. XFall overcomes the generalization problem from three aspects. To advance cross-environment sensing, XFall exploits an environment-independent feature called speed distribution profile, which is irrelevant to indoor layout and device deployment. To ensure sensitivity across all fall types, an attention-based encoder is designed to extract the general fall representation by associating both the spatial and temporal dimensions of the input. To train a large model with limited amounts of Wi-Fi data, we design a cross-modal learning framework, adopting a pre-trained visual model for supervision during the training process. We implement and evaluate XFall on one of the latest commercial wireless products through a year-long deployment in real-world settings. The result shows XFall achieves an overall accuracy of 96.8%, with a miss alarm rate of 3.1% and a false alarm rate of 3.3%, outperforming the state-of-the-art solutions in both in-domain and cross-domain evaluation.
引用
收藏
页码:2457 / 2471
页数:15
相关论文
共 50 条
  • [31] DOMAIN UNCERTAINTY BASED ON INFORMATION THEORY FOR CROSS-MODAL HASH RETRIEVAL
    Chen, Wei
    Pu, Nan
    Liu, Yu
    Bakker, Erwin M.
    Lew, Michael S.
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 43 - 48
  • [32] A Cross-Modal CCA-Based Astroturfing Detection Approach
    Bai, Xiaoxuan
    Xiang, Yingxiao
    Niu, Wenjia
    Liu, Jiqiang
    Chen, Tong
    Liu, Jingjing
    Wu, Tong
    INFORMATION AND COMMUNICATIONS SECURITY, ICICS 2017, 2018, 10631 : 582 - 592
  • [33] Cross-Modal Rumor Detection Based on Adversarial Neural Network
    Jiana, Meng
    Xiaopei, Wang
    Ting, Li
    Shuang, Liu
    Di, Zhao
    Data Analysis and Knowledge Discovery, 2022, 6 (12) : 32 - 42
  • [34] Cross-Modal Supervision-Based Multitask Learning With Automotive Radar Raw Data
    Jin, Yi
    Deligiannis, Anastasios
    Fuentes-Michel, Juan-Carlos
    Vossiek, Martin
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (04): : 3012 - 3025
  • [35] Cross-Modal Adaptive Interaction Network for RGB-D Saliency Detection
    Du, Qinsheng
    Bian, Yingxu
    Wu, Jianyu
    Zhang, Shiyan
    Zhao, Jian
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [36] Interact before Align: Leveraging Cross-Modal Knowledge for Domain Adaptive Action Recognition
    Yang, Lijin
    Huang, Yifei
    Sugano, Yusuke
    Sato, Yoichi
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14702 - 14712
  • [37] Fall Detection using Wi-Fi Signals and Threshold-Based Activity Segmentation
    Keenan, Robert M.
    Le-Nam Tran
    2020 IEEE 31ST ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2020,
  • [38] A Multi-class Dataset Expansion Method for Wi-Fi- Based Fall Detection
    Wen, Xin
    Song, Xinran
    Zheng, Zhi
    Wang, Bo
    Guo, Yongxin
    2022 IEEE MTT-S INTERNATIONAL MICROWAVE BIOMEDICAL CONFERENCE (IMBIOC), 2022, : 195 - 197
  • [39] Unsupervised domain adaptation for lip reading based on cross-modal knowledge distillation
    Yuki Takashima
    Ryoichi Takashima
    Ryota Tsunoda
    Ryo Aihara
    Tetsuya Takiguchi
    Yasuo Ariki
    Nobuaki Motoyama
    EURASIP Journal on Audio, Speech, and Music Processing, 2021
  • [40] Unsupervised domain adaptation for lip reading based on cross-modal knowledge distillation
    Takashima, Yuki
    Takashima, Ryoichi
    Tsunoda, Ryota
    Aihara, Ryo
    Takiguchi, Tetsuya
    Ariki, Yasuo
    Motoyama, Nobuaki
    EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2021, 2021 (01)