Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

被引:4
|
作者
Cao, Lin [1 ,2 ]
Liang, Song [1 ,2 ]
Zhao, Zongmin [1 ,2 ]
Wang, Dongfeng [3 ]
Fu, Chong [4 ]
Du, Kangning [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100101, Peoples R China
[3] Beijing TransMicrowave Technol Co, Beijing 100080, Peoples R China
[4] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
基金
美国国家科学基金会;
关键词
human activity recognition; attention mechanism; multi-domain feature fusion; multi-classification focus loss; FMCW radar sensor; NEURAL-NETWORK; CLASSIFICATION; CHANNEL;
D O I
10.3390/s23115100
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a human activity recognition (HAR) method for frequency-modulated continuous wave (FMCW) radar sensors. The method utilizes a multi-domain feature attention fusion network (MFAFN) model that addresses the limitation of relying on a single range or velocity feature to describe human activity. Specifically, the network fuses time-Doppler (TD) and time-range (TR) maps of human activities, resulting in a more comprehensive representation of the activities being performed. In the feature fusion phase, the multi-feature attention fusion module (MAFM) combines features of different depth levels by introducing a channel attention mechanism. Additionally, a multi-classification focus loss (MFL) function is applied to classify confusable samples. The experimental results demonstrate that the proposed method achieves 97.58% recognition accuracy on the dataset provided by the University of Glasgow, UK. Compared to existing HAR methods for the same dataset, the proposed method showed an improvement of about 0.9-5.5%, especially in the classification of confusable activities, showing an improvement of up to 18.33%.
引用
下载
收藏
页数:25
相关论文
共 50 条
  • [1] Multi-domain Attention Fusion Network For Language Recognition
    Ju M.
    Xu Y.
    Ke D.
    Su K.
    SN Computer Science, 4 (1)
  • [2] A Multi-Domain Fusion Human Motion Recognition Method Based on Lightweight Network
    Chen, Pengyun
    Jian, Qiang
    Wu, Peilun
    Guo, Shisheng
    Cui, Guolong
    Jiang, Chaoshu
    Kong, Lingjiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [3] Through-Wall Human Motion Recognition Using Random Code Radar Sensor With Multi-Domain Feature Fusion
    Xu, Hang
    Li, Yong
    Li, Yingxin
    Li, Jingxia
    Wang, Bingjie
    Liu, Li
    IEEE SENSORS JOURNAL, 2022, 22 (15) : 15123 - 15132
  • [4] Active sonar target recognition method based on multi-domain transformations and attention-based fusion network
    Wang, Qingcui
    Du, Shuanping
    Zhang, Wei
    Wang, Fangyong
    IET RADAR SONAR AND NAVIGATION, 2024, : 1814 - 1828
  • [5] Radar emitter signal recognition based on ambiguity function multi-domain feature fusion and ensemble learning
    Pu Y.-W.
    Yu Y.-P.
    Jiang Y.
    Tian C.-J.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (01): : 39 - 48
  • [6] Electricity theft detection method based on multi-domain feature fusion
    Zhao, Hong-shan
    Sun, Cheng-yan
    Ma, Li-bo
    Xue, Yang
    Guo, Xiao-mei
    Chang, Jie-ying
    IET SCIENCE MEASUREMENT & TECHNOLOGY, 2023, 17 (03) : 93 - 104
  • [7] RFDANet: an FMCW and TOF radar fusion approach for driver activity recognition using multi-level attention based CNN and LSTM network
    Minming Gu
    Kaiyu Chen
    Zhixiang Chen
    Complex & Intelligent Systems, 2024, 10 : 1517 - 1530
  • [8] RFDANet: an FMCW and TOF radar fusion approach for driver activity recognition using multi-level attention based CNN and LSTM network
    Gu, Minming
    Chen, Kaiyu
    Chen, Zhixiang
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (01) : 1517 - 1530
  • [9] FMCW Radar Sensor Based Human Activity Recognition using Deep Learning
    Ahmed, Shahzad
    Park, Junbyung
    Cho, Sung Ho
    2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2022,
  • [10] DAMUN: A Domain Adaptive Human Activity Recognition Network Based on Multimodal Feature Fusion
    Feng, Xinxin
    Weng, Yuxin
    Li, Wenlong
    Chen, Pengcheng
    Zheng, Haifeng
    IEEE SENSORS JOURNAL, 2023, 23 (18) : 22019 - 22030