Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

被引:4
|
作者
Cao, Lin [1 ,2 ]
Liang, Song [1 ,2 ]
Zhao, Zongmin [1 ,2 ]
Wang, Dongfeng [3 ]
Fu, Chong [4 ]
Du, Kangning [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100101, Peoples R China
[3] Beijing TransMicrowave Technol Co, Beijing 100080, Peoples R China
[4] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
基金
美国国家科学基金会;
关键词
human activity recognition; attention mechanism; multi-domain feature fusion; multi-classification focus loss; FMCW radar sensor; NEURAL-NETWORK; CLASSIFICATION; CHANNEL;
D O I
10.3390/s23115100
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a human activity recognition (HAR) method for frequency-modulated continuous wave (FMCW) radar sensors. The method utilizes a multi-domain feature attention fusion network (MFAFN) model that addresses the limitation of relying on a single range or velocity feature to describe human activity. Specifically, the network fuses time-Doppler (TD) and time-range (TR) maps of human activities, resulting in a more comprehensive representation of the activities being performed. In the feature fusion phase, the multi-feature attention fusion module (MAFM) combines features of different depth levels by introducing a channel attention mechanism. Additionally, a multi-classification focus loss (MFL) function is applied to classify confusable samples. The experimental results demonstrate that the proposed method achieves 97.58% recognition accuracy on the dataset provided by the University of Glasgow, UK. Compared to existing HAR methods for the same dataset, the proposed method showed an improvement of about 0.9-5.5%, especially in the classification of confusable activities, showing an improvement of up to 18.33%.
引用
下载
收藏
页数:25
相关论文
共 50 条
  • [21] A method of jamming recognition based on multi-domain joint convolutional neural network
    Fan, Pengfei
    Wu, Yatao
    Wei, Yao
    Guo, Guoqiang
    Peng, Zhefan
    Proceedings of SPIE - The International Society for Optical Engineering, 2022, 12172
  • [22] Bearing fault diagnosis method based on multi-domain feature fusion and heterogeneous network under small sample conditions
    Zhao, Xiaoqiang
    Li, Sen
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, : 8131 - 8148
  • [23] Activity Classification Based on Feature Fusion of FMCW Radar Human Motion Micro-Doppler Signatures
    Abdu, Fahad Jibrin
    Zhang, Yixiong
    Deng, Zhenmiao
    IEEE SENSORS JOURNAL, 2022, 22 (09) : 8648 - 8662
  • [24] Research on Emotion Recognition Based on EEG Time-Frequency-Spatial Multi-Domain Feature Fusion
    Wang, Lu
    Liang, Mingjing
    Shi, Huiyu
    Wen, Xin
    Cao, Rui
    Computer Engineering and Applications, 2024, 59 (04) : 191 - 196
  • [25] Ultrasonic diagnosis method for stainless steel weld defects based on multi-domain feature fusion
    Zhang, Rui
    Zhao, Na
    Fu, Liuhu
    Pan, Lihu
    Bai, Xiaolu
    Song, Renwang
    SENSOR REVIEW, 2022, 42 (02) : 214 - 229
  • [26] Space emitter fine feature identification based on multi-domain fusion
    Wang Xiaohan
    Yan Yi
    Fan Yanan
    Li Xue
    Mou Jiao
    CHINESE SPACE SCIENCE AND TECHNOLOGY, 2023, 43 (04) : 126 - 136
  • [27] Hand gesture recognition method using FMCW radar based on multidomain fusion
    Yang, Tianhong
    Wu, Hanxu
    INTERNATIONAL JOURNAL OF MICROWAVE AND WIRELESS TECHNOLOGIES, 2023,
  • [28] Radar Human Activity Recognition with an Attention-Based Deep Learning Network
    Huan, Sha
    Wu, Limei
    Zhang, Man
    Wang, Zhaoyue
    Yang, Chao
    SENSORS, 2023, 23 (06)
  • [29] A Multi-domain Named Entity Recognition Method Based on Part-of-Speech Attention Mechanism
    Zhang, Shun
    Sheng, Ying
    Gao, Jiangfan
    Chen, Jianhui
    Huang, Jiajin
    Lin, Shaofu
    COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING, CHINESECSCW 2019, 2019, 1042 : 631 - 644
  • [30] Residual Neural Network Driven Human Activity Recognition by Exploiting FMCW Radar
    Li, Cong
    Wang, Xianpeng
    Shi, Jinmei
    Wang, Han
    Wan, Liangtian
    IEEE ACCESS, 2023, 11 : 111875 - 111887