Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

被引:4
|
作者
Cao, Lin [1 ,2 ]
Liang, Song [1 ,2 ]
Zhao, Zongmin [1 ,2 ]
Wang, Dongfeng [3 ]
Fu, Chong [4 ]
Du, Kangning [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100101, Peoples R China
[3] Beijing TransMicrowave Technol Co, Beijing 100080, Peoples R China
[4] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
基金
美国国家科学基金会;
关键词
human activity recognition; attention mechanism; multi-domain feature fusion; multi-classification focus loss; FMCW radar sensor; NEURAL-NETWORK; CLASSIFICATION; CHANNEL;
D O I
10.3390/s23115100
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a human activity recognition (HAR) method for frequency-modulated continuous wave (FMCW) radar sensors. The method utilizes a multi-domain feature attention fusion network (MFAFN) model that addresses the limitation of relying on a single range or velocity feature to describe human activity. Specifically, the network fuses time-Doppler (TD) and time-range (TR) maps of human activities, resulting in a more comprehensive representation of the activities being performed. In the feature fusion phase, the multi-feature attention fusion module (MAFM) combines features of different depth levels by introducing a channel attention mechanism. Additionally, a multi-classification focus loss (MFL) function is applied to classify confusable samples. The experimental results demonstrate that the proposed method achieves 97.58% recognition accuracy on the dataset provided by the University of Glasgow, UK. Compared to existing HAR methods for the same dataset, the proposed method showed an improvement of about 0.9-5.5%, especially in the classification of confusable activities, showing an improvement of up to 18.33%.
引用
下载
收藏
页数:25
相关论文
共 50 条
  • [31] Multi-class Motor Imagery Recognition of Single Joint in Upper Limb Based on Multi-domain Feature Fusion
    Shan Guan
    Zhen Yuan
    Fuwang Wang
    Jixian Li
    Xiaogang Kang
    Bin Lu
    Neural Processing Letters, 2023, 55 : 8927 - 8945
  • [32] Multi-class Motor Imagery Recognition of Single Joint in Upper Limb Based on Multi-domain Feature Fusion
    Guan, Shan
    Yuan, Zhen
    Wang, Fuwang
    Li, Jixian
    Kang, Xiaogang
    Lu, Bin
    NEURAL PROCESSING LETTERS, 2023, 55 (07) : 8927 - 8945
  • [33] Radar HRRP Feature Fusion Recognition Method Based on ConvLSTM Network with Multi-Input Gate Recurrent Unit
    Yang, Wei
    Chen, Tianqi
    Lei, Shiwen
    Zhao, Zhiqin
    Hu, Haoquan
    Hu, Jun
    Remote Sensing, 2024, 16 (23)
  • [34] Radar-Based Human Activity Recognition Using Dual-Stream Spatial and Temporal Feature Fusion Network
    Li, Jianjun
    Xu, Hongji
    Zeng, Jiaqi
    Ai, Wentao
    Li, Shijie
    Li, Xiaoman
    Li, Xinya
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (02) : 1835 - 1847
  • [35] Human interactive behaviour recognition method based on multi-feature fusion
    Ye, Qing
    Li, Rui
    Yang, Hang
    Guo, Xinran
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2022, 25 (03) : 262 - 271
  • [36] Fault diagnosis of blade crack based on multi-domain feature and information fusion
    Ma, Tianchi
    Shen, Junxian
    Song, Di
    Xu, Feiyun
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2024, 54 (06): : 1567 - 1573
  • [37] Perceptual authentication hashing for digital images based on multi-domain feature fusion
    Cao, Fang
    Yao, Shifei
    Zhou, Yuanding
    Yao, Heng
    Qin, Chuan
    SIGNAL PROCESSING, 2024, 223
  • [38] Specific Emitter Identification Based on Multi-Domain Feature Fusion and Integrated Learning
    Qu, Ling-Zhi
    Liu, Hui
    Huang, Ke-Ju
    Yang, Jun-An
    SYMMETRY-BASEL, 2021, 13 (08):
  • [39] AMFF: A new attention-based multi-feature fusion method for intention recognition
    Liu, Cong
    Xu, Xiaolong
    KNOWLEDGE-BASED SYSTEMS, 2021, 233
  • [40] Arrhythmia Classification Based on Multi-Domain Feature Extraction for an ECG Recognition System
    Li, Hongqiang
    Yuan, Danyang
    Wang, Youxi
    Cui, Dianyin
    Cao, Lu
    SENSORS, 2016, 16 (10)