Recognition of Micro-Motion Space Targets Based on Attention-Augmented Cross-Modal Feature Fusion Recognition Network

被引:11
|
作者
Tian, Xudong [1 ]
Bai, Xueru [2 ]
Zhou, Feng [1 ]
机构
[1] Xidian Univ, Key Lab Elect Informat Countermeasure & Simulat Te, Minist Educ, Xian 710071, Peoples R China
[2] Xidian Univ, Natl Key Lab Radar Signal Proc, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention-augmented cross-modal feature fusion recognition (ACM-FR); convolutional neural network (CNN); feature fusion; inverse synthetic aperture radar (ISAR); micro-motion space target; SIGNATURE EXTRACTION; PARAMETER-ESTIMATION; DOPPLER;
D O I
10.1109/TGRS.2023.3275991
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Narrowband and wideband waveforms are usually adopted simultaneously during the observation of micro-motion space targets by inverse synthetic aperture radar (ISAR), which can collect rich multimodal information in the time-Doppler, time-range, and range-instantaneous-Doppler (RID) domains. In order to exploit the electromagnetic scattering, shape, structure, and motion characteristics, this article proposes an attention-augmented cross-modal feature fusion recognition network (ACM-FR Net). First, the ACM-FR Net adopts a convolutional neural network (CNN) to extract initial feature vectors from joint time-frequency (JTF) image, high-resolution range profiles (HRRPs), and RID image. Then, it transforms the feature vectors of the three modalities into feature sequences. Finally, it achieves interactive feature fusion by implementing ACM feature fusion. In the four-category micro-motion space target recognition experiments, the proposed ACM-FR Net has demonstrated high accuracy and noise robustness.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] UCEMA: Uni-modal and cross-modal encoding network based on multi-head attention for emotion recognition in conversation
    Zhao, Hongkun
    Liu, Siyuan
    Chen, Yang
    Kong, Fanmin
    Zeng, Qingtian
    Li, Kang
    Multimedia Systems, 2024, 30 (06)
  • [32] Classification of Space Targets with Micro-motion Based on Deep CNN
    Wang, Yizhe
    Feng, Cunqian
    Zhang, Yongshun
    Ge, Qichao
    PROCEEDINGS OF 2019 IEEE 2ND INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION AND COMMUNICATION TECHNOLOGY (ICEICT 2019), 2019, : 557 - 561
  • [33] Recognition of Micro-Motion Jamming Based on Complex-Valued Convolutional Neural Network
    Shi, Chongwei
    Zhang, Qun
    Lin, Tao
    Liu, Zhidong
    Li, Shiliang
    SENSORS, 2023, 23 (03)
  • [34] Attention-Augmented Convolutional Autoencoder for Radar-Based Human Activity Recognition
    Campbell, Christopher
    Ahmad, Fauzia
    2020 IEEE INTERNATIONAL RADAR CONFERENCE (RADAR), 2020, : 990 - 995
  • [35] Temporal Attention-Augmented Graph Convolutional Network for Efficient Skeleton-Based Human Action Recognition
    Heidari, Negar
    Iosifidis, Alexandros
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7907 - 7914
  • [36] Holistic-Based Cross-Attention Modal Fusion Network for Video Sign Language Recognition
    Gao, Qing
    Hu, Jing
    Mai, Haixing
    Ju, Zhaojie
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024,
  • [37] Marine Targets Recognition Through Micro-Motion Estimation from SAR data
    Armenise, Davide
    Biondi, Filippo
    Addabbo, Pia
    Clemente, Carmine
    Orlando, Danilo
    2020 IEEE 7TH INTERNATIONAL WORKSHOP ON METROLOGY FOR AEROSPACE (METROAEROSPACE), 2020, : 37 - 42
  • [38] Speaker-aware cognitive network with cross-modal attention for multimodal emotion recognition in conversation
    Guo, Lili
    Song, Yikang
    Ding, Shifei
    KNOWLEDGE-BASED SYSTEMS, 2024, 296
  • [39] A Trimodel SAR Semisupervised Recognition Method Based on Attention-Augmented Convolutional Networks
    Yan, Sifan
    Zhang, Yaotian
    Gao, Fei
    Sun, Jinping
    Hussain, Amir
    Zhou, Huiyu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9566 - 9583
  • [40] Joint low-rank tensor fusion and cross-modal attention for multimodal physiological signals based emotion recognition
    Wan, Xin
    Wang, Yongxiong
    Wang, Zhe
    Tang, Yiheng
    Liu, Benke
    PHYSIOLOGICAL MEASUREMENT, 2024, 45 (07)