Recognition of Micro-Motion Space Targets Based on Attention-Augmented Cross-Modal Feature Fusion Recognition Network

被引:11
|
作者
Tian, Xudong [1 ]
Bai, Xueru [2 ]
Zhou, Feng [1 ]
机构
[1] Xidian Univ, Key Lab Elect Informat Countermeasure & Simulat Te, Minist Educ, Xian 710071, Peoples R China
[2] Xidian Univ, Natl Key Lab Radar Signal Proc, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention-augmented cross-modal feature fusion recognition (ACM-FR); convolutional neural network (CNN); feature fusion; inverse synthetic aperture radar (ISAR); micro-motion space target; SIGNATURE EXTRACTION; PARAMETER-ESTIMATION; DOPPLER;
D O I
10.1109/TGRS.2023.3275991
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Narrowband and wideband waveforms are usually adopted simultaneously during the observation of micro-motion space targets by inverse synthetic aperture radar (ISAR), which can collect rich multimodal information in the time-Doppler, time-range, and range-instantaneous-Doppler (RID) domains. In order to exploit the electromagnetic scattering, shape, structure, and motion characteristics, this article proposes an attention-augmented cross-modal feature fusion recognition network (ACM-FR Net). First, the ACM-FR Net adopts a convolutional neural network (CNN) to extract initial feature vectors from joint time-frequency (JTF) image, high-resolution range profiles (HRRPs), and RID image. Then, it transforms the feature vectors of the three modalities into feature sequences. Finally, it achieves interactive feature fusion by implementing ACM feature fusion. In the four-category micro-motion space target recognition experiments, the proposed ACM-FR Net has demonstrated high accuracy and noise robustness.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Fast Graph Convolution Network Based Multi-label Image Recognition via Cross-modal Fusion
    Wang, Yangtao
    Xie, Yanzhao
    Liu, Yu
    Zhou, Ke
    Li, Xiaocui
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 1575 - 1584
  • [42] Modality Compensation Network: Cross-Modal Adaptation for Action Recognition
    Song, Sijie
    Liu, Jiaying
    Li, Yanghao
    Guo, Zongming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 3957 - 3969
  • [43] Large Margin Coupled Feature Learning for Cross-Modal Face Recognition
    Jin, Yi
    Lu, Jiwen
    Ruan, Qiuqi
    2015 INTERNATIONAL CONFERENCE ON BIOMETRICS (ICB), 2015, : 286 - 292
  • [44] Multi-Scale Cross-Modal Spatial Attention Fusion for Multi-label Image Recognition
    Li, Junbing
    Zhang, Changqing
    Wang, Xueman
    Du, Ling
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT I, 2020, 12396 : 736 - 747
  • [45] Incongruity-Aware Cross-Modal Attention for Audio-Visual Fusion in Dimensional Emotion Recognition
    Praveen, R. Gnana
    Alam, Jahangir
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2024, 18 (03) : 444 - 458
  • [46] Research on cross-modal emotion recognition based on multi-layer semantic fusion
    Xu Z.
    Gao Y.
    Mathematical Biosciences and Engineering, 2024, 21 (02) : 2488 - 2514
  • [47] Hybrid Network Based on Cross-Modal Feature Fusion for Diagnosis of Alzheimer's Disease
    Qiu, Zifeng
    Yang, Peng
    Wang, Tianfu
    Lei, Baiying
    ETHICAL AND PHILOSOPHICAL ISSUES IN MEDICAL IMAGING, MULTIMODAL LEARNING AND FUSION ACROSS SCALES FOR CLINICAL DECISION SUPPORT, AND TOPOLOGICAL DATA ANALYSIS FOR BIOMEDICAL IMAGING, EPIMI 2022, ML-CDS 2022, TDA4BIOMEDICALIMAGING, 2022, 13755 : 87 - 99
  • [48] CATNet: Cross-modal fusion for audio-visual speech recognition
    Wang, Xingmei
    Mi, Jiachen
    Li, Boquan
    Zhao, Yixu
    Meng, Jiaxiang
    PATTERN RECOGNITION LETTERS, 2024, 178 : 216 - 222
  • [49] CroMM-VSR: Cross-Modal Memory Augmented Visual Speech Recognition
    Kim, Minsu
    Hong, Joanna
    Park, Se Jin
    Ro, Yong Man
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4342 - 4355
  • [50] CMFFN: An efficient cross-modal feature fusion network for semantic segmentation
    Zhang, Yingjian
    Li, Ning
    Jiao, Jichao
    Ai, Jiawen
    Yan, Zheng
    Zeng, Yingchao
    Zhang, Tianxiang
    Li, Qian
    Robotics and Autonomous Systems, 2025, 186