Fine-Grained Image Generation Network With Radar Range Profiles Using Cross-Modal Visual Supervision

被引:3
|
作者
Bao, Jiacheng [1 ]
Li, Da [1 ]
Li, Shiyong [1 ]
Zhao, Guoqiang [1 ]
Sun, Houjun [1 ]
Zhang, Yi [1 ]
机构
[1] Beijing Inst Technol, Sch Integrated Circuits & Elect, Beijing Key Lab Millimeter Wave & Terahertz Tech, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modal supervision; deep neural network (DNN); electromagnetic imaging; generative adversarial network (GAN); radar range profile; CONVOLUTIONAL NEURAL-NETWORK; ENTROPY; RECONSTRUCTION; RESOLUTION;
D O I
10.1109/TMTT.2023.3299615
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Electromagnetic imaging methods mainly utilize converted sampling, dimensional transformation, and coherent processing to obtain spatial images of targets, which often suffer from accuracy and efficiency problems. Deep neural network (DNN)-based high-resolution imaging methods have achieved impressive results in improving resolution and reducing computational costs. However, previous works exploit single modality information from electromagnetic data; thus, the performances are limited. In this article, we propose an electromagnetic image generation network (EMIG-Net), which translates electromagnetic data of multiview 1-D range profiles (1DRPs), directly into bird-view 2-D high-resolution images under cross-modal supervision. We construct an adversarial generative framework with visual images as supervision to significantly improve the imaging accuracy. Moreover, the network structure is carefully designed to optimize computational efficiency. Experiments on self-built synthetic data and experimental data in the anechoic chamber show that our network has the ability to generate high-resolution images, whose visual quality is superior to that of traditional imaging methods and DNN-based methods, while consuming less computational cost. Compared with the backprojection (BP) algorithm, the EMIG-Net gains a significant improvement in entropy (72%), peak signal-to-noise ratio (PSNR; 150%), and structural similarity (SSIM; 153%). Our work shows the broad prospects of deep learning in radar data representation and high-resolution imaging and provides a path for researching electromagnetic imaging based on learning theory.
引用
收藏
页码:1339 / 1352
页数:14
相关论文
共 50 条
  • [21] Multi-label adversarial fine-grained cross-modal retrieval
    Sun, Chunpu
    Zhang, Huaxiang
    Liu, Li
    Liu, Dongmei
    Wang, Lin
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 117
  • [22] Cross-Modal Fine-Grained Interaction Fusion in Fake News Detection
    Che, Zhanbin
    Cui, GuangBo
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (05) : 945 - 956
  • [23] Integration of Global and Local Representations for Fine-Grained Cross-Modal Alignment
    Jin, Seungwan
    Choi, Hoyoung
    Noh, Taehyung
    Han, Kyungsik
    COMPUTER VISION - ECCV 2024, PT LXXXIII, 2025, 15141 : 53 - 70
  • [24] VIDEO-MUSIC RETRIEVAL WITH FINE-GRAINED CROSS-MODAL ALIGNMENT
    Era, Yuki
    Togo, Ren
    Maeda, Keisuke
    Ogawa, Takahiro
    Haseyama, Miki
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2005 - 2009
  • [25] RODNet: Radar Object Detection using Cross-Modal Supervision
    Wang, Yizhou
    Jiang, Zhongyu
    Gao, Xiangyu
    Hwang, Jenq-Neng
    Xing, Guanbin
    Liu, Hui
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 504 - 513
  • [26] Deep cascaded cross-modal correlation learning for fine-grained sketch-based image retrieval
    Wang, Yanfei
    Huang, Fei
    Zhang, Yuejie
    Feng, Rui
    Zhang, Tao
    Fan, Weiguo
    PATTERN RECOGNITION, 2020, 100 (100)
  • [27] Histopathology language-image representation learning for fine-grained digital pathology cross-modal retrieval
    Hu, Dingyi
    Jiang, Zhiguo
    Shi, Jun
    Xie, Fengying
    Wu, Kun
    Tang, Kunming
    Cao, Ming
    Huai, Jianguo
    Zheng, Yushan
    MEDICAL IMAGE ANALYSIS, 2024, 35
  • [28] TECMH: Transformer-Based Cross-Modal Hashing For Fine-Grained Image-Text Retrieval
    Li, Qiqi
    Ma, Longfei
    Jiang, Zheng
    Li, Mingyong
    Jin, Bo
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 3713 - 3728
  • [29] Fine-grained similarity semantic preserving deep hashing for cross-modal retrieval
    Li, Guoyou
    Peng, Qingjun
    Zou, Dexu
    Yang, Jinyue
    Shu, Zhenqiu
    FRONTIERS IN PHYSICS, 2023, 11
  • [30] Fine-Grained Cross-Modal Contrast Learning for Video-Text Retrieval
    Liu, Hui
    Lv, Gang
    Gu, Yanhong
    Nian, Fudong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT V, ICIC 2024, 2024, 14866 : 298 - 310