Fine-Grained Image Generation Network With Radar Range Profiles Using Cross-Modal Visual Supervision

被引:3
|
作者
Bao, Jiacheng [1 ]
Li, Da [1 ]
Li, Shiyong [1 ]
Zhao, Guoqiang [1 ]
Sun, Houjun [1 ]
Zhang, Yi [1 ]
机构
[1] Beijing Inst Technol, Sch Integrated Circuits & Elect, Beijing Key Lab Millimeter Wave & Terahertz Tech, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modal supervision; deep neural network (DNN); electromagnetic imaging; generative adversarial network (GAN); radar range profile; CONVOLUTIONAL NEURAL-NETWORK; ENTROPY; RECONSTRUCTION; RESOLUTION;
D O I
10.1109/TMTT.2023.3299615
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Electromagnetic imaging methods mainly utilize converted sampling, dimensional transformation, and coherent processing to obtain spatial images of targets, which often suffer from accuracy and efficiency problems. Deep neural network (DNN)-based high-resolution imaging methods have achieved impressive results in improving resolution and reducing computational costs. However, previous works exploit single modality information from electromagnetic data; thus, the performances are limited. In this article, we propose an electromagnetic image generation network (EMIG-Net), which translates electromagnetic data of multiview 1-D range profiles (1DRPs), directly into bird-view 2-D high-resolution images under cross-modal supervision. We construct an adversarial generative framework with visual images as supervision to significantly improve the imaging accuracy. Moreover, the network structure is carefully designed to optimize computational efficiency. Experiments on self-built synthetic data and experimental data in the anechoic chamber show that our network has the ability to generate high-resolution images, whose visual quality is superior to that of traditional imaging methods and DNN-based methods, while consuming less computational cost. Compared with the backprojection (BP) algorithm, the EMIG-Net gains a significant improvement in entropy (72%), peak signal-to-noise ratio (PSNR; 150%), and structural similarity (SSIM; 153%). Our work shows the broad prospects of deep learning in radar data representation and high-resolution imaging and provides a path for researching electromagnetic imaging based on learning theory.
引用
收藏
页码:1339 / 1352
页数:14
相关论文
共 50 条
  • [1] Fine-grained Image-text Matching by Cross-modal Hard Aligning Network
    Pan, Zhengxin
    Wu, Fangyu
    Zhang, Bailing
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19275 - 19284
  • [2] Cross-Modal Face Matching: Tackling Visual Abstraction using Fine-Grained Attributes
    Hu, Yichuan
    Li, Ke
    Zhang, Honggang
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [3] Fine-Grained Visual Textual Alignment for Cross-Modal Retrieval Using Transformer Encoders
    Messina, Nicola
    Amato, Giuseppe
    Esuli, Andrea
    Falchi, Fabrizio
    Gennaro, Claudio
    Marchand-Maillet, Stephane
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (04)
  • [4] Deep cross-modal hashing with fine-grained similarity
    Yangdong Chen
    Jiaqi Quan
    Yuejie Zhang
    Rui Feng
    Tao Zhang
    Applied Intelligence, 2023, 53 : 28954 - 28973
  • [5] Deep cross-modal hashing with fine-grained similarity
    Chen, Yangdong
    Quan, Jiaqi
    Zhang, Yuejie
    Feng, Rui
    Zhang, Tao
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28954 - 28973
  • [6] Cross-modal knowledge learning with scene text for fine-grained image classification
    Xiong, Li
    Mao, Yingchi
    Wang, Zicheng
    Nie, Bingbing
    Li, Chang
    IET IMAGE PROCESSING, 2024, 18 (06) : 1447 - 1459
  • [7] Fine-grained Feature Assisted Cross-modal Image-text Retrieval
    Bu, Chaofei
    Liu, Xueliang
    Huang, Zhen
    Su, Yuling
    Tu, Junfeng
    Hong, Richang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XI, 2025, 15041 : 306 - 320
  • [8] Fine-grained Cross-modal Alignment Network for Text-Video Retrieval
    Han, Ning
    Chen, Jingjing
    Xiao, Guangyi
    Zhang, Hao
    Zeng, Yawen
    Chen, Hao
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3826 - 3834
  • [9] Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrieval
    Yuan, Zhiqiang
    Zhang, Wenkai
    Fu, Kun
    Li, Xuan
    Deng, Chubo
    Wang, Hongqi
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Paired Cross-Modal Data Augmentation for Fine-Grained Image-to-Text Retrieval
    Wang, Hao
    Lin, Guosheng
    Hoi, Steven
    Miao, Chunyan
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 5517 - 5526