Efficient physics-based learned reconstruction methods for real-time 3D near-field MIMO radar imaging

被引:4
|
作者
Manisali, Irfan [1 ]
Oral, Okyanus [1 ]
Oktem, Figen S. [1 ]
机构
[1] Middle East Tech Univ METU, Dept Elect & Elect Engn, TR-06800 Ankara, Turkiye
关键词
Radar imaging; Near-field microwave imaging; Deep learning; 3D inverse imaging problems; Sparse MIMO array; CONVOLUTIONAL NEURAL-NETWORK; INVERSE PROBLEMS; RECOVERY; ARRAYS;
D O I
10.1016/j.dsp.2023.104274
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Near-field multiple-input multiple-output (MIMO) radar imaging systems have recently gained significant attention. These systems generally reconstruct the three-dimensional (3D) complex-valued reflectivity distribution of the scene using sparse measurements. Consequently, imaging quality highly relies on the image reconstruction approach. Existing analytical reconstruction approaches suffer from either high computational cost or low image quality. In this paper, we develop novel non-iterative deep learning-based reconstruction methods for real-time near-field MIMO imaging. The goal is to achieve high image quality with low computational cost at compressive settings. The developed approaches have two stages. In the first approach, physics-based initial stage performs adjoint operation to back-project the measurements to the image-space, and deep neural network (DNN)-based second stage converts the 3D backprojected measurements to a magnitude-only reflectivity image. Since scene reflectivities often have random phase, DNN processes directly the magnitude of the adjoint result. As DNN, 3D U-Net is used to jointly exploit range and cross-range correlations. To comparatively evaluate the significance of exploiting physics in a learning-based approach, two additional approaches that replace the physics-based first stage with fully connected layers are also developed as purely learning based methods. The performance is also analyzed by changing the DNN architecture for the second stage to include complex-valued processing (instead of magnitude-only processing), 2D convolution kernels (instead of 3D), and ResNet architecture (instead of U-Net). Moreover, we develop a synthesizer to generate large-scale dataset for training the neural networks with 3D extended targets. We illustrate the performance through experimental data and extensive simulations. The results show the effectiveness of the developed physics based learned reconstruction approach compared to commonly used approaches in terms of both runtime and image quality at highly compressive settings. Our source codes and dataset are made available at https:// github .com /METU -SPACE-Lab /Efficient -Learned-3D -Near-Field-MIMO -Imaging upon publication to advance research in this field.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] A Real-time Handheld 3D Temperature Field Reconstruction System
    Zhao, Shibo
    Fang, Zheng
    Wen, Shiguang
    2017 IEEE 7TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2017, : 289 - 294
  • [22] A new approach of 3D SPECT reconstruction for near-field coded aperture imaging
    Hong, Baoming
    Mu, Zhiping
    Liu, Yi-Hwa
    MEDICAL IMAGING 2006: PHYSICS OF MEDICAL IMAGING, PTS 1-3, 2006, 6142
  • [23] Real-time near-field terahertz imaging with atomic optical fluorescence
    Wade C.G.
    Šibali N.
    De Melo N.R.
    Kondo J.M.
    Adams C.S.
    Weatherill K.J.
    Nature Photonics, 2017, 11 (1) : 40 - 43
  • [24] Real-time near-field terahertz imaging with atomic optical fluorescence
    Wade, C. G.
    Sibalic, N.
    de Melo, N. R.
    Kondo, J. M.
    Adams, C. S.
    Weatherill, K. J.
    NATURE PHOTONICS, 2017, 11 (01) : 40 - 43
  • [25] Near real-time 3D reconstruction from InIm video stream
    Chaikalis, D.
    Passalis, G.
    Sgouros, N.
    Maroulis, D.
    Theoharis, T.
    IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2008, 5112 : 336 - 347
  • [26] 3D Radar Imaging with a MIMO OFDM-based Radar
    Sit, Yoke Leen
    Nguyen, Thuy T.
    Zwick, Thomas
    2013 ASIA-PACIFIC MICROWAVE CONFERENCE PROCEEDINGS (APMC 2013), 2013, : 68 - 70
  • [27] An Efficient Near-Field Parallel Subarray Beamforming for Portable 3D Imaging Sonar
    Zhao, Dongdong
    Liu, Xuesong
    Zhou, Fan
    Jiang, Rongxin
    Hu, Yingtian
    Chen, Yaowu
    PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018), 2018, : 1120 - 1124
  • [28] Efficient 3-D Near-Field MIMO-SAR Imaging for Irregular Scanning Geometries
    Smith, Josiah W.
    Torlak, Murat
    IEEE ACCESS, 2022, 10 : 10283 - 10294
  • [29] Real-time 3D face modeling based on 3D face imaging
    Zhan, Shu
    Chang, Lele
    Zhao, Jingjing
    Kurihara, Toru
    Du, Hao
    Tang, Yucheng
    Cheng, Jun
    NEUROCOMPUTING, 2017, 252 : 42 - 48
  • [30] Efficient 3D imaging method of MIMO radar for moving target
    Wang W.
    Hu Z.
    Yue J.
    Tongxin Xuebao/Journal on Communications, 2019, 40 (07): : 38 - 47