Efficient physics-based learned reconstruction methods for real-time 3D near-field MIMO radar imaging

被引:4
|
作者
Manisali, Irfan [1 ]
Oral, Okyanus [1 ]
Oktem, Figen S. [1 ]
机构
[1] Middle East Tech Univ METU, Dept Elect & Elect Engn, TR-06800 Ankara, Turkiye
关键词
Radar imaging; Near-field microwave imaging; Deep learning; 3D inverse imaging problems; Sparse MIMO array; CONVOLUTIONAL NEURAL-NETWORK; INVERSE PROBLEMS; RECOVERY; ARRAYS;
D O I
10.1016/j.dsp.2023.104274
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Near-field multiple-input multiple-output (MIMO) radar imaging systems have recently gained significant attention. These systems generally reconstruct the three-dimensional (3D) complex-valued reflectivity distribution of the scene using sparse measurements. Consequently, imaging quality highly relies on the image reconstruction approach. Existing analytical reconstruction approaches suffer from either high computational cost or low image quality. In this paper, we develop novel non-iterative deep learning-based reconstruction methods for real-time near-field MIMO imaging. The goal is to achieve high image quality with low computational cost at compressive settings. The developed approaches have two stages. In the first approach, physics-based initial stage performs adjoint operation to back-project the measurements to the image-space, and deep neural network (DNN)-based second stage converts the 3D backprojected measurements to a magnitude-only reflectivity image. Since scene reflectivities often have random phase, DNN processes directly the magnitude of the adjoint result. As DNN, 3D U-Net is used to jointly exploit range and cross-range correlations. To comparatively evaluate the significance of exploiting physics in a learning-based approach, two additional approaches that replace the physics-based first stage with fully connected layers are also developed as purely learning based methods. The performance is also analyzed by changing the DNN architecture for the second stage to include complex-valued processing (instead of magnitude-only processing), 2D convolution kernels (instead of 3D), and ResNet architecture (instead of U-Net). Moreover, we develop a synthesizer to generate large-scale dataset for training the neural networks with 3D extended targets. We illustrate the performance through experimental data and extensive simulations. The results show the effectiveness of the developed physics based learned reconstruction approach compared to commonly used approaches in terms of both runtime and image quality at highly compressive settings. Our source codes and dataset are made available at https:// github .com /METU -SPACE-Lab /Efficient -Learned-3D -Near-Field-MIMO -Imaging upon publication to advance research in this field.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Near-Field 3D SAR Imaging Using a Scanning Linear MIMO Array With Arbitrary Topologies
    Fan, Bo
    Gao, Jing-Kun
    Li, Hong-Jun
    Jiang, Zhi-Jie
    He, Yan
    IEEE ACCESS, 2020, 8 : 6782 - 6791
  • [42] Reconstruction of transient acoustic field using sparse real-time near-field acoustic holography
    Geng, Lin
    Chen, Xing-Guo
    He, Shu-Ping
    He, Chun-Dong
    JOURNAL OF SOUND AND VIBRATION, 2024, 568
  • [43] Real-time imaging of surface waves with nonlinear near-field optical microscopy
    Frischwasser, Kobi
    Cohen, Kobi
    Kher-Alden, Jakob
    Dolev, Shimon
    Tsesses, Shai
    Bartal, Guy
    2021 CONFERENCE ON LASERS AND ELECTRO-OPTICS (CLEO), 2021,
  • [44] Near Real-Time 3D Reconstruction and Quality 3D Point Cloud for Time-Critical Construction Monitoring
    Liu, Zuguang
    Kim, Daeho
    Lee, Sanghyun
    Zhou, Li
    An, Xuehui
    Liu, Meiyin
    BUILDINGS, 2023, 13 (02)
  • [45] Physics-Based Data Augmentation for High Frequency 3D Radar Systems
    Crosskey, Miles
    Wang, Patrick
    Sakaguchi, Rayn
    Morton, Kenneth D., Jr.
    DETECTION AND SENSING OF MINES, EXPLOSIVE OBJECTS, AND OBSCURED TARGETS XXIII, 2018, 10628
  • [46] StereoScan: Dense 3d Reconstruction in Real-time
    Geiger, Andreas
    Ziegler, Julius
    Stiller, Christoph
    2011 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2011, : 963 - 968
  • [47] DenseMatch: a dataset for real-time 3D reconstruction
    Lombardi, Marco
    Savardi, Mattia
    Signoroni, Alberto
    DATA IN BRIEF, 2021, 39
  • [48] Real-Time Active Multiview 3D Reconstruction
    Ide, Kai
    Sikora, Thomas
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTER VISION IN REMOTE SENSING, 2012, : 203 - 208
  • [49] Real-time 3D cone beam reconstruction
    Stsepankou, D
    Kornmesser, K
    Hesser, J
    Männer, R
    2004 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-7, 2004, : 3648 - 3652
  • [50] Real-time active 3D shape reconstruction for 3D video
    Wu, X
    Matsuyama, T
    ISPA 2003: PROCEEDINGS OF THE 3RD INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, PTS 1 AND 2, 2003, : 186 - 191