Single Target SAR 3D Reconstruction Based on Deep Learning

被引:7
|
作者
Wang, Shihong [1 ,2 ,3 ]
Guo, Jiayi [1 ,2 ]
Zhang, Yueting [1 ,2 ]
Hu, Yuxin [1 ,2 ]
Ding, Chibiao [1 ,2 ]
Wu, Yirong [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applic, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
SAR imaging; 3D reconstruction; small number of data; deep learning; super resolution; TOMOGRAPHY;
D O I
10.3390/s21030964
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Synthetic aperture radar tomography (TomoSAR) is an important 3D mapping method. Traditional TomoSAR requires a large number of observation orbits however, it is hard to meet the requirement of massive orbits. While on the one hand, this is due to funding constraints, on the other hand, because the target scene is changing over time and each observation orbit consumes lots of time, the number of orbits can be fewer as required within a narrow time window. When the number of observation orbits is insufficient, the signal-to-noise ratio (SNR), peak-to-sidelobe ratio (PSR), and resolution of 3D reconstruction results will decline severely, which seriously limits the practical application of TomoSAR. In order to solve this problem, we propose to use a deep learning network to improve the resolution and SNR of 3D reconstruction results under the condition of very few observation orbits by learning the prior distribution of targets. We use all available orbits to reconstruct a high resolution target, while only very few (around 3) orbits to reconstruct a low resolution input. The low-res and high-res 3D voxel-grid pairs are used to train a 3D super-resolution (SR) CNN (convolutional neural network) model, just like ordinary 2D image SR tasks. Experiments on the Civilian Vehicle Radar dataset show that the proposed deep learning algorithm can effectively improve the reconstruction both in quality and in quantity. In addition, the model also shows good generalization performance for targets not shown in the training set.
引用
收藏
页码:1 / 20
页数:20
相关论文
共 50 条
  • [1] Single image 3D object reconstruction based on deep learning: A review
    Fu, Kui
    Peng, Jiansheng
    He, Qiwen
    Zhang, Hanxiao
    [J]. Multimedia Tools and Applications, 2021, 80 (01): : 463 - 498
  • [2] Single image 3D object reconstruction based on deep learning: A review
    Fu, Kui
    Peng, Jiansheng
    He, Qiwen
    Zhang, Hanxiao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (01) : 463 - 498
  • [3] Colorful 3D Reconstruction from Single Image Based on Deep Learning
    Zhu Yuzheng
    Zhang Yaping
    Feng Qiaosheng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
  • [4] Single image 3D object reconstruction based on deep learning: A review
    Kui Fu
    Jiansheng Peng
    Qiwen He
    Hanxiao Zhang
    [J]. Multimedia Tools and Applications, 2021, 80 : 463 - 498
  • [5] Single Sketch Image based 3D Car Shape Reconstruction with Deep Learning and Lazy Learning
    Nozawa, Naoki
    Shum, Hubert P. H.
    Ho, Edmond S. L.
    Morishima, Shigeo
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 1: GRAPP, 2020, : 179 - 190
  • [6] Deep learning-based 3D reconstruction: a survey
    Taha Samavati
    Mohsen Soryani
    [J]. Artificial Intelligence Review, 2023, 56 : 9175 - 9219
  • [7] Deep learning-based 3D reconstruction: a survey
    Samavati, Taha
    Soryani, Mohsen
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (09) : 9175 - 9219
  • [8] Medical 3D Reconstruction Based on Deep Learning for Healthcare
    Wang, Jia-Ji
    Chen, Shu-Wen
    Shao, Jia-Qi
    Gu, Xiao-Wei
    Zhu, Hui-Sheng
    [J]. COMPANION PROCEEDINGS OF THE 14TH IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING (UCC'21 COMPANION), 2021,
  • [9] Incremental SFM 3D Reconstruction Based on Deep Learning
    Liu, Lei
    Wang, Congzheng
    Feng, Chuncheng
    Gong, Wanqi
    Zhang, Lingyi
    Liao, Libin
    Feng, Chang
    [J]. ELECTRONICS, 2024, 13 (14)
  • [10] Single-View 3D reconstruction: A Survey of deep learning methods
    Fahim, George
    Amin, Khalid
    Zarif, Sameh
    [J]. COMPUTERS & GRAPHICS-UK, 2021, 94 : 164 - 190