Bridging a Gap in SAR-ATR: Training on Fully Synthetic and Testing on Measured Data

被引:58
|
作者
Inkawhich, Nathan [1 ]
Inkawhich, Matthew J. [1 ]
Davis, Eric K. [2 ]
Majumder, Uttam K. [3 ]
Tripp, Erin [4 ]
Capraro, Chris [5 ]
Chen, Yiran [1 ]
机构
[1] Duke Univ, Elect & Comp Engn Dept, Durham, NC 27708 USA
[2] SRC Inc, Machine Learning & AI, North Syracuse, NY 13212 USA
[3] US Air Force, Comp & Commun, Res Lab Informat Directorate, Rome, NY 13441 USA
[4] US Air Force, High Performance Syst Branch, Res Lab Informat Directorate, Rome, NY 13441 USA
[5] SRC Inc, Radars & Sensors, North Syracuse, NY 13212 USA
关键词
Training; Solid modeling; Data models; Training data; Synthetic aperture radar; Testing; Semiconductor device measurement; Automatic target recognition (ATR); deep learning; synthetic aperture radar (SAR);
D O I
10.1109/JSTARS.2021.3059991
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Obtaining measured synthetic aperture radar (SAR) data for training automatic target recognition (ATR) models can be too expensive (in terms of time and money) and complex of a process in many situations. In response, researchers have developed methods for creating synthetic SAR data for targets using electro-magnetic prediction software, which is then used to enrich an existing measured training dataset. However, this approach relies on the availability of some amount of measured data. In this work, we focus on the case of having 100% synthetic training data, while testing on only measured data. We use the SAMPLE dataset public released by AFRL, and find significant challenges to learning generalizable representations from the synthetic data due to distributional differences between the two modalities and extremely limited training sample quantities. Using deep learning-based ATR models, we propose data augmentation, model construction, loss function choices, and ensembling techniques to enhance the representation learned from the synthetic data, and ultimately achieved over 95% accuracy on the SAMPLE dataset. We then analyze the functionality of our ATR models using saliency and feature-space investigations and find them to learn a more cohesive representation of the measured and synthetic data. Finally, we evaluate the out-of-library detection performance of our synthetic-only models and find that they are nearly 10% more effective than baseline methods at identifying measured test samples that do not belong to the training class set. Overall, our techniques and their compositions significantly enhance the feasibility of using ATR models trained exclusively on synthetic data.
引用
收藏
页码:2942 / 2955
页数:14
相关论文
共 30 条
  • [1] Bridging the synthetic to measured SAR gap by splitting style and content
    Parks, Caleb
    Swan, Matthew
    Gauch, Susan
    Zhan, Justin
    [J]. ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXX, 2023, 12520
  • [2] Training SAR-ATR Models for Reliable Operation in Open-World Environments
    Inkawhich, Nathan A.
    Davis, Eric K.
    Inkawhich, Matthew J.
    Majumder, Uttam K.
    Chen, Yiran
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 3954 - 3966
  • [3] INTERPRETABLE DISENTANGLED ADVERSARIAL AUTO-ENCODER FOR SAR-ATR WITH SPARSE TRAINING SAMPLES
    Guo, Qian
    Xu, Feng
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7511 - 7514
  • [4] Synthetic SAR data Domain Randomization for Unseen SAR ATR
    Kim, MinJun
    Kim, Sungho
    [J]. ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXXI, 2024, 13032
  • [5] Adaptive Target Enhancer: Bridging the Gap between Synthetic and Measured SAR Images for Automatic Target Recognition
    Campos, Alexandre B.
    Molin, Ricardo D., Jr.
    Ramos, Lucas P.
    Machado, Renato
    Vu, Viet T.
    Pettersson, Mats I.
    [J]. 2023 IEEE RADAR CONFERENCE, RADARCONF23, 2023,
  • [6] Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization
    Tremblay, Jonathan
    Prakash, Aayush
    Acuna, David
    Brophy, Mark
    Jampani, Varun
    Anil, Cem
    To, Thang
    Cameracci, Eric
    Boochoon, Shaad
    Birchfield, Stan
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1082 - 1090
  • [7] Towards assessing the synthetic-to-measured adversarial vulnerability of SAR ATR
    Peng, Bowen
    Peng, Bo
    Xia, Jingyuan
    Liu, Tianpeng
    Liu, Yongxiang
    Liu, Li
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 214 : 119 - 134
  • [8] A SAR Dataset for ATR Development: the Synthetic and Measured Paired Labeled Experiment (SAMPLE)
    Lewis, Benjamin
    Scarnati, Theresa
    Sudkamp, Elizabeth
    Nehrbass, John
    Rosencrantz, Steven
    Zelnio, Edmund
    [J]. ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXVI, 2019, 10987
  • [9] Graph pretraining approach to utilize synthetic data for SAR ATR
    Parks, Caleb
    Gauch, Susan
    Scherreik, Matthew
    Socha, Ryan
    [J]. ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXXI, 2024, 13032
  • [10] Improving SAR ATR using synthetic data via transfer learning
    Raeker, Brian O.
    Hill, Tyler A.
    Kreucher, Chris
    Banas, Katherine M.
    Tactac, Kevin
    Simpson, Kyle
    Weeks, Kirk
    [J]. ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXX, 2023, 12520