Aerial-DEM Geolocalization for GPS-Denied UAS Navigation

Accelerated by the proliferation of small, affordable, and lightweight electronically scanning radar systems as well as advances in UAS (Unmanned Aircraft System) technology, GRRR (Geo-Registered Radar Returns) data is becoming an incredible source for geolocalization in GPS-denied UAS navigation. Most existing approaches match aerial images to pre-stored DEMs through 3D terrain reconstruction or GPU-based terrain rendering techniques. However, these reconstruction or rendering processes are themselves error-prone and time-consuming, decreasing UAS navigation accuracy. In this work, we propose a novel geolicalization approach by directly matching aerial images to DEMs. Inspired by success of deep learning in face verification, we develop a Triplet Ranking network to embed aerial images and DEMs into the same low-dimensional feature space, where matching aerial-DEM are near one another and mismatched aerial-DEM are far apart. To create large-scale training dataset, we design an efficient terrain generation approach using pixel displacement mapping technique. This approach augments aerial datasets by simulating visual appearances of terrain under different lighting conditions. Experiments are conducted to show the effectiveness of our deep network in finding matches between aerial images and DEMs.