Fast retrieval method of remote sensing image for UAV absolute location

被引:0
|
作者
Wang X. [1 ,2 ]
Li J. [1 ]
Wang A. [1 ]
Yang Z. [1 ]
机构
[1] Institute of Geospatial Information, Information Engineering University, Zhengzhou
[2] Henan Mechanical and electrical vocational College, Zhengzhou
关键词
aggregation; image retrieval; remote sensing; scene matching; soft assignment;
D O I
10.13695/j.cnki.12-1222/o3.2024.04.006
中图分类号
学科分类号
摘要
Focusing on the absolute positioning problem of UAV scene matching visual navigation in complex environment, a fast real-time image retrieval method based on aggregation of deep learning features is proposed. Firstly, NetVLAD, a trainable soft assignment deep learning framework, is introduced to extract and aggregate the image stable global feature representation vector with VGG16 network. Secondly, in the initial retrieval stage, KD tree structure is utilized to construct the retrieval index of image global feature vector, which can improve the retrieval speed without losing the retrieval accuracy. Finally, the initial retrieval results are judged quickly by using the Pearson product-moment correlation coefficient that can automatically filter the initial retrieval results. Graph neural network SuperGlue, a feature learning and matching algorithm is utilized to match and reorder the images that need to be reordered. The proposed method is tested by grouping open summer and winter remote sensing image datasets. The experimental results show that under the condition of no reordering, the average accuracy of the first image of the initial retrieval results reaches 58.27%, and the accuracy of some areas with better features reaches 85%. It also has good adaptability to remote sensing images of different time phases and takes 3.7 s on average to retrieve an image, which can provide reference for UAV scene matching navigation initial positioning. © 2024 Editorial Department of Journal of Chinese Inertial Technology. All rights reserved.
引用
收藏
页码:363 / 370and378
相关论文
共 18 条
  • [1] Zhao C, Zhou Y, Lin Z, Et al., Review of scene matching visual navigation for unmanned aerial vehicles, Sci Sin Inform, 49, 5, pp. 507-519, (2019)
  • [2] Xu B, Chen C, Wang L., Vehicle INS/OD/GPS positioning method based on interactive multi-model, Journal of Chinese Inertial Technology, 30, 1, pp. 58-64, (2022)
  • [3] Han Y, Yu X, Ji Z, Et al., Urban complex environment oriented GNSS/INS precision graph optimization algorithm, Journal of Chinese Inertial Technology, 30, 5, pp. 582-588, (2022)
  • [4] Goforth H, Lucey S., GPS-Denied UAV localization using pre-existing satellite imagery, International Conference on Robotics and Automation, pp. 2974-2980, (2019)
  • [5] Zheng Z, Wei Y, Yang Y., University-1652: a multi-view multi-source benchmark for drone-based geolocalization, MM '20: Proceedings of the 28th ACM International Conference on Multimedia, pp. 1395-1403, (2020)
  • [6] Wu Z, Zou C, Wang Y, Et al., Rotation-aware representation learning for remote sensing image retrieval, Information Sciences, 572, pp. 404-423, (2021)
  • [7] Sun Y, Ye Y, Li X, Et al., Unsupervised deep hashing through learning soft pseudo label for remote sensing image retrieval, Knowledge-Based Systems, 239, (2022)
  • [8] Sukhia K N, Riaz M M, Ghafoor A, Et al., Content-based remote sensing image retrieval using multi-scale local ternary pattern, Digital Signal Processing, 104, (2020)
  • [9] Sudha S K, Aji S., An active learning method with entropy weighting subspace clustering for remote sensing image retrieval, Applied Soft Computing, 125, (2022)
  • [10] Detone D, Malisiewicz T, Rabinovich A., Superpoint: self-supervised interest point detection and description, IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 337-33712, (2018)