Combining OpenStreetMap with Satellite Imagery to Enhance Cross-View Geo-Localization

被引:0
|
作者
Hu, Yuekun [1 ,2 ,3 ]
Liu, Yingfan [1 ,2 ,3 ]
Hui, Bin [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Optoelect Informat Proc, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang 110016, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
cross-view geo-localization; OpenStreetMap; satellite imagery; data fusion;
D O I
10.3390/s25010044
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Cross-view geo-localization (CVGL) aims to determine the capture location of street-view images by matching them with corresponding 2D maps, such as satellite imagery. While recent bird's eye view (BEV)-based methods have advanced this task by addressing viewpoint and appearance differences, the existing approaches typically rely solely on either OpenStreetMap (OSM) data or satellite imagery, limiting localization robustness due to single-modality constraints. This paper presents a novel CVGL method that fuses OSM data with satellite imagery, leveraging their complementary strengths to enhance localization robustness. We integrate the semantic richness and structural information from OSM with the high-resolution visual details of satellite imagery, creating a unified 2D geospatial representation. Additionally, we employ a transformer-based BEV perception module that utilizes attention mechanisms to construct fine-grained BEV features from street-view images for matching with fused map features. Compared to state-of-the-art methods that utilize only OSM data, our approach achieves substantial improvements, with 12.05% and 12.06% recall enhancements on the KITTI benchmark for lateral and longitudinal localization within a 1-m error, respectively.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Cross-View Object Geo-Localization in a Local Region With Satellite Imagery
    Sun, Yuxi
    Ye, Yunming
    Kang, Jian
    Fernandez-Beltran, Ruben
    Feng, Shanshan
    Li, Xutao
    Luo, Chuyao
    Zhang, Puzhao
    Plaza, Antonio
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [2] Cross-View Geo-Localization: A Survey
    Durgam, Abhilash
    Paheding, Sidike
    Dhiman, Vikas
    Devabhaktuni, Vijay
    IEEE ACCESS, 2024, 12 : 192028 - 192050
  • [3] UAV-Satellite View Synthesis for Cross-View Geo-Localization
    Tian, Xiaoyang
    Shao, Jie
    Ouyang, Deqiang
    Shen, Heng Tao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4804 - 4815
  • [4] Cross-View Image Sequence Geo-localization
    Zhang, Xiaohan
    Sultani, Waqas
    Wshah, Safwan
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2913 - 2922
  • [5] GAMa: Cross-View Video Geo-Localization
    Vyas, Shruti
    Chen, Chen
    Shah, Mubarak
    COMPUTER VISION, ECCV 2022, PT XXXVII, 2022, 13697 : 440 - 456
  • [6] Cross-view geo-localization with evolving transformer
    Yang, Hongji
    Lu, Xiufan
    Zhu, Yingying
    arXiv, 2021,
  • [7] Geo-Localization via Ground-to-Satellite Cross-View Image Retrieval
    Zeng, Zelong
    Wang, Zheng
    Yang, Fan
    Satoh, Shin'ichi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2176 - 2188
  • [8] A Cross-View Geo-Localization Algorithm Using UAV Image and Satellite Image
    Fan, Jiqi
    Zheng, Enhui
    He, Yufei
    Yang, Jianxing
    SENSORS, 2024, 24 (12)
  • [9] Road Structure Inspired UGV-Satellite Cross-View Geo-Localization
    Hu, Di
    Yuan, Xia
    Xi, Huiying
    Li, Jie
    Song, Zhenbo
    Xiong, Fengchao
    Zhang, Kai
    Zhao, Chunxia
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 16767 - 16786
  • [10] Benchmarking the Robustness of Cross-View Geo-Localization Models
    Zhang, Qingwang
    Zhu, Yingying
    COMPUTER VISION - ECCV 2024, PT LXXXVII, 2025, 15145 : 36 - 53