Lunar Rover Cross-View Localization Through Integration of Rover and Orbital Images

被引:0
|
作者
Zhao, Xinyu [1 ]
Cui, Linyan [1 ]
Wei, Xiaodong [1 ]
Liu, Chuankai [2 ,3 ]
Yin, Jihao [1 ]
机构
[1] Beihang Univ, Sch Astronaut, Image Proc Ctr, Beijing 100191, Peoples R China
[2] Beijing Aerosp Control Ctr, Beijing 100190, Peoples R China
[3] Key Lab Sci & Technol Aerosp Flight Dynam, Beijing 100190, Peoples R China
关键词
Moon; Location awareness; Orbits; Planetary orbits; Space vehicles; Feature extraction; Visualization; Computer vision; cross-view image; environmental perception; lunar exploration; visual localization; DESIGN;
D O I
10.1109/TGRS.2024.3462487
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Efficient visual localization of lunar rovers is essential for long-range autonomous exploration missions and the construction of the International Lunar Research Station. Given the communication delay and bandwidth limitations between the Earth and the Moon, we propose a novel cross-view localization framework that autonomously registers a single rover image to an orbital image. We developed a bird's-eye-view (BEV) feature synthesis method that integrates geometric projection, cross-scale feature transfer (CSFT), and contour guidance mechanism (CGM). The basic principle involves first projecting rover features into the BEV perspective through geometric projection, then reconstructing BEV features in reference to orbital features using CSFT. This process is guided by CGM, enhancing the expression of rich terrain contours in BEV and orbital features, thereby improving the viewpoint and scale consistency of cross-view features. By conducting dense spatial correlation searches between BEV and orbital features, we can accurately estimate the position of the lunar rover. Additionally, we introduce a lunar surface simulation environment and construct the lunar cross-view localization (LCVL) simulation dataset based on this environment to demonstrate the framework's effectiveness. Our research offers a new solution for rover localization, potentially improving the efficiency of future exploration missions.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] LunarNav: Crater-based Localization for Long-range Autonomous Lunar Rover Navigation
    Daftry, Shreyansh
    Chen, Zhanlin
    Cheng, Yang
    Tepsuporn, Scott
    Khattak, Shehryar
    Matthies, Larry
    Coltin, Brian
    Naal, Ussama
    Ma, Lanssie Mingyue
    Deans, Matthew
    2023 IEEE AEROSPACE CONFERENCE, 2023,
  • [32] Cross-View Image Sequence Geo-localization
    Zhang, Xiaohan
    Sultani, Waqas
    Wshah, Safwan
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2913 - 2922
  • [33] GAMa: Cross-View Video Geo-Localization
    Vyas, Shruti
    Chen, Chen
    Shah, Mubarak
    COMPUTER VISION, ECCV 2022, PT XXXVII, 2022, 13697 : 440 - 456
  • [34] Lunar Micro Rover Design for Exploration through Virtual Reality Tele-operation
    Britton, Nathan
    Yoshida, Kazuya
    Walker, John
    Nagatani, Keiji
    Taylor, Graeme
    Dauphin, Loic
    FIELD AND SERVICE ROBOTICS, 2015, 105 : 259 - 272
  • [35] Planetary Rover Localization in Virtual Reality Environment via Orbital and Surface Imagery Learnt Embeddings
    Franchi, Valerio
    Ntagiou, Evridiki
    2021 4TH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2021), 2021, : 114 - 118
  • [36] Rover localization through 3D terrain registration in natural enviromments
    Bakambu, Joseph Nsasi
    Gemme, Sebastien
    Dupuis, Erick
    2006 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-12, 2006, : 4121 - +
  • [37] Dual Path Network for Cross-view Geo-Localization
    Dong, Leyi
    Wang, Yuhui
    Huang, Junshi
    Qian, Xueming
    Fan, Mingyuan
    Lai, Shenqi
    PROCEEDINGS OF THE 2023 WORKSHOP ON UAVS IN MULTIMEDIA: CAPTURING THE WORLD FROM A NEW PERSPECTIVE, UAVM 2023, 2023, : 45 - 49
  • [38] Satellite Image Based Cross-view Localization for Autonomous Vehicle
    Wang, Shan
    Zhang, Yanhao
    Vora, Ankit
    Perincherry, Akhil
    Li, Hongdong
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 3592 - 3599
  • [39] Visual Cross-View Metric Localization with Dense Uncertainty Estimates
    Xia, Zimin
    Booij, Olaf
    Manfredi, Marco
    Kooij, Julian F. P.
    COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 90 - 106
  • [40] A Novel Geo-Localization Method for UAV and Satellite Images Using Cross-View Consistent Attention
    Cui, Zhuofan
    Zhou, Pengwei
    Wang, Xiaolong
    Zhang, Zilun
    Li, Yingxuan
    Li, Hongbo
    Zhang, Yu
    REMOTE SENSING, 2023, 15 (19)