GAMa: Cross-View Video Geo-Localization

被引:4
|
作者
Vyas, Shruti [1 ]
Chen, Chen [1 ]
Shah, Mubarak [1 ]
机构
[1] Univ Cent Florida, Ctr Res Comp Vis, Orlando, FL 32816 USA
来源
关键词
D O I
10.1007/978-3-031-19836-6_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The existing work in cross-view geo-localization is based on images where a ground panorama is matched to an aerial image. In this work, we focus on ground videos instead of images which provides additional contextual cues which are important for this task. There are no existing datasets for this problem, therefore we propose GAMa dataset, a large-scale dataset with ground videos and corresponding aerial images. We also propose a novel approach to solve this problem. At clip-level, a short video clip is matched with corresponding aerial image and is later used to get video-level geo-localization of a long video. Moreover, we propose a hierarchical approach to further improve the clip-level geo-localization. On this challenging dataset, with unaligned images and limited field of view, our proposed method achieves a Top-1 recall rate of 19.4% and 45.1% @1.0mile.
引用
收藏
页码:440 / 456
页数:17
相关论文
共 50 条
  • [1] Cross-View Geo-Localization: A Survey
    Durgam, Abhilash
    Paheding, Sidike
    Dhiman, Vikas
    Devabhaktuni, Vijay
    [J]. IEEE Access, 2024, 12 : 192028 - 192050
  • [2] Cross-View Image Sequence Geo-localization
    Zhang, Xiaohan
    Sultani, Waqas
    Wshah, Safwan
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2913 - 2922
  • [3] Cross-view geo-localization with evolving transformer
    Yang, Hongji
    Lu, Xiufan
    Zhu, Yingying
    [J]. arXiv, 2021,
  • [4] Dual Path Network for Cross-view Geo-Localization
    Dong, Leyi
    Wang, Yuhui
    Huang, Junshi
    Qian, Xueming
    Fan, Mingyuan
    Lai, Shenqi
    [J]. PROCEEDINGS OF THE 2023 WORKSHOP ON UAVS IN MULTIMEDIA: CAPTURING THE WORLD FROM A NEW PERSPECTIVE, UAVM 2023, 2023, : 45 - 49
  • [5] UAV-Satellite View Synthesis for Cross-View Geo-Localization
    Tian, Xiaoyang
    Shao, Jie
    Ouyang, Deqiang
    Shen, Heng Tao
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4804 - 4815
  • [6] Lending Orientation to Neural Networks for Cross-view Geo-localization
    Liu, Liu
    Li, Hongdong
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5607 - 5616
  • [7] Fusing Geometric and Scene Information for Cross-View Geo-Localization
    Guo, Siyuan
    Liu, Tianying
    Li, Wengen
    Guan, Jihong
    Zhou, Shuigeng
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 3978 - 3982
  • [8] Cross-View Image Matching for Geo-localization in Urban Environments
    Tian, Yicong
    Chen, Chen
    Shah, Mubarak
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1998 - 2006
  • [9] Perceptual Feature Fusion Network for Cross-View Geo-Localization
    Wang, Jiayi
    Chen, Ziyang
    Yuan, Xiaochen
    Zhao, Genping
    [J]. Computer Engineering and Applications, 60 (03): : 255 - 262
  • [10] Cross-View Visual Geo-Localization for Outdoor Augmented Reality
    Mithun, Niluthpol Chowdhury
    Minhas, Kshitij S.
    Chiu, Han-Pang
    Oskiper, Taragay
    Sizintsev, Mikhail
    Samarasekera, Supun
    Kumar, Rakesh
    [J]. 2023 IEEE CONFERENCE VIRTUAL REALITY AND 3D USER INTERFACES, VR, 2023, : 493 - 502