DaCo: domain-agnostic contrastive learning for visual place recognition

被引:3
|
作者
Ren, Hao [1 ]
Zheng, Ziqiang [2 ]
Wu, Yang [3 ]
Lu, Hong [1 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[2] UISEE Technol Co Ltd, Shanghai, Peoples R China
[3] Kyoto Univ, Kyoto, Japan
关键词
Image retrieval; Contrastive learning; Generative adversarial networks; Domain adaptation; Visual place recognition;
D O I
10.1007/s10489-023-04629-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual place recognition is a core component of visual information analysis, which serves for the position and orientation perception of autonomous driving and robotics. The current place recognition methods usually rely on image retrieval techniques to identify the visual similarity between query and gallery images. However, state-of-the-art image retrieval methods are often based on extensive labels, such as matched pairs (e.g., the image correspondences). Besides, image retrieval methods heavily suffer from environmental condition changes (i.e., a large range of illumination and weather changes). To alleviate the annotation cost, we introduce contrastive learning to perform feature extraction and feature similarity measurement in a self-supervised manner. Considering the heavy data augmentations of the existing contrastive learning approaches cannot effectively simulate domain disparities, we design the generative adversarial model to promote the extraction of domain-agnostic features. To tightly integrate the domain-agnostic representations and self-supervision, we design a self-generated soft constraint to achieve domain-agnostic contrastive learning (termed "DaCo"). Extensive experiments and analysis on cross-illumination and cross-weather settings are conducted on three challenging datasets. The proposed "DaCo" outperforms current contrastive learning based image retrieval methods by a large margin.
引用
收藏
页码:21827 / 21840
页数:14
相关论文
共 50 条
  • [1] DaCo: domain-agnostic contrastive learning for visual place recognition
    Hao Ren
    Ziqiang Zheng
    Yang Wu
    Hong Lu
    [J]. Applied Intelligence, 2023, 53 : 21827 - 21840
  • [2] Towards Domain-Agnostic Contrastive Learning
    Verma, Vikas
    Minh-Thang Luong
    Kawaguchi, Kenji
    Hieu Pham
    Le, Quoc, V
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139 : 7544 - 7554
  • [3] Domain-Agnostic Contrastive Representations for Learning from Label Proportions
    Nandy, Jay
    Saket, Rishi
    Jain, Prateek
    Chauhan, Jatin
    Ravindran, Balaraman
    Raghuveer, Aravindan
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 1542 - 1551
  • [4] Meta-Prototypical Learning for Domain-Agnostic Few-Shot Recognition
    Wang, Rui-Qi
    Zhang, Xu-Yao
    Liu, Cheng-Lin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6990 - 6996
  • [5] Learning deep domain-agnostic features from synthetic renders for industrial visual inspection
    Abubakr, Abdelrahman G.
    Jovancevic, Igor
    Mokhtari, Nour Islam
    Ben Abdallah, Hamdi
    Orteu, Jean-Jose
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (05)
  • [6] A domain-agnostic approach for characterization of lifelong learning systems
    Baker, Megan M.
    New, Alexander
    Aguilar-Simon, Mario
    Al-Halah, Ziad
    Arnold, Sebastien M. R.
    Ben-Iwhiwhu, Ese
    Brna, Andrew P.
    Brooks, Ethan
    Brown, Ryan C.
    Daniels, Zachary
    Daram, Anurag
    Delattre, Fabien
    Dellana, Ryan
    Eaton, Eric
    Fu, Haotian
    Grauman, Kristen
    Hostetler, Jesse
    Iqbal, Shariq
    Kent, Cassandra
    Ketz, Nicholas
    Kolouri, Soheil
    Konidaris, George
    Kudithipudi, Dhireesha
    Learned-Miller, Erik
    Lee, Seungwon
    Littman, Michael L.
    Madireddy, Sandeep
    Mendez, Jorge A.
    Nguyen, Eric Q.
    Piatko, Christine
    Pilly, Praveen K.
    Raghavan, Aswin
    Rahman, Abrar
    Ramakrishnan, Santhosh Kumar
    Ratzlaff, Neale
    Soltoggio, Andrea
    Stone, Peter
    Sur, Indranil
    Tang, Zhipeng
    Tiwari, Saket
    Vedder, Kyle
    Wang, Felix
    Xu, Zifan
    Yanguas-Gil, Angel
    Yedidsion, Harel
    Yu, Shangqun
    Vallabha, Gautam K.
    [J]. NEURAL NETWORKS, 2023, 160 : 274 - 296
  • [7] Deep Learning Model Portability for Domain-Agnostic Device Fingerprinting
    Gaskin, Jared
    Elmaghbub, Abdurrahman
    Hamdaoui, Bechir
    Wong, Weng-Keen
    [J]. IEEE ACCESS, 2023, 11 : 86801 - 86823
  • [8] Towards Domain-agnostic Depth Completion
    Xu, Guangkai
    Yin, Wei
    Zhang, Jianming
    Wang, Oliver
    Niklaus, Simon
    Chen, Simon
    Bian, Jia-Wang
    [J]. MACHINE INTELLIGENCE RESEARCH, 2024, 21 (04) : 652 - 669
  • [9] Medical domain knowledge in domain-agnostic generative AI
    Jakob Nikolas Kather
    Narmin Ghaffari Laleh
    Sebastian Foersch
    Daniel Truhn
    [J]. npj Digital Medicine, 5
  • [10] Medical domain knowledge in domain-agnostic generative AI
    Kather, Jakob Nikolas
    Ghaffari Laleh, Narmin
    Foersch, Sebastian
    Truhn, Daniel
    [J]. NPJ DIGITAL MEDICINE, 2022, 5 (01)