Graph-Based Place Recognition in Image Sequences with CNN Features

被引:32
|
作者
Zhang, Xiwu [1 ,2 ]
Wang, Lei [2 ]
Zhao, Yan [2 ]
Su, Yan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Mech Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
关键词
Visual place recognition; Loop closure detection; SLAM; Deep learning; CNN; Diffusion; FAB-MAP; LOCALIZATION; DIFFUSION; SCALE; SLAM;
D O I
10.1007/s10846-018-0917-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual place recognition is a critical and challenging problem in both robotics and computer vision communities. In this paper, we focus on place recognition for visual Simultaneous Localization and Mapping (vSLAM) systems. These systems have been limited to handcrafted feature based paradigms for a long time, which normally use local visual information of images and are not sufficiently robust against variations applied to images. In this work, we address place recognition with the features automatically learned from data. First, we propose a graph-based visual place recognition method. The graph is constructed by combining the visual features extracted from convolutional neural networks (CNNs) and the temporal information of the images in a sequence. Second, we propose to employ diffusion process to enhance the data association in the graph to achieve more accurate recognition results. Finally, to evaluate the proposed method, we experiment on four commonly used datasets. Experimental results indicate that the proposed method is able to obtain significantly better performance (e.g. 95.37% recall at 100% of precision) than that of FAB-MAP (47.16% recall at 100% of precision), a commonly used method for place recognition based on handcrafted features, especially on some challenging datasets.
引用
收藏
页码:389 / 403
页数:15
相关论文
共 50 条
  • [1] Graph-Based Place Recognition in Image Sequences with CNN Features
    Xiwu Zhang
    Lei Wang
    Yan Zhao
    Yan Su
    [J]. Journal of Intelligent & Robotic Systems, 2019, 95 : 389 - 403
  • [2] GRAPH-BASED RECOGNITION OF MORPHOLOGICAL FEATURES
    GAVANKAR, P
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 1993, 4 (03) : 209 - 218
  • [3] New graph-based features for shape recognition
    Mirehi, Narges
    Tahmasbi, Maryam
    Targhi, Alireza Tavakoli
    [J]. SOFT COMPUTING, 2021, 25 (11) : 7577 - 7592
  • [4] New graph-based features for shape recognition
    Narges Mirehi
    Maryam Tahmasbi
    Alireza Tavakoli Targhi
    [J]. Soft Computing, 2021, 25 : 7577 - 7592
  • [5] Investigating Graph-based Features for Speech Emotion Recognition
    Pentari, Anastasia
    Kafentzis, George
    Tsiknakis, Manolis
    [J]. 2022 IEEE-EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL AND HEALTH INFORMATICS (BHI) JOINTLY ORGANISED WITH THE IEEE-EMBS INTERNATIONAL CONFERENCE ON WEARABLE AND IMPLANTABLE BODY SENSOR NETWORKS (BSN'22), 2022,
  • [6] Explainable Image Recognition With Graph-Based Feature Extraction
    Griffith University, School of Information and Communication Technology, Brisbane
    QLD
    4111, Australia
    不详
    VIC
    3010, Australia
    不详
    TAS
    7005, Australia
    不详
    639798, Singapore
    [J]. IEEE Access, (150325-150333):
  • [7] Video Copy Detection Based on Deep CNN Features and Graph-Based Sequence Matching
    Zhang, Xin
    Xie, Yuxiang
    Luan, Xidao
    He, Jingmeng
    Zhang, Lili
    Wu, Lingda
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2018, 103 (01) : 401 - 416
  • [8] CNN training with graph-based sample preselection: application to handwritten character recognition
    Rayar, Frederic
    Uchida, Seiichi
    Goto, Masanori
    [J]. 2018 13TH IAPR INTERNATIONAL WORKSHOP ON DOCUMENT ANALYSIS SYSTEMS (DAS), 2018, : 19 - 24
  • [9] Video Copy Detection Based on Deep CNN Features and Graph-Based Sequence Matching
    Xin Zhang
    Yuxiang Xie
    Xidao Luan
    Jingmeng He
    Lili Zhang
    Lingda Wu
    [J]. Wireless Personal Communications, 2018, 103 : 401 - 416
  • [10] Frequent approximate subgraphs as features for graph-based image classification
    Acosta-Mendoza, Niusvel
    Gago-Alonso, Andres
    Medina-Pagola, Jose E.
    [J]. KNOWLEDGE-BASED SYSTEMS, 2012, 27 : 381 - 392