Robust loop closure detection and relocalization with semantic-line graph matching constraints in indoor environments

被引:1
|
作者
Wang, Xiqi [1 ]
Zheng, Shunyi [1 ]
Lin, Xiaohu [2 ]
Zhang, Qiyuan [1 ]
Liu, Xiaojian [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Hubei, Peoples R China
[2] Xian Univ Sci & Technol, Coll Geomat, Xian 710054, Shanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Loop closure detection; Semantic segmentation; SLAM; Graph matching; Relocalization; IMAGE FEATURES; LOCALIZATION; EFFICIENT; BAGS; MAP;
D O I
10.1016/j.jag.2024.103844
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Loop closure detection (LCD) plays an essential role in the Simultaneous Localization and Mapping (SLAM) process, effectively reducing cumulative trajectory errors. However, conventional LCD methods often encounter challenges when dealing with variations in illumination, changes in viewpoint, and environments with weak textures. This is due to their reliance on low-level geometric or image features. To address these issues, we propose a robust LCD method named SL-LCD, which integrates semantic information and line features to fully leverage the semantic content and line attributes within indoor scenes, thereby establishing a reliable feature correspondence between query images and loop closure images. For the retrieval of candidate closed-loop images, we construct a semantic-line-segment topological graph and introduce a graph matching algorithm to perform the LCD task. This approach fully exploits image features and spatial information to achieve closed- loop detection in complex indoor scenes. Furthermore, we present a semantic voxel-based generalized ICP (SVGICP) closed-loop relocalization algorithm tailored for challenging and complex indoor scenes, enhancing the accuracy of closed-loop relocalization in such scenarios. Experimental results demonstrate that the SL-LCD algorithm proposed in this paper surpasses state-of-the-art methods, accurately detecting closed loops, and effectively eliminating trajectory drift.
引用
收藏
页数:13
相关论文
共 24 条
  • [1] SSGM: Spatial Semantic Graph Matching for Loop Closure Detection in Indoor Environments
    Tang, Yujie
    Wang, Meiling
    Deng, Yinan
    Yang, Yi
    Yue, Yufeng
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 9163 - 9168
  • [2] SSGM: Spatial Semantic Graph Matching for Loop Closure Detection in Indoor Environments
    Tang, Yujie
    Wang, Meiling
    Deng, Yinan
    Yang, Yi
    Yue, Yufeng
    IEEE International Conference on Intelligent Robots and Systems, 2023, : 9163 - 9168
  • [3] Indoor Loop Closure Detection Based on Semantic Topology Graph Matching
    Liu, Zhengyu
    Wang, Fan
    Liu, Yong
    Xia, Yingwei
    Gao, Zhenyu
    Zhang, Chaofan
    PROCEEDINGS OF THE WORLD CONFERENCE ON INTELLIGENT AND 3-D TECHNOLOGIES, WCI3DT 2022, 2023, 323 : 133 - 145
  • [4] Semantic loop closure detection based on graph matching in multi-objects scenes?
    Qin, Cao
    Zhang, Yunzhou
    Liu, Yingda
    Lv, Guanghao
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 76
  • [5] Graph Matching Based Robust Line Segment Correspondence for Active Camera Relocalization
    Pan, Mengyu
    Meng, Chen
    Tian, Fei-Peng
    Feng, Wei
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 228 - 238
  • [6] Deep Pose Graph-Matching-Based Loop Closure Detection for Semantic Visual SLAM
    Duan, Ran
    Feng, Yurong
    Wen, Chih-Yung
    SUSTAINABILITY, 2022, 14 (19)
  • [7] SemanticLoop: Loop Closure With 3D Semantic Graph Matching
    Yu, Junfeng
    Shen, Shaojie
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (02) : 568 - 575
  • [8] Robust visual semi-semantic loop closure detection by a covisibility graph and CNN features
    Cascianelli, Silvia
    Costante, Gabriele
    Bellocchio, Enrico
    Valigi, Paolo
    Fravolini, Mario L.
    Ciarfuglia, Thomas A.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 92 : 53 - 65
  • [9] Loop Closure Detection Based on Image Semantic Segmentation in Indoor Environment
    Li, Jinming
    Wang, Peng
    Ni, Cui
    Rong, Wen
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [10] Loop Closure Detection Based on Image Semantic Segmentation in Indoor Environment
    Li, Jinming
    Wang, Peng
    Ni, Cui
    Rong, Wen
    Mathematical Problems in Engineering, 2022, 2022