Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments

被引:17
|
作者
Yang, Shiqiang [1 ]
Zhao, Cheng [1 ]
Wu, Zhengkun [2 ]
Wang, Yan [1 ]
Wang, Guodong [1 ]
Li, Dexin [1 ]
机构
[1] Xian Univ Technol, Sch Mech & Precis Instrument Engn, Xian 710048, Peoples R China
[2] China Aerosp Sci & Ind Corp 210, Res Inst 6, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Heuristic algorithms; Simultaneous localization and mapping; Information filters; Filtering algorithms; Data mining; Visual SLAM; ORB-SLAM2; dynamic feature filtering; semantic map;
D O I
10.1109/ACCESS.2022.3185766
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in significant system positioning errors and high map redundancy. Based on the ORB-SLAM2 algorithm, this paper combines semantic information and a geometric constraint algorithm based on feature point homogenization to improve the positioning accuracy of the SLAM system. Aiming at the problem that the feature points extracted by the ORB-SLAM2 algorithm are easily concentrated, and the extraction rate is low in the weak texture area, a feature point homogenization algorithm based on quadtree and adaptive threshold is proposed to improve the uniformity of feature point extraction. In addition, in view of the impact of dynamic targets on the SLAM system, the dynamic information in the scene is filtered out through the semantic segmentation network and the motion consistency detection algorithm, and the static feature points obtained after filtering are used to estimate the camera pose. Then, a semantic map is constructed after filtering out the dynamic point cloud according to the semantic information. Finally, the test results on Oxford and TUM datasets show that the uniformity of feature points extracted by the improved algorithm is increased by 56.3%. The positioning error of visual SLAM is reduced by 68.8% on average, and the constructed semantic map has rich semantic information and less redundancy.
引用
收藏
页码:69636 / 69649
页数:14
相关论文
共 50 条
  • [1] Semantic SLAM Based on Compensated Segmentation and Geometric Constraints in Dynamic Environments
    Fang, Baofu
    Zhou, Shuai
    Wang, Hao
    Proceedings of 2022 6th Asian Conference on Artificial Intelligence Technology, ACAIT 2022, 2022,
  • [2] YGC-SLAM:A visual SLAM based on improved YOLOv5 and geometric constraints for dynamic indoor environments
    Juncheng ZHANG
    Fuyang KE
    Qinqin TANG
    Wenming YU
    Ming ZHANG
    虚拟现实与智能硬件(中英文), 2025, 7 (01) : 62 - 82
  • [3] OFM-SLAM: A Visual Semantic SLAM for Dynamic Indoor Environments
    Zhao, Xiong
    Zuo, Tao
    Hu, Xinyu
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [4] Indoor Dynamic Scene Visual SLAM Based On Human Detection And Geometric Constraints
    He, Jiantao
    He, Li
    Zhu, Haifei
    Xiang, Chaoqun
    Guan, Yisheng
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1652 - 1657
  • [5] Vehicle Visual SLAM in Dynamic Scenes Based on Semantic Segmentation and Motion Consistency Constraints
    Huang S.
    Hu M.
    Zhou Y.
    Yin Z.
    Qin X.
    Bian Y.
    Jia Q.
    Qiche Gongcheng/Automotive Engineering, 2022, 44 (10): : 1503 - 1510
  • [6] Improving RGB-D SLAM accuracy in dynamic environments based on semantic and geometric constraints
    Wang, Xiqi
    Zheng, Shunyi
    Lin, Xiaohu
    Zhu, Fengbo
    MEASUREMENT, 2023, 217
  • [7] A robust RGB-D SLAM based on multiple geometric features and semantic segmentation in dynamic environments
    Kuang, Benfa
    Yuan, Jie
    Liu, Qiang
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (01)
  • [8] RSV-SLAM: Toward Real-Time Semantic Visual SLAM in Indoor Dynamic Environments
    Habibpour, Mobin
    Nemati, Alireza
    Meghdari, Ali
    Taheri, Alireza
    Nazari, Shima
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 832 - 844
  • [9] SGC-VSLAM: A Semantic and Geometric Constraints VSLAM for Dynamic Indoor Environments
    Yang, Shiqiang
    Fan, Guohao
    Bai, Lele
    Zhao, Cheng
    Li, Dexin
    SENSORS, 2020, 20 (08)
  • [10] KSF-SLAM: A Key Segmentation Frame Based Semantic SLAM in Dynamic Environments
    Yao Zhao
    Zhi Xiong
    Shuailin Zhou
    Zheng Peng
    Pascual Campoy
    Ling Zhang
    Journal of Intelligent & Robotic Systems, 2022, 105