Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments

被引:17
|
作者
Yang, Shiqiang [1 ]
Zhao, Cheng [1 ]
Wu, Zhengkun [2 ]
Wang, Yan [1 ]
Wang, Guodong [1 ]
Li, Dexin [1 ]
机构
[1] Xian Univ Technol, Sch Mech & Precis Instrument Engn, Xian 710048, Peoples R China
[2] China Aerosp Sci & Ind Corp 210, Res Inst 6, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Heuristic algorithms; Simultaneous localization and mapping; Information filters; Filtering algorithms; Data mining; Visual SLAM; ORB-SLAM2; dynamic feature filtering; semantic map;
D O I
10.1109/ACCESS.2022.3185766
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in significant system positioning errors and high map redundancy. Based on the ORB-SLAM2 algorithm, this paper combines semantic information and a geometric constraint algorithm based on feature point homogenization to improve the positioning accuracy of the SLAM system. Aiming at the problem that the feature points extracted by the ORB-SLAM2 algorithm are easily concentrated, and the extraction rate is low in the weak texture area, a feature point homogenization algorithm based on quadtree and adaptive threshold is proposed to improve the uniformity of feature point extraction. In addition, in view of the impact of dynamic targets on the SLAM system, the dynamic information in the scene is filtered out through the semantic segmentation network and the motion consistency detection algorithm, and the static feature points obtained after filtering are used to estimate the camera pose. Then, a semantic map is constructed after filtering out the dynamic point cloud according to the semantic information. Finally, the test results on Oxford and TUM datasets show that the uniformity of feature points extracted by the improved algorithm is increased by 56.3%. The positioning error of visual SLAM is reduced by 68.8% on average, and the constructed semantic map has rich semantic information and less redundancy.
引用
收藏
页码:69636 / 69649
页数:14
相关论文
共 50 条
  • [31] Visual SLAM technology based on weakly supervised semantic segmentation in dynamic environment
    Liu, Jianxin
    Zeng, Menglan
    Wang, Yuchao
    Liu, Wei
    INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2020, 2020, 11574
  • [32] Semantic SLAM for mobile robots in dynamic environments based on visual camera sensors
    Zhang, Qi
    Li, Changdi
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (08)
  • [33] ESD-SLAM: An efficient semantic visual SLAM towards dynamic environments
    Xu, Yan
    Wang, Yanyun
    Huang, Jiani
    Qin, Hong
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (06) : 5155 - 5164
  • [34] MOR-SLAM: A New Visual SLAM System for Indoor Dynamic Environments Based on Mask Restoration
    Yao, Chengzhi
    Ding, Lei
    Lan, Yonghong
    MATHEMATICS, 2023, 11 (19)
  • [35] A Monocular-Visual SLAM System with Semantic and Optical-Flow Fusion for Indoor Dynamic Environments
    Chen, Weifeng
    Shang, Guangtao
    Hu, Kai
    Zhou, Chengjun
    Wang, Xiyang
    Fang, Guisheng
    Ji, Aihong
    MICROMACHINES, 2022, 13 (11)
  • [36] SPP-SLAM: Dynamic Visual SLAM with Multiple Constraints Based on Semantic Masks and Probabilistic Propagation
    Qiu, Run
    He, Ying
    Yu, F. Richard
    Zhou, Guang
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [37] Panoptic-SLAM: Visual SLAM in Dynamic Environments using Panoptic Segmentation
    Abati, Gahriel Fischer
    Soares, Joao Carlos Virgolino
    Medeiros, Vivian Suzano
    Meggiolaro, Marco Antonio
    Semini, Claudio
    2024 21ST INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS, UR 2024, 2024, : 762 - 769
  • [38] Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2
    Li, Yawen
    Song, Guangming
    Hao, Shuang
    Mao, Juzheng
    Song, Aiguo
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2023, 50 (03): : 542 - 554
  • [39] Visual SLAM System Design based on Semantic Segmentation
    Wang, Jiwu
    Liu, Yafan
    ICAROB 2019: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS, 2019, : 316 - 319
  • [40] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Liu, Qiang
    Yuan, Jie
    Kuang, Benfa
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 53531 - 53547