Dynamic visual simultaneous localization and mapping based on semantic segmentation module

被引:7
|
作者
Jin, Jing [1 ,2 ,3 ]
Jiang, Xufeng [1 ,2 ,3 ]
Yu, Chenhui [1 ]
Zhao, Lingna [4 ]
Tang, Zhen [4 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Key Lab Ind Safety & Emergency Technol, Hefei 230009, Peoples R China
[3] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230009, Peoples R China
[4] Anhui Water Conservancy Tech Coll, Sch Mechatron Engn, Hefei 231603, Peoples R China
关键词
Semantic SLAM; Dynamic scenes; Epipolar constraints; Point cloud map; MONOCULAR SLAM; ENVIRONMENTS; TRACKING;
D O I
10.1007/s10489-023-04531-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous localization and mapping (SLAM) is a key technique for mobile robotics. Moving objects can vastly impair the performance of a visual SLAM system. To deal with the problem, a new semantic visual SLAM system for indoor environments is proposed. Our system adds a semantic segmentation network and geometric model to detect and remove dynamic feature points on moving objects. Moreover, a 3D point cloud map with semantic information is created using semantic labels and depth images. We evaluate our method on the TUM RGB-D dataset and real-world environments. The evaluation metrics used are absolute trajectory error and relative position error. Experimental results show our method improves the accuracy in dynamic scenes compared to ORB-SLAM3 and other advanced methods.
引用
收藏
页码:19418 / 19432
页数:15
相关论文
共 50 条
  • [1] Dynamic visual simultaneous localization and mapping based on semantic segmentation module
    Jing Jin
    Xufeng Jiang
    Chenhui Yu
    Lingna Zhao
    Zhen Tang
    Applied Intelligence, 2023, 53 : 19418 - 19432
  • [2] Visual simultaneous localization and mapping (vSLAM) algorithm based on improved Vision Transformer semantic segmentation in dynamic scenes
    Chen, Mengyuan
    Guo, Hangrong
    Qian, Runbang
    Gong, Guangqiang
    Cheng, Hao
    MECHANICAL SCIENCES, 2024, 15 (01) : 1 - 16
  • [3] Multilevel Semantic Maps Based on Visual Simultaneous Localization and Mapping in Dynamic Scenarios
    Mei, Tiancan
    Qin, Yusheng
    Yang, Hong
    Gao, Zhi
    Li, Haoran
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (05) : 1737 - 1746
  • [4] A Comparative Review on Enhancing Visual Simultaneous Localization and Mapping with Deep Semantic Segmentation
    Liu, Xiwen
    He, Yong
    Li, Jue
    Yan, Rui
    Li, Xiaoyu
    Huang, Hui
    SENSORS, 2024, 24 (11)
  • [5] Semantic visual simultaneous localization and mapping (SLAM) using deep learning for dynamic scenes
    Zhang X.Y.
    Rahman A.H.A.
    Qamar F.
    PeerJ Computer Science, 2023, 9
  • [6] Semantic visual simultaneous localization and mapping (SLAM) using deep learning for dynamic scenes
    Zhang, Xiao Ya
    Abd Rahman, Abdul Hadi
    Qamar, Faizan
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [7] Visual-based Semantic Simultaneous Localization and Mapping for Robotic Applications: A Review
    Atoui, Oussama
    Husni, Husniza
    Mat, Ruzinoor Che
    4TH INNOVATION AND ANALYTICS CONFERENCE & EXHIBITION (IACE 2019), 2019, 2138
  • [8] A visual simultaneous localization and mapping approach based on scene segmentation and incremental optimization
    Zhang, Xiaoguo
    Liu, Qihan
    Zheng, Bingqing
    Wang, Huiqing
    Wang, Qing
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (06)
  • [9] Visual Simultaneous Localization and Mapping Algorithm Based on Dynamic Target Detection
    Xu Xuesong
    Zeng Yu
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (16)
  • [10] Visual Simultaneous Localization and Mapping Method of Semantic Octree Map Toward Indoor Dynamic Scenes
    Zhang Rongfen
    Yuan Wenhao
    Lu Jin
    Liu Yuhong
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (18)