DYS-SLAM: A real-time RGBD SLAM combined with optical flow and semantic information in a dynamic environment

被引:2
|
作者
Fang, Yuhua [1 ]
Xie, Zhijun [1 ]
Chen, Kewei [2 ]
Huang, Guangyan [3 ]
Zarei, Roozbeh [3 ]
Xie, Yuntao [4 ]
机构
[1] Ningbo Univ, Sch Fac Elect Engn & Comp Sci, Ningbo, Peoples R China
[2] Ningbo Univ, Sch Fac Mech Engn & Mech, Ningbo, Peoples R China
[3] Deakin Univ, Sch Informat Technol, Melbourne, Vic, Australia
[4] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Visual SLAM; object detection; dynamic environment; deep learning for visual perception; SIMULTANEOUS LOCALIZATION;
D O I
10.3233/JIFS-234235
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional Simultaneous Localization and Mapping application in dynamic situations is constrained by static assumptions. However, the majority of well-known dynamic SLAM systems use deep learning to identify dynamic objects, which creates the issue of trade-offs between accuracy and real-time. To tackle this issue, this work suggests a unique dynamic semantics method(DYS-SLAM) for semantic simultaneous localization and mapping that strikes a trade-off between high accuracy and high real-time performance. We propose M-LK, an enhanced Lucas-Kanade(LK) optical flow method. This technique keeps the continuous motion and greyscale consistency assumptions from the original method while switching out the spatial consistency assumption for a motion consistency assumption, reducing sensitivity to image gradients to identify dynamic feature points and regions efficiently. In order to increase segmentation accuracy while maintaining real-time performance, we develop a segmentation refinement scheme that projects 3D point cloud segmentation results into 2D object detection zones. A dense semantic octree graph is built in the interim to expedite the high-level process. Compared to the four equivalent dynamic SLAM approaches, experiments on the publicly available TUM RGB-D dataset demonstrate that the DYS-SLAM method offers competitive localization accuracy and satisfactory real-time performance in both high and low-dynamic scenarios.
引用
收藏
页码:10349 / 10367
页数:19
相关论文
共 50 条
  • [31] RVD-SLAM: A Real-Time Visual SLAM Toward Dynamic Environments Based on Sparsely Semantic Segmentation and Outlier Prior
    Zhou, Yao
    Tao, Fazhan
    Fu, Zhumu
    Zhu, Longlong
    Ma, Haoxiang
    IEEE SENSORS JOURNAL, 2023, 23 (24) : 30773 - 30785
  • [32] Real-Time Semantic Mapping of Visual SLAM Based on DCNN
    Chen, Xudong
    Zhu, Yu
    Zheng, Bingbing
    Huang, Junjian
    DIGITAL TV AND MULTIMEDIA COMMUNICATION, 2019, 1009 : 194 - 204
  • [33] A real-time semantic visual SLAM approach with points and objects
    Guan, Peiyu
    Cao, Zhiqiang
    Chen, Erkui
    Liang, Shuang
    Tan, Min
    Yu, Junzhi
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (01)
  • [34] A SLAM in Dynamic Environment Based on Instance Segmentation and Optical Flow
    Yue S.
    Wang Z.
    Binggong Xuebao/Acta Armamentarii, 2024, 45 (01): : 156 - 165
  • [35] Real-Time Dynamic SLAM Algorithm Based on Deep Learning
    Su, Peng
    Luo, Suyun
    Huang, Xiaoci
    IEEE ACCESS, 2022, 10 : 87754 - 87766
  • [36] Using Detection, Tracking and Prediction in Visual SLAM to Achieve Real-time Semantic Mapping of Dynamic Scenarios
    Chen, Xingyu
    Xue, Jianru
    Fang, Jianwu
    Pan, Yuxin
    Zheng, Nanning
    2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 666 - 671
  • [37] Spatial Information Guided Convolution for Real-Time RGBD Semantic Segmentation
    Chen, Lin-Zhuo
    Lin, Zheng
    Wang, Ziqin
    Yang, Yong-Liang
    Cheng, Ming-Ming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2313 - 2324
  • [38] STDC-SLAM: A Real-Time Semantic SLAM Detect Object by Short-Term Dense Concatenate Network
    Hu, Zhangfang
    Chen, Jian
    Luo, Yuan
    Zhang, Yi
    IEEE ACCESS, 2022, 10 : 129419 - 129428
  • [39] Real-time LiDAR SLAM in Off-road Environment for UGV
    Liu Z.
    Chen H.
    Cui X.
    Xiong G.
    Wang Y.
    Tao Y.
    Binggong Xuebao/Acta Armamentarii, 2019, 40 (12): : 2399 - 2406
  • [40] A Real-Time Dynamic Object Segmentation Framework for SLAM System in Dynamic Scenes
    Chang, Jianfang
    Dong, Na
    Li, Donghui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70