DSOMF: A Dynamic Environment Simultaneous Localization and Mapping Technique Based on Machine Learning

被引:0
|
作者
Yue, Shengzhe [1 ]
Wang, Zhengjie [1 ]
Zhang, Xiaoning [1 ]
机构
[1] Beijing Inst Technol, Sch Electromech Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic scene; simultaneous localization and mapping; direct method; instance segmentation; video inpainting; TRACKING; SLAM;
D O I
10.3390/s24103063
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
To address the challenges of reduced localization accuracy and incomplete map construction demonstrated using classical semantic simultaneous localization and mapping (SLAM) algorithms in dynamic environments, this study introduces a dynamic scene SLAM technique that builds upon direct sparse odometry (DSO) and incorporates instance segmentation and video completion algorithms. While prioritizing the algorithm's real-time performance, we leverage the rapid matching capabilities of Direct Sparse Odometry (DSO) to link identical dynamic objects in consecutive frames. This association is achieved through merging semantic and geometric data, thereby enhancing the matching accuracy during image tracking through the inclusion of semantic probability. Furthermore, we incorporate a loop closure module based on video inpainting algorithms into our mapping thread. This allows our algorithm to rely on the completed static background for loop closure detection, further enhancing the localization accuracy of our algorithm. The efficacy of this approach is validated using the TUM and KITTI public datasets and the unmanned platform experiment. Experimental results show that, in various dynamic scenes, our method achieves an improvement exceeding 85% in terms of localization accuracy compared with the DSO system.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Semantic visual simultaneous localization and mapping (SLAM) using deep learning for dynamic scenes
    Zhang X.Y.
    Rahman A.H.A.
    Qamar F.
    [J]. PeerJ Computer Science, 2023, 9
  • [22] Semantic visual simultaneous localization and mapping (SLAM) using deep learning for dynamic scenes
    Zhang, Xiao Ya
    Abd Rahman, Abdul Hadi
    Qamar, Faizan
    [J]. PEERJ COMPUTER SCIENCE, 2023, 9
  • [23] Review of Simultaneous Localization and Mapping Technology in the Agricultural Environment
    Yaoguang Wei
    Bingqian Zhou
    Jialong Zhang
    Ling Sun
    Dong An
    Jincun Liu
    [J]. Journal of Beijing Institute of Technology, 2023, 32 (03) : 257 - 274
  • [24] Review of Simultaneous Localization and Mapping Technology in the Agricultural Environment
    Wei Y.
    Zhou B.
    Zhang J.
    Sun L.
    An D.
    Liu J.
    [J]. Journal of Beijing Institute of Technology (English Edition), 2023, 32 (03): : 257 - 274
  • [25] Simultaneous Localization and Mapping based on Lidar
    Jia Danping
    Duan Guangxue
    Wang Nan
    Zhou Zhigang
    Zhong Zhenyu
    Lei Huan
    [J]. PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 5528 - 5532
  • [26] Simultaneous localization and mapping in a multi-robot system in a dynamic environment with unknown initial correspondence
    Malakouti-Khah, Hadiseh
    Sadeghzadeh-Nokhodberiz, Nargess
    Montazeri, Allahyar
    [J]. FRONTIERS IN ROBOTICS AND AI, 2024, 10
  • [27] Simultaneous Localization and Mapping based on Lidar
    Danping, Jia
    Guangxue, Duan
    Nan, Wang
    Zhigang, Zhou
    Zhenyu, Zhong
    Huan, Lei
    [J]. Proceedings of the 31st Chinese Control and Decision Conference, CCDC 2019, 2019, : 5528 - 5532
  • [28] Simultaneous Localization and Mapping in Unknown Environment using Dynamic Matching of Images and Registration of Point Clouds
    Vokhmintsev, A.
    Timchenko, M.
    Yakovlev, K.
    [J]. 2016 2ND INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING, APPLICATIONS AND MANUFACTURING (ICIEAM), 2016,
  • [29] Robust Vision-based Simultaneous Localization and Mapping for Highly Dynamic Scenes
    Zhang, Zijian
    Lei, Qiaoyu
    Li, Chao
    Zhuang, Zhipeng
    Yan, Bo
    [J]. 2021 6TH INTERNATIONAL CONFERENCE ON UK-CHINA EMERGING TECHNOLOGIES (UCET 2021), 2021, : 221 - 228
  • [30] Multilevel Semantic Maps Based on Visual Simultaneous Localization and Mapping in Dynamic Scenarios
    Mei, Tiancan
    Qin, Yusheng
    Yang, Hong
    Gao, Zhi
    Li, Haoran
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (05) : 1737 - 1746