YDD-SLAM: Indoor Dynamic Visual SLAM Fusing YOLOv5 with Depth Information

被引:4
|
作者
Cong, Peichao [1 ]
Liu, Junjie [1 ]
Li, Jiaxing [1 ]
Xiao, Yixuan [1 ]
Chen, Xilai [1 ]
Feng, Xinjie [1 ]
Zhang, Xin [1 ]
机构
[1] Guangxi Univ Sci & Technol, Sch Mech & Automot Engn, Liuzhou 545006, Peoples R China
关键词
dynamic VSLAM; ORB-SLAM3; YOLOv5; object classification; depth information fusion; ROBUST; ENVIRONMENTS; VERSATILE;
D O I
10.3390/s23239592
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Simultaneous location and mapping (SLAM) technology is key in robot autonomous navigation. Most visual SLAM (VSLAM) algorithms for dynamic environments cannot achieve sufficient positioning accuracy and real-time performance simultaneously. When the dynamic object proportion is too high, the VSLAM algorithm will collapse. To solve the above problems, this paper proposes an indoor dynamic VSLAM algorithm called YDD-SLAM based on ORB-SLAM3, which introduces the YOLOv5 object detection algorithm and integrates deep information. Firstly, the objects detected by YOLOv5 are divided into eight subcategories according to their motion characteristics and depth values. Secondly, the depth ranges of the dynamic object and potentially dynamic object in the moving state in the scene are calculated. Simultaneously, the depth value of the feature point in the detection box is compared with that of the feature point in the detection box to determine whether the point is a dynamic feature point; if it is, the dynamic feature point is eliminated. Further, multiple feature point optimization strategies were developed for VSLAM in dynamic environments. A public data set and an actual dynamic scenario were used for testing. The accuracy of the proposed algorithm was significantly improved compared to that of ORB-SLAM3. This work provides a theoretical foundation for the practical application of a dynamic VSLAM algorithm.
引用
收藏
页数:32
相关论文
共 50 条
  • [21] Fusing Semantic Segmentation and Object Detection for Visual SLAM in Dynamic Scenes
    Yu, Peilin
    Guo, Chi
    Liu, Yang
    Zhang, Huyin
    PROCEEDINGS OF 27TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, VRST 2021, 2021,
  • [22] Dynamic SLAM Based on Neural Network and Depth Information
    Liu, Aoqiang
    Yang, Shu
    Fan, Yuan
    2024 3RD CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, FASTA 2024, 2024, : 1187 - 1192
  • [23] BY-SLAM: Dynamic Visual SLAM System Based on BEBLID and Semantic Information Extraction
    Zhu, Daixian
    Liu, Peixuan
    Qiu, Qiang
    Wei, Jiaxin
    Gong, Ruolin
    SENSORS, 2024, 24 (14)
  • [24] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Liu, Qiang
    Yuan, Jie
    Kuang, Benfa
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 53531 - 53547
  • [25] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Qiang Liu
    Jie Yuan
    Benfa Kuang
    Multimedia Tools and Applications, 2024, 83 : 53531 - 53547
  • [26] RSV-SLAM: Toward Real-Time Semantic Visual SLAM in Indoor Dynamic Environments
    Habibpour, Mobin
    Nemati, Alireza
    Meghdari, Ali
    Taheri, Alireza
    Nazari, Shima
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 832 - 844
  • [27] YES-SLAM: YOLOv7-enhanced-semantic visual SLAM for mobile robots in dynamic scenes
    Liu, Hang
    Luo, Jingwen
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (03)
  • [28] DKP-SLAM: A Visual SLAM for Dynamic Indoor Scenes Based on Object Detection and Region Probability
    Yin, Menglin
    Qin, Yong
    Peng, Jiansheng
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (01): : 1329 - 1347
  • [29] MOR-SLAM: A New Visual SLAM System for Indoor Dynamic Environments Based on Mask Restoration
    Yao, Chengzhi
    Ding, Lei
    Lan, Yonghong
    MATHEMATICS, 2023, 11 (19)
  • [30] MDP-SLAM: A Visual SLAM towards a Dynamic Indoor Scene Based on Adaptive Mask Dilation and Dynamic Probability
    Zhang, Xiaofeng
    Shi, Zhengyang
    ELECTRONICS, 2024, 13 (08)