Double Deep Q-Learning and Faster R-CNN-Based Autonomous Vehicle Navigation and Obstacle Avoidance in Dynamic Environment

被引:19
|
作者
Bin Issa, Razin [1 ]
Das, Modhumonty [1 ]
Rahman, Md. Saferi [1 ]
Barua, Monika [1 ]
Rhaman, Md. Khalilur [1 ]
Ripon, Kazi Shah Nawaz [2 ]
Alam, Md. Golam Rabiul [1 ]
机构
[1] BRAC Univ, Sch Data & Sci, Dept Comp Sci & Engn, 66 Mohakhali, Dhaka 1212, Bangladesh
[2] Ostfold Univ Coll, Fac Comp Sci, N-1783 Halden, Norway
关键词
autonomous vehicle; reinforcement learning; Double Deep Q Learning; faster R-CNN; object classifier; markov decision process;
D O I
10.3390/s21041468
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Autonomous vehicle navigation in an unknown dynamic environment is crucial for both supervised- and Reinforcement Learning-based autonomous maneuvering. The cooperative fusion of these two learning approaches has the potential to be an effective mechanism to tackle indefinite environmental dynamics. Most of the state-of-the-art autonomous vehicle navigation systems are trained on a specific mapped model with familiar environmental dynamics. However, this research focuses on the cooperative fusion of supervised and Reinforcement Learning technologies for autonomous navigation of land vehicles in a dynamic and unknown environment. The Faster R-CNN, a supervised learning approach, identifies the ambient environmental obstacles for untroubled maneuver of the autonomous vehicle. Whereas, the training policies of Double Deep Q-Learning, a Reinforcement Learning approach, enable the autonomous agent to learn effective navigation decisions form the dynamic environment. The proposed model is primarily tested in a gaming environment similar to the real-world. It exhibits the overall efficiency and effectiveness in the maneuver of autonomous land vehicles.
引用
收藏
页码:1 / 24
页数:24
相关论文
共 50 条
  • [41] Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Deep Reinforcement Learning
    Xu, Guoqiang
    Jiang, Weilai
    Wang, Zhaolei
    Wang, Yaonan
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 104 (04)
  • [42] Double Deep Q-Learning Based Irrigation and Chemigation Control
    Song, Jianfeng
    Porter, Dana
    Hu, Jiang
    Marek, Thomas
    PROCEEDINGS OF THE TWENTY THIRD INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED 2022), 2022, : 414 - 419
  • [43] Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Deep Reinforcement Learning
    Guoqiang Xu
    Weilai Jiang
    Zhaolei Wang
    Yaonan Wang
    Journal of Intelligent & Robotic Systems, 2022, 104
  • [44] Toward Safety Navigation in Cluttered Dynamic Environment: A Robot Neural-Based Hybrid Autonomous Navigation and Obstacle Avoidance with Moving Target Tracking
    Hacene, Nacer
    Mendil, Boubekeur
    3RD INTERNATIONAL CONFERENCE ON CONTROL, ENGINEERING & INFORMATION TECHNOLOGY (CEIT 2015), 2015,
  • [45] Static and Dynamic Collision Avoidance for Autonomous Robot Navigation in Diverse Scenarios based on Deep Reinforcement Learning
    Pico, Nabih
    Lee, Beomjoon
    Montero, Estrella
    Tadese, Meseret
    Auh, Eugene
    Doh, Myeongyun
    Moon, Hyungpil
    2023 20TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS, UR, 2023, : 281 - 286
  • [46] Dynamic collision avoidance for maritime autonomous surface ships based on deep Q-network with velocity obstacle method
    Li, Yuqin
    Wu, Defeng
    Wang, Hongdong
    Lou, Jiankun
    OCEAN ENGINEERING, 2025, 320
  • [47] Research on obstacle avoidance of underactuated autonomous underwater vehicle based on offline reinforcement learning
    Liu, Tao
    Huang, Junhao
    Zhao, Jintao
    ROBOTICA, 2024,
  • [48] Deep Q-learning Approach based on CNN and XGBoost for Traffic Signal Control
    Faqir, Nada
    Loqman, Chakir
    Boumhidi, Jaouad
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (09) : 529 - 536
  • [49] Obstacle Avoidance Algorithm for Unmanned Aerial Vehicle Vision Based on Deep Learning
    Zhang, Xiangzhu
    Zhang, Lijia
    Song, Yifan
    Pei, Hailong
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2022, 50 (01): : 101 - 108
  • [50] The synergy of the multi-modal MPC and Q-learning approach for the navigation of a three-wheeled omnidirectional robot based on the dynamic model with obstacle collision avoidance purposes
    Saeedinia, Samaneh Alsadat
    Tale Masouleh, Mehdi
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2022, 236 (17) : 9716 - 9729