Neural Q Learning Algorithm based UAV Obstacle Avoidance

被引:0
|
作者
Zhou, Benchun [1 ]
Wang, Weihong [2 ]
Wang, Zhifeng [3 ]
Ding, Baoyang [1 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Nav Guidance & Control, Beijing 100191, Peoples R China
[3] China Acad Space Technol, Automat, Beijing 100094, Peoples R China
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the paper, Neural Q Learning algorithm (NQL) was involved to solve the obstacle avoidance problem for UAV path planning. Q learning was good at online learning and BP network provided excellent function approximation. The combination of two methods can provided UAV a collision-free trajectory in unknown environment. Through several simulations, the proposed algorithm could gain better performance and gain higher success rate than classic Q-learning (CQL). Besides, this method was extended for deep reinforcement learning, such as DQN, which is more suitable for practical applications.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Multi-obstacle Avoidance of UAV Based on Improved Q Learning Algorithm
    Gao, Haochen
    Li, Jinna
    [J]. PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 59 - 71
  • [2] The Algorithm for UAV Obstacle Avoidance and Route Planning Based on Reinforcement Learning
    Liu, Jiantong
    Wang, Zhengjie
    Zhang, Zhide
    [J]. PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC2019), 2020, 582 : 747 - 754
  • [3] Q learning algorithm based UAV path learning and obstacle avoidence approach
    Zhao Yijing
    Zheng Zheng
    Zhang Xiaoyi
    Liu Yang
    [J]. PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 3397 - 3402
  • [4] Study on UAV obstacle avoidance algorithm based on deep recurrent double Q network
    Wei, Yao
    Liu, Zhicheng
    Cai, Bin
    Chen, Jiaxin
    Yang, Yao
    Zhang, Kai
    [J]. Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2022, 40 (05): : 970 - 979
  • [5] UAV Obstacle Avoidance Algorithm Based on Ellipsoid Geometry
    R. A. Sasongko
    S. S. Rawikara
    Hansel J. Tampubolon
    [J]. Journal of Intelligent & Robotic Systems, 2017, 88 : 567 - 581
  • [6] UAV Obstacle Avoidance Algorithm Based on Ellipsoid Geometry
    Sasongko, R. A.
    Rawikara, S. S.
    Tampubolon, Hansel J.
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2017, 88 (2-4) : 567 - 581
  • [7] Study of the Obstacle Avoidance Plan of UAV Based on IRIS Algorithm
    Li, Yunhe
    Wu, Xi
    Zhang, Qinyu
    [J]. CONFERENCE PROCEEDINGS OF 2017 3RD IEEE INTERNATIONAL CONFERENCE ON CONTROL SCIENCE AND SYSTEMS ENGINEERING (ICCSSE), 2017, : 74 - 79
  • [8] Autonomous obstacle avoidance of UAV based on deep reinforcement learning
    Yang, Songyue
    Yu, Guizhen
    Meng, Zhijun
    Wang, Zhangyu
    Li, Han
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (04) : 3323 - 3335
  • [9] Obstacle Avoidance Path Planning for UAV Based on Improved RRT Algorithm
    Yang, Fan
    Fang, Xi
    Gao, Fei
    Zhou, Xianjin
    Li, Hao
    Jin, Hongbin
    Song, Yu
    [J]. DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2022, 2022
  • [10] Dynamic Obstacle Avoidance Planning Algorithm for UAV Based on Dubins Path
    Wang, Na
    Dai, Fei
    Liu, Fangxin
    Zhang, Guomin
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2018, PT II, 2018, 11335 : 367 - 377