Neural Q Learning Algorithm based UAV Obstacle Avoidance

被引:0
|
作者
Zhou, Benchun [1 ]
Wang, Weihong [2 ]
Wang, Zhifeng [3 ]
Ding, Baoyang [1 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Nav Guidance & Control, Beijing 100191, Peoples R China
[3] China Acad Space Technol, Automat, Beijing 100094, Peoples R China
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the paper, Neural Q Learning algorithm (NQL) was involved to solve the obstacle avoidance problem for UAV path planning. Q learning was good at online learning and BP network provided excellent function approximation. The combination of two methods can provided UAV a collision-free trajectory in unknown environment. Through several simulations, the proposed algorithm could gain better performance and gain higher success rate than classic Q-learning (CQL). Besides, this method was extended for deep reinforcement learning, such as DQN, which is more suitable for practical applications.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Obstacle Avoidance for AUV by Q-Learning based Guidance Vector Field
    Wu, Keqiao
    Yao, Peng
    [J]. PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 702 - 707
  • [42] Dual-game based UAV swarm obstacle avoidance algorithm in multi-narrow type obstacle scenarios
    Lin, Ye
    Na, Zhenyu
    Feng, Zilong
    Lin, Bin
    Lin, Yun
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2023, 2023 (01)
  • [43] Automatic obstacle avoidance planning for UAV based on velocity obstacle arc method
    Yang X.
    Zhou W.
    Zhang Y.
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2017, 39 (01): : 168 - 176
  • [44] Research on Image Feature Matching Algorithm Applied to UAV Obstacle Avoidance
    Zhu Haijie
    Li Jiafeng
    Cheng Sifan
    Qin Linlin
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 3753 - 3757
  • [45] Dual-game based UAV swarm obstacle avoidance algorithm in multi-narrow type obstacle scenarios
    Ye Lin
    Zhenyu Na
    Zilong Feng
    Bin Lin
    Yun Lin
    [J]. EURASIP Journal on Advances in Signal Processing, 2023
  • [46] UAV obstacle avoidance and track recovery strategy based on velocity obstacle method
    Zhang H.
    Gan X.
    Li A.
    Gao Z.
    Xu X.
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2020, 42 (08): : 1759 - 1767
  • [47] Three-Dimensional Autonomous Obstacle Avoidance Algorithm for UAV Based on Circular Arc Trajectory
    Guo, Jiandong
    Liang, Chenyu
    Wang, Kang
    Sang, Biao
    Wu, Yulin
    [J]. INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2021, 2021
  • [48] Multi-narrow type obstacle avoidance algorithm for UAV swarm based on game theory
    Lin Y.
    Na Z.
    Liu J.
    Lin Y.
    [J]. Advanced Control for Applications: Engineering and Industrial Systems, 2023, 5 (04):
  • [49] UAV Formation Obstacle Avoidance Control Algorithm Based on Improved Artificial Potential Field and Consensus
    Wang, Ning
    Dai, Jiyang
    Ying, Jin
    [J]. INTERNATIONAL JOURNAL OF AERONAUTICAL AND SPACE SCIENCES, 2021, 22 (06) : 1413 - 1427
  • [50] UAV Formation Obstacle Avoidance Control Algorithm Based on Improved Artificial Potential Field and Consensus
    Ning Wang
    Jiyang Dai
    Jin Ying
    [J]. International Journal of Aeronautical and Space Sciences, 2021, 22 : 1413 - 1427