Autonomous navigation based on PPO for mobile platform

被引：0

作者：

Xu G. ^{[1
]}

Xiong Y. ^{[1
]}

Zhou B. ^{[1
]}

Chen G. ^{[1
]}

机构：

[1] Key Laboratory of Autonomous Transportation Technology for Special Vehicles, Ministry of Industry and Information Technology, School of Transportation Science and Engineering, Beihang University, Beijing

来源：

Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics | 2022年 / 48卷 / 11期

基金：

中国国家自然科学基金;

关键词：

artificial potential field; autonomous navigation; mobile platform; proximal policy optimization algorithm; reinforcement learning;

D O I：

10.13700/j.bh.1001-5965.2021.0100

中图分类号：

学科分类号：

摘要：

This paper presents an autonomous navigation method based on proximal policy optimization (PPO) algorithm for mobile platform. In this method, GNSS and LADAR are used for sensing environment information. To define the state of reinforcement learning model, an ego position evaluation method is introduced based on improved artificial potential field algorithm. After that, on the basis of PPO algorithm, a kind of action policy function is designed based on Gaussian distribution, which solves the continuity problem of the vehicle linear velocity and yaw velocity. Furthermore, the network framework and reward function of the model are also designed for navigation scenarios. In order to train the navigation model, a virtual environment based on Gazebo is built. The training results show that the ego position evaluation method obviously helps to improve the speed of model convergence. Finally, the navigation model is transplanted to a real environment, which verifies the effectiveness of the proposed method. © 2022 Beijing University of Aeronautics and Astronautics (BUAA). All rights reserved.

引用

页码：2138 / 2145

页数：7

共 15 条

[11] TAI L, PAOLO G, LIU M., Virtual-to-real deep reinforcement learning:Continuous control of mobile robots for mapless navigation, IEEE / RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 31-36, (2017)
[12] SCHULMAN J, WOLSKI F, DHARIWAL P, Et al., Proximal policy optimization algorithms[ EB / OL]
[13] LIU Z P, YU Q Y, ZHA J F., Fast coordinate transformations for both XYZ-BLH and XYZ-RhA [ J], Science of Surveying and Mapping, 40, 3, pp. 8-11, (2015)
[14] LIU S H, DENG C Q., Transformation of coordinate system[ J], Journal of Jilin Jianzhu University, 33, 1, pp. 43-47, (2016)
[15] KHATIB O., Real-time obstacle avoidance system for manipulators and mobile robots[J], International Journal of Robotics Research, 5, 1, pp. 90-98, (1986)

← 1 2 →