Online parameter adaptive control of mobile robots based on deep reinforcement learning under multiple optimisation objectives

被引:0
|
作者
Sui, Xiuli [1 ,2 ]
Chen, Haiyong [2 ]
机构
[1] Tianjin Sino German Univ Appl Sci, Software & Commun Sch, Tianjin, Peoples R China
[2] Hebei Univ Technol, Sch Artificial Intelligence, Tianjin, Peoples R China
关键词
learning (artificial intelligence); mobile robots; TRACKING CONTROL;
D O I
10.1049/ccs2.12105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fixed control parameters and various optimisation objectives significantly limit the robot control performance. To address such issues, a parameter adaptive controller based on deep reinforcement learning is introduced firstly to adjust control parameters according to the real-time system state. Further, multiple evaluation mechanisms are constructed to take account of optimisation objectives so that the controller can adapt to different control performance indexes by different evaluation mechanisms. Finally, the target pedestrian tracking control with mobile robots is selected as the validation case study, and the Proportional-Derivative Controller is chosen as the foundation controller. Several simulation and experimental examples are designed, and the results demonstrate that the proposed method shows satisfactory performance while taking account of multiple optimisation objectives.
引用
收藏
页码:86 / 97
页数:12
相关论文
共 50 条
  • [41] Deep Reinforcement Learning-Based Control of Bicycle Robots on Rough Terrain
    Zhu, Xianjin
    Zheng, Xudong
    Deng, Yang
    Chen, Zhang
    Liang, Bin
    Liu, Yu
    2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 103 - 108
  • [42] Adaptive Task Offloading for Mobile Aware Applications Based on Deep Reinforcement Learning
    Liu, Xianming
    Zhang, Chaokun
    He, Shen
    2022 IEEE 19TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2022), 2022, : 33 - 39
  • [43] A Reinforcement Learning based Adaptive Supervisor for Multiple Model Adaptive Estimation and Control
    Renwick, Zachary
    Tilbury, Dawn
    Atkins, Ella
    2018 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY (EIT), 2018, : 216 - 221
  • [44] Deep Reinforcement Learning Based Radar Parameter Adaptation for Multiple Target Tracking
    Huang Y.
    Guo R.
    Zhang Y.
    Chen Z.
    IEEE Transactions on Aerospace and Electronic Systems, 2024, 60 (05) : 1 - 18
  • [45] Leader-following based adaptive formation control for multiple mobile robots
    Park B.S.
    Park J.B.
    Journal of Institute of Control, Robotics and Systems, 2010, 16 (05) : 428 - 432
  • [46] Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning
    Yin, Yongfeng
    Wang, Zhetao
    Zheng, Lili
    Su, Qingran
    Guo, Yang
    ELECTRONICS, 2024, 13 (13)
  • [47] Deep Reinforcement Learning based Adaptive Transmission Control in Vehicular Networks
    Liu, Mingyuan
    Quan, Wei
    Yu, Chengxiao
    Zhang, Xue
    Gao, Deyun
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [48] Reward-Based Exploration: Adaptive Control for Deep Reinforcement Learning
    Xu, Zhi-xiong
    Cao, Lei
    Chen, Xi-liang
    Li, Chen-xi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (09): : 2409 - 2412
  • [49] Barrier Function-based Safe Reinforcement Learning for Formation Control of Mobile Robots
    Zhang, Xinglong
    Peng, Yaoqian
    Pan, Wei
    Xu, Xin
    Xie, Haibin
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 5532 - 5538
  • [50] Multiple Workflows Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing
    Gao, Yongqiang
    Wang, Yanping
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT I, 2022, 13155 : 476 - 493