Knowledge-Embedded Deep Reinforcement Learning for Autonomous Network Decision-Making Algorithm

被引:1
|
作者
Zhang, Yalin [1 ]
Gao, Hui [1 ]
Su, Xin [2 ]
Liu, Bei [3 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing, Peoples R China
[3] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing, Peoples R China
关键词
Cloud-edge-end computing; Deep reinforcement learning; resource allocation; LOW-LATENCY COMMUNICATIONS; WIRELESS; DESIGN;
D O I
10.1109/VTC2022-Spring54318.2022.9860487
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a multi-critic deep Reinforcement learning framework (MCDRL) and a knowledge-embedded multi-critic deep reinforcement learning(KE-MCDRL) Decision-making method, the method can ensure users' real-time QoS delay requirements. Compared with implementing the deep reinforcement learning algorithm directly in the communication system, this method can accelerate the convergence and guarantee the initial QoS performance of the system. Simulation results show that the design method can significantly reduce the convergence time compared with traditional deep reinforcement learning, and has nearly optimal decision delay compared with existing decision-making methods, which can actualize real-time decision-making in a time-varying channel environment.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
    Li, Ke
    Zhang, Kun
    Zhang, Zhenchong
    Liu, Zekun
    Hua, Shuai
    He, Jianliang
    SENSORS, 2021, 21 (06)
  • [2] Research on Autonomous Decision-Making of UCAV Based on Deep Reinforcement Learning
    Wang, Linxiang
    Wei, Hongtao
    2022 3RD INFORMATION COMMUNICATION TECHNOLOGIES CONFERENCE (ICTC 2022), 2022, : 122 - 126
  • [3] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Guofa Li
    Shenglong Li
    Shen Li
    Yechen Qin
    Dongpu Cao
    Xingda Qu
    Bo Cheng
    Automotive Innovation, 2020, 3 : 374 - 385
  • [4] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Li, Guofa
    Li, Shenglong
    Li, Shen
    Qin, Yechen
    Cao, Dongpu
    Qu, Xingda
    Cheng, Bo
    AUTOMOTIVE INNOVATION, 2020, 3 (04) : 374 - 385
  • [5] Autonomous guidance maneuver control and decision-making algorithm based on deep reinforcement learning UAV route
    Zhang K.
    Li K.
    Shi H.
    Zhang Z.
    Liu Z.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2020, 42 (07): : 1567 - 1574
  • [6] Decision-Making in Fallback Scenarios for Autonomous Vehicles: Deep Reinforcement Learning Approach
    Lee, Cheonghwa
    An, Dawn
    APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [7] Autonomous Decision-Making for Aerobraking via Parallel Randomized Deep Reinforcement Learning
    Falcone, Giusy
    Putnam, Zachary R. R.
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (03) : 3055 - 3070
  • [8] Decision-Making Strategy on Highway for Autonomous Vehicles Using Deep Reinforcement Learning
    Liao, Jiangdong
    Liu, Teng
    Tang, Xiaolin
    Mu, Xingyu
    Huang, Bing
    Cao, Dongpu
    IEEE ACCESS, 2020, 8 (08): : 177804 - 177814
  • [9] Random Prior Network for Autonomous Driving Decision-Making Based on Reinforcement Learning
    Qiang, Yuchuan
    Wang, Xiaolan
    Wang, Yansong
    Zhang, Weiwei
    Xu, Jianxun
    JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS, 2024, 150 (04)
  • [10] A Deep Reinforcement Learning Decision-Making Approach for Adaptive Cruise Control in Autonomous Vehicles
    Ghraizi, Dany
    Talj, Reine
    Francis, Clovis
    2023 21ST INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, ICAR, 2023, : 71 - 78