Knowledge-Embedded Deep Reinforcement Learning for Autonomous Network Decision-Making Algorithm

被引:1
|
作者
Zhang, Yalin [1 ]
Gao, Hui [1 ]
Su, Xin [2 ]
Liu, Bei [3 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing, Peoples R China
[3] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing, Peoples R China
来源
2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING) | 2022年
关键词
Cloud-edge-end computing; Deep reinforcement learning; resource allocation; LOW-LATENCY COMMUNICATIONS; WIRELESS; DESIGN;
D O I
10.1109/VTC2022-Spring54318.2022.9860487
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a multi-critic deep Reinforcement learning framework (MCDRL) and a knowledge-embedded multi-critic deep reinforcement learning(KE-MCDRL) Decision-making method, the method can ensure users' real-time QoS delay requirements. Compared with implementing the deep reinforcement learning algorithm directly in the communication system, this method can accelerate the convergence and guarantee the initial QoS performance of the system. Simulation results show that the design method can significantly reduce the convergence time compared with traditional deep reinforcement learning, and has nearly optimal decision delay compared with existing decision-making methods, which can actualize real-time decision-making in a time-varying channel environment.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Learning to Play Football From Sports Domain Perspective: A Knowledge-Embedded Deep Reinforcement Learning Framework
    Liu, Boyin
    Pu, Zhiqiang
    Zhang, Tianle
    Wang, Huimu
    Yi, Jianqiang
    Mi, Jiachen
    IEEE TRANSACTIONS ON GAMES, 2023, 15 (04) : 648 - 657
  • [22] Decision-Making for the Autonomous Navigation of Maritime Autonomous Surface Ships Based on Scene Division and Deep Reinforcement Learning
    Zhang, Xinyu
    Wang, Chengbo
    Liu, Yuanchang
    Chen, Xiang
    SENSORS, 2019, 19 (18)
  • [23] An Integrated Lateral and Longitudinal Decision-Making Model for Autonomous Driving Based on Deep Reinforcement Learning
    Cui, Jianxun
    Zhao, Boyuan
    Qu, Mingcheng
    JOURNAL OF ADVANCED TRANSPORTATION, 2023, 2023
  • [24] Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning
    Qi, Xiao
    Ye, Yingjun
    Sun, Jian
    CICTP 2019: TRANSPORTATION IN CHINA-CONNECTING THE WORLD, 2019, : 5853 - 5864
  • [25] An Integrated Model for Autonomous Speed and Lane Change Decision-Making Based on Deep Reinforcement Learning
    Peng, Jiankun
    Zhang, Siyu
    Zhou, Yang
    Li, Zhibin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 21848 - 21860
  • [26] Decision-Making of an Autonomous Vehicle when Approached by an Emergency Vehicle using Deep Reinforcement Learning
    Shoaraee, Hamid
    Chen, Liang
    Jiang, Fan
    2021 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS DASC/PICOM/CBDCOM/CYBERSCITECH 2021, 2021, : 185 - 191
  • [27] A novel deep reinforcement learning for POMDP-based autonomous ship collision decision-making
    Zhang, Xinyu
    Zheng, Kangjie
    Wang, Chengbo
    Chen, Jihong
    Qi, Huaiyuan
    NEURAL COMPUTING & APPLICATIONS, 2023,
  • [28] Deep imitative reinforcement learning with gradient conflict-free for decision-making in autonomous vehicles
    Shan, Zitong
    Zhao, Jian
    Huang, Wenhui
    Zhao, Yang
    Ge, Linhe
    Zhong, Shouren
    Hu, Hongyu
    Lv, Chen
    Zhu, Bing
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2025, 173
  • [29] Leveraging on Deep Reinforcement Learning for Autonomous Safe Decision-Making in Highway On-ramp Merging
    Kherroubi, Zine el Abidine
    Aknine, Samir
    Bacha, Rebiha
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 15815 - 15816
  • [30] Network Defense Decision-Making Based on Deep Reinforcement Learning and Dynamic Game Theory
    Huang, Wanwei
    Yuan, Bo
    Wang, Sunan
    Ding, Yi
    Li, Yuhua
    CHINA COMMUNICATIONS, 2024, 21 (09) : 262 - 275