Deep Reinforcement Learning for Resource Allocation with Network Slicing in Cognitive Radio Network*

被引:11
|
作者
Yuan, Siyu [1 ,2 ]
Zhang, Yong [1 ,2 ]
Qie, Wenbo [1 ]
Ma, Tengteng [1 ,2 ]
Li, Sisi [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitorin, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio network; network slicing; resource allocation; deep re-inforcement learning;
D O I
10.2298/CSIS200710055Y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of wireless communication technology, the requirement for data rate is growing rapidly. Mobile communication system faces the problem of shortage of spectrum resources. Cognitive radio technology allows secondary users to use the frequencies authorized to the primary user with the permission of the primary user, which can effectively improve the utilization of spectrum resources. In this article, we establish a cognitive network model based on underlay model and propose a cognitive network resource allocation algorithm based on DDQN (Double Deep Q Network). The algorithm jointly optimizes the spectrum efficiency of the cognitive network and QoE (Quality of Experience) of cognitive users through channel selection and power control of the cognitive users. Simulation results show that proposed algorithm can effectively improve the spectral efficiency and QoE. Compared with Q-learning and DQN, this algorithm can converge faster and obtain higher spectral efficiency and QoE. The algorithm shows a more stable and efficient performance.
引用
收藏
页码:979 / 999
页数:21
相关论文
共 50 条
  • [1] Radio Resource Allocation Method for Network Slicing using Deep Reinforcement Learning
    Abiko, Yu
    Saito, Takato
    Ikeda, Daizo
    Ohta, Ken
    Mizuno, Tadanori
    Mineno, Hiroshi
    2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 420 - 425
  • [2] Dynamic Resource Allocation in Network Slicing with Deep Reinforcement Learning
    Cai, Yue
    Cheng, Peng
    Chen, Zhuo
    Xiang, Wei
    Vucetic, Branka
    Li, Yonghui
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2955 - 2960
  • [3] Deep Reinforcement Learning for Online Resource Allocation in Network Slicing
    Cai, Yue
    Cheng, Peng
    Chen, Zhuo
    Ding, Ming
    Vucetic, Branka
    Li, Yonghui
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (06) : 7099 - 7116
  • [4] DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing
    Liu, Qiang
    Han, Tao
    Zhang, Ning
    Wang, Ye
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [5] Graph convolutional reinforcement learning for resource allocation in hybrid overlay-underlay cognitive radio network with network slicing
    Yuan, Siyu
    Zhang, Yong
    Ma, Tengteng
    Cheng, Zhenjie
    Guo, Da
    IET COMMUNICATIONS, 2023, 17 (02) : 215 - 227
  • [6] Constrained Reinforcement Learning for Resource Allocation in Network Slicing
    Xu, Yizhen
    Zhao, Zhengyang
    Cheng, Peng
    Chen, Zhuo
    Ding, Ming
    Vucetic, Branka
    Li, Yonghui
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (05) : 1554 - 1558
  • [7] Deep Reinforcement Learning Based Resource Allocation for Network Slicing With Massive MIMO
    Yan, Dandan
    Ng, Benjamin K.
    Ke, Wei
    Lam, Chan-Tong
    IEEE ACCESS, 2023, 11 : 75899 - 75911
  • [8] A Graph Convolutional Network-Based Deep Reinforcement Learning Approach for Resource Allocation in a Cognitive Radio Network
    Zhao, Di
    Qin, Hao
    Song, Bin
    Han, Beichen
    Du, Xiaojiang
    Guizani, Mohsen
    SENSORS, 2020, 20 (18) : 1 - 23
  • [9] Flexible Resource Block Allocation to Multiple Slices for Radio Access Network Slicing Using Deep Reinforcement Learning
    Abiko, Yu
    Saito, Takato
    Ikeda, Daizo
    Ohta, Ken
    Mizuno, Tadanori
    Mineno, Hiroshi
    IEEE ACCESS, 2020, 8 : 68183 - 68198
  • [10] Deep Reinforcement Learning for Resource Management in Network Slicing
    Li, Rongpeng
    Zhao, Zhifeng
    Sun, Qi
    I, Chih-Lin
    Yang, Chenyang
    Chen, Xianfu
    Zhao, Minjian
    Zhang, Honggang
    IEEE ACCESS, 2018, 6 : 74429 - 74441