Deep Reinforcement Learning for Resource Allocation with Network Slicing in Cognitive Radio Network*

被引:11
|
作者
Yuan, Siyu [1 ,2 ]
Zhang, Yong [1 ,2 ]
Qie, Wenbo [1 ]
Ma, Tengteng [1 ,2 ]
Li, Sisi [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitorin, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio network; network slicing; resource allocation; deep re-inforcement learning;
D O I
10.2298/CSIS200710055Y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of wireless communication technology, the requirement for data rate is growing rapidly. Mobile communication system faces the problem of shortage of spectrum resources. Cognitive radio technology allows secondary users to use the frequencies authorized to the primary user with the permission of the primary user, which can effectively improve the utilization of spectrum resources. In this article, we establish a cognitive network model based on underlay model and propose a cognitive network resource allocation algorithm based on DDQN (Double Deep Q Network). The algorithm jointly optimizes the spectrum efficiency of the cognitive network and QoE (Quality of Experience) of cognitive users through channel selection and power control of the cognitive users. Simulation results show that proposed algorithm can effectively improve the spectral efficiency and QoE. Compared with Q-learning and DQN, this algorithm can converge faster and obtain higher spectral efficiency and QoE. The algorithm shows a more stable and efficient performance.
引用
收藏
页码:979 / 999
页数:21
相关论文
共 50 条
  • [31] Online Learning-based Virtual Resource Allocation for Network Slicing in Virtualized Cloud Radio Access Network
    Tang Lun
    Wei Yannan
    Ma Runlin
    He Xiaoyu
    Chen Qianbin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2019, 41 (07) : 1533 - 1539
  • [32] Online Learning-based Virtual Resource Allocation for Network Slicing in Virtualized Cloud Radio Access Network
    Tang L.
    Wei Y.
    Ma R.
    He X.
    Chen Q.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2019, 41 (07): : 1533 - 1539
  • [33] When Network Slicing meets Deep Reinforcement Learning
    Liu, Qiang
    Han, Tao
    CONEXT'19 COMPANION: PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON EMERGING NETWORKING EXPERIMENTS AND TECHNOLOGIES, 2019, : 29 - 30
  • [34] Hierarchical Radio Resource Allocation for Network Slicing in Fog Radio Access Networks
    Sun, Yaohua
    Peng, Mugen
    Mao, Shiwen
    Yan, Shi
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (04) : 3866 - 3881
  • [35] Dynamic Network Slicing using Deep Reinforcement Learning
    Kumar, Swaraj
    Vankayala, Satya Kumar
    Singh, Devashish
    Roy, Ishaan
    Sahoo, Biswa P. S.
    Yoon, Seungil
    Kanakaraj, Ignatius Samuel
    2021 IEEE INTERNATIONAL CONFERENCE ON ADVANCED NETWORKS AND TELECOMMUNICATIONS SYSTEMS (IEEE ANTS), 2021,
  • [36] GAN-based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Zhang, Honggang
    Chen, Xianfu
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [37] GAN-Powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Chen, Xianfu
    Zhang, Honggang
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (02) : 334 - 349
  • [38] Deep Reinforcement Learning With Discrete Normalized Advantage Functions for Resource Management in Network Slicing
    Qi, Chen
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Zhang, Honggang
    IEEE COMMUNICATIONS LETTERS, 2019, 23 (08) : 1337 - 1341
  • [39] Reinforcement Learning for Dynamic Resource Optimization in 5G Radio Access Network Slicing
    Shi, Yi
    Sagduyu, Yalin E.
    Erpek, Tugba
    2020 IEEE 25TH INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS (CAMAD), 2020,
  • [40] Resource allocation for joint energy and spectral efficiency in cloud radio access network based on deep reinforcement learning
    Iqbal, Amjad
    Tham, Mau-Luen
    Chang, Yoong Choon
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2022, 33 (04)