Deep Reinforcement Learning for Resource Allocation with Network Slicing in Cognitive Radio Network*

被引:11
|
作者
Yuan, Siyu [1 ,2 ]
Zhang, Yong [1 ,2 ]
Qie, Wenbo [1 ]
Ma, Tengteng [1 ,2 ]
Li, Sisi [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitorin, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio network; network slicing; resource allocation; deep re-inforcement learning;
D O I
10.2298/CSIS200710055Y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of wireless communication technology, the requirement for data rate is growing rapidly. Mobile communication system faces the problem of shortage of spectrum resources. Cognitive radio technology allows secondary users to use the frequencies authorized to the primary user with the permission of the primary user, which can effectively improve the utilization of spectrum resources. In this article, we establish a cognitive network model based on underlay model and propose a cognitive network resource allocation algorithm based on DDQN (Double Deep Q Network). The algorithm jointly optimizes the spectrum efficiency of the cognitive network and QoE (Quality of Experience) of cognitive users through channel selection and power control of the cognitive users. Simulation results show that proposed algorithm can effectively improve the spectral efficiency and QoE. Compared with Q-learning and DQN, this algorithm can converge faster and obtain higher spectral efficiency and QoE. The algorithm shows a more stable and efficient performance.
引用
收藏
页码:979 / 999
页数:21
相关论文
共 50 条
  • [21] Smart Jamming Attack and Mitigation on Deep Transfer Reinforcement Learning Enabled Resource Allocation for Network Slicing
    Salehi, Shavbo
    Zhou, Hao
    Elsayed, Medhat
    Bavand, Majid
    Gaigalas, Raimundas
    Ozcan, Yigit
    Erol-Kantarci, Melike
    arXiv,
  • [22] Resource allocation for network slicing in dynamic multi-tenant networks: A deep reinforcement learning approach
    Xie, Yanghao
    Kong, Yuyang
    Huang, Lin
    Wang, Sheng
    Xu, Shizhong
    Wang, Xiong
    Ren, Jing
    COMPUTER COMMUNICATIONS, 2022, 195 : 476 - 487
  • [23] Two-Tier Resource Allocation for Multitenant Network Slicing: A Federated Deep Reinforcement Learning Approach
    Ou, Ruijie
    Sun, Guolin
    Ayepah-Mensah, Daniel
    Boateng, Gordon Owusu
    Liu, Guisong
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (22) : 20174 - 20187
  • [24] CLARA: A Constrained Reinforcement Learning Based Resource Allocation Framework for Network Slicing
    Liu, Yongshuai
    Ding, Jiaxin
    Zhang, Zhi-Li
    Liu, Xin
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 1427 - 1437
  • [25] Network Resource Allocation Strategy Based on Deep Reinforcement Learning
    Zhang, Shidong
    Wang, Chao
    Zhang, Junsan
    Duan, Youxiang
    You, Xinhong
    Zhang, Peiying
    IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2020, 1 (01): : 86 - 94
  • [26] Intimacy-based Resource Allocation for Network Slicing in 5G via Deep Reinforcement Learning
    He, Nan
    Yang, Song
    Li, Fan
    Chen, Xu
    IEEE NETWORK, 2021, 35 (06): : 111 - 118
  • [27] Cognitive Radio Network Throughput Maximization with Deep Reinforcement Learning
    Ong, Kevin Shen Hoong
    Zhang, Yang
    Niyato, Dusit
    2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL), 2019,
  • [28] Reinforcement Learning Based Resource Management for Network Slicing
    Kim, Yohan
    Kim, Sunyong
    Lim, Hyuk
    APPLIED SCIENCES-BASEL, 2019, 9 (11):
  • [29] Supervised Learning Based Resource Allocation with Network Slicing
    Zhang, Tianxiang
    Bian, Yuxin
    Lu, Qianchun
    Qi, Jin
    Zhang, Kai
    Ji, Hong
    Wang, Wanyuan
    Wu, Weiwei
    2020 EIGHTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD 2020), 2020, : 25 - 30
  • [30] Intelligent Deep Reinforcement Learning based Resource Allocation in Fog network
    Divya, V
    Sri, Leena R.
    2019 26TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA AND ANALYTICS WORKSHOP (HIPCW 2019), 2019, : 18 - 22