Convolutional Neural Network-Based Deep Q-Network (CNN-DQN) Resource Management in Cloud Radio Access Network

被引:6
|
作者
Iqbal, Amjad [1 ]
Tham, Mau-Luen [1 ]
Chang, Yoong Choon [1 ]
机构
[1] Univ Tunku Abdul Rahman UTAR, Lee Kong Chian Fac Engn & Sci, Dept Elect & Elect Engn, Petaling Jaya, Malaysia
关键词
energy efficiency (EE); markov decision process (MDP); convolutional neural network (CNN); cloud RAN; deep Q-network (DQN); ALLOCATION; ENERGY;
D O I
10.23919/JCC.2022.00.025
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
The recent surge of mobile subscribers and user data traffic has accelerated the telecommunication sector towards the adoption of the fifth-generation (5G) mobile networks. Cloud radio access network (CRAN) is a prominent framework in the 5G mobile network to meet the above requirements by deploying low-cost and intelligent multiple distributed antennas known as remote radio heads (RRHs). However, achieving the optimal resource allocation (RA) in CRAN using the traditional approach is still challenging due to the complex structure. In this paper, we introduce the convolutional neural network-based deep Q-network (CNN-DQN) to balance the energy consumption and guarantee the user quality of service (QoS) demand in downlink CRAN. We first formulate the Markov decision process (MDP) for energy efficiency (EE) and build up a 3-layer CNN to capture the environment feature as an input state space. We then use DQN to turn on/off the RRHs dynamically based on the user QoS demand and energy consumption in the CRAN. Finally, we solve the RA problem based on the user constraint and transmit power to guarantee the user QoS demand and maximize the EE with a minimum number of active RRHs. In the end, we conduct the simulation to compare our proposed scheme with nature DQN and the traditional approach.
引用
收藏
页码:129 / 142
页数:14
相关论文
共 50 条
  • [1] Convolutional Neural Network-Based Deep Q-Network(CNN-DQN) Resource Management in Cloud Radio Access Network
    Amjad Iqbal
    Mau-Luen Tham
    Yoong Choon Chang
    China Communications, 2022, 19 (10) : 129 - 142
  • [2] Dynamic spectrum access based on double deep Q-network and convolution neural network
    Fang, Guangjin
    Shen, Bin
    Zhang, Hong
    Cui, Taiping
    2022 24TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT): ARITIFLCIAL INTELLIGENCE TECHNOLOGIES TOWARD CYBERSECURITY, 2022, : 112 - +
  • [3] Manufacturing Resource Scheduling Based on Deep Q-Network
    ZHANG Yufei
    ZOU Yuanhao
    ZHAO Xiaodong
    Wuhan University Journal of Natural Sciences, 2022, 27 (06) : 531 - 538
  • [4] Double Deep Q-Network-Based Energy-Efficient Resource Allocation in Cloud Radio Access Network
    Iqbal, Amjad
    Tham, Mau-Luen
    Chang, Yoong Choon
    IEEE ACCESS, 2021, 9 : 20440 - 20449
  • [5] Tuning Apex DQN: A Reinforcement Learning based Deep Q-Network Algorithm
    Ruhela, Dhani
    Ruhela, Amit
    PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2024, PEARC 2024, 2024,
  • [6] The optimal dispatching strategy of cogeneration based on Deep Q-Network (DQN) algorithm
    Zhang, Pei
    Fu, Yan
    Yao, Fu
    Science and Technology for Energy Transition (STET), 2024, 79
  • [7] A Graph Convolutional Network-Based Deep Reinforcement Learning Approach for Resource Allocation in a Cognitive Radio Network
    Zhao, Di
    Qin, Hao
    Song, Bin
    Han, Beichen
    Du, Xiaojiang
    Guizani, Mohsen
    SENSORS, 2020, 20 (18) : 1 - 23
  • [8] Application of Deep Q-Network in Portfolio Management
    Gao, Ziming
    Gao, Yuan
    Hu, Yi
    Jiang, Zhengyong
    Su, Jionglong
    2020 5TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (IEEE ICBDA 2020), 2020, : 268 - 275
  • [9] Deep Convolutional Neural Network-Based Approaches for Face Recognition
    Almabdy, Soad
    Elrefaei, Lamiaa
    APPLIED SCIENCES-BASEL, 2019, 9 (20):
  • [10] Deep Convolutional Neural Network-Based Detector for Index Modulation
    Wang, Tengjiao
    Yang, Fang
    Song, Jian
    Han, Zhu
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (10) : 1705 - 1709