Network Resource Allocation Algorithm Using Reinforcement Learning Policy-Based Network in a Smart Grid Scenario

被引:2
|
作者
Zheng, Zhe [1 ]
Han, Yu [2 ]
Chi, Yingying [1 ]
Yuan, Fusheng [1 ]
Cui, Wenpeng [1 ]
Zhu, Hailong [3 ]
Zhang, Yi [4 ]
Zhang, Peiying [4 ]
机构
[1] Beijing Smartchip Microelect Technol Co Ltd, Beijing 100192, Peoples R China
[2] China Mobile Grp Shandong Co Ltd, Jinan 250001, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[4] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
关键词
smart grid; edge computing; resource allocation; multi-domain virtual network; reinforcement learning; EDGE; AREA;
D O I
10.3390/electronics12153330
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The exponential growth in user numbers has resulted in an overwhelming surge in data that the smart grid must process. To tackle this challenge, edge computing emerges as a vital solution. However, the current heuristic resource scheduling approaches often suffer from resource fragmentation and consequently get stuck in local optimum solutions. This paper introduces a novel network resource allocation method for multi-domain virtual networks with the support of edge computing. The approach entails modeling the edge network as a multi-domain virtual network model and formulating resource constraints specific to the edge computing network. Secondly, a policy network is constructed for reinforcement learning (RL) and an optimal resource allocation strategy is obtained under the premise of ensuring resource requirements. In the experimental section, our algorithm is compared with three other algorithms. The experimental results show that the algorithm has an average increase of 5.30%, 8.85%, 15.47% and 22.67% in long-term average revenue-cost ratio, virtual network request acceptance ratio, long-term average revenue and CPU resource utilization, respectively.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid
    Chi, Yingying
    Zhang, Yi
    Liu, Yong
    Zhu, Hailong
    Zheng, Zhe
    Liu, Rui
    Zhang, Peiying
    [J]. IEEE ACCESS, 2023, 11 : 6541 - 6550
  • [2] Resource Allocation of Smart Grid Virtual Communication Network based on Genetic Algorithm
    Zhu, Jiazheng
    Yu, Mingxing
    Tao, Xiumei
    Yu, Changle
    Zhang, Shuo
    [J]. 2019 34RD YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2019, : 232 - 237
  • [3] Policy-based resource provisioning in optical grid service network
    Zhu, YH
    Lin, RJ
    [J]. Current Trends in High Performance Computing and Its Applications, Proceedings, 2005, : 629 - 634
  • [4] Smart Grid Network Resource Scheduling Algorithm Based on Network Calculus
    Min, Wang
    Guo Jinghui
    Wei, Wang
    Shuang, Zhang
    [J]. INTEGRATED FERROELECTRICS, 2019, 199 (01) : 1 - 11
  • [5] Deep Reinforcement Learning-Based Smart Grid Resource Allocation System
    Lang, Qiong
    Zhu, La Ba Dun
    Ren, Mi Ma Ci
    Zhang, Rui
    Wu, Yinghen
    He, Wenting
    Li, Mingjia
    [J]. 2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 703 - 707
  • [6] Network Resource Allocation Strategy Based on Deep Reinforcement Learning
    Zhang, Shidong
    Wang, Chao
    Zhang, Junsan
    Duan, Youxiang
    You, Xinhong
    Zhang, Peiying
    [J]. IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2020, 1 : 86 - 94
  • [7] Using Distributed Reinforcement Learning for Resource Orchestration in a Network Slicing Scenario
    Mason, Federico
    Nencioni, Gianfranco
    Zanella, Andrea
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (01) : 88 - 102
  • [8] Resource Allocation Method for Network Slicing Using Constrained Reinforcement Learning
    Liu, Yongshuai
    Ding, Jiaxin
    Liu, Xin
    [J]. 2021 IFIP NETWORKING CONFERENCE AND WORKSHOPS (IFIP NETWORKING), 2021,
  • [9] Intelligent Deep Reinforcement Learning based Resource Allocation in Fog network
    Divya, V
    Sri, Leena R.
    [J]. 2019 26TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA AND ANALYTICS WORKSHOP (HIPCW 2019), 2019, : 18 - 22
  • [10] Constrained Reinforcement Learning for Resource Allocation in Network Slicing
    Xu, Yizhen
    Zhao, Zhengyang
    Cheng, Peng
    Chen, Zhuo
    Ding, Ming
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (05) : 1554 - 1558