Deep Reinforcement Learning Based Resource Allocation for Fault Detection with Cloud Edge Collaboration in Smart Grid

被引:4
|
作者
Li, Qiyue [1 ,4 ]
Zhu, Yadong [2 ,4 ]
Ding, Jinjin [5 ]
Li, Weitao [3 ,4 ]
Sun, Wei [3 ,4 ]
Ding, Lijian [3 ]
机构
[1] Hefei Univ Technol, Sch Elect Engn & Automat, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Control Engn, Hefei 230009, Anhui, Peoples R China
[3] Hefei Univ Technol, Hefei 230009, Peoples R China
[4] Engn Technol Res Ctr Ind Automat, Hefei 230009, Peoples R China
[5] State Grid Anhui Elect Power Co Ltd, Elect Power Res Inst, Hefei 230000, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Delays; Fault detection; Cloud computing; Smart grids; Resource management; Real-time systems; Image edge detection; Cloud-edge collaboration; communication delay; deep reinforcement learning; fault detection; smart grid; NETWORKS;
D O I
10.17775/CSEEJPES.2021.02390
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Real-time fault detection is important for operation of smart grid. It has become a trend of future development to design an anomaly detection system based on deep learning by using the powerful computing power of the cloud. However, delay of Internet transmission is large, which may make the delay time of detection and transmission go beyond the limits. However, the edge-based scheme may not be able to undertake all data detection tasks due to limited computing resources of edge devices. Therefore, we propose a cloud-edge collaborative smart grid fault detection system, next to which edge devices are placed, and equipped with a lightweight neural network with different precision for fault detection. In addition, a sub-optimal and real-time communication and computing resource allocation method is proposed based on deep reinforcement learning. This method greatly speeds up solution time, which can meet the requirements of data transmission delay, maximize the system throughput, and improve communication efficiency. Simulation results show the scheme is superior in transmission delay and improves real-time performance of the smart grid detection system.
引用
收藏
页码:1220 / 1230
页数:11
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid
    Chi, Yingying
    Zhang, Yi
    Liu, Yong
    Zhu, Hailong
    Zheng, Zhe
    Liu, Rui
    Zhang, Peiying
    [J]. IEEE ACCESS, 2023, 11 : 6541 - 6550
  • [2] Resource Orchestration of Cloud-Edge-based Smart Grid Fault Detection
    Li, Jie
    Deng, Yuxing
    Sun, Wei
    Li, Weitao
    Li, Ruidong
    Li, Qiyue
    Liu, Zhi
    [J]. ACM TRANSACTIONS ON SENSOR NETWORKS, 2022, 18 (03)
  • [3] Deep Reinforcement Learning-Based Smart Grid Resource Allocation System
    Lang, Qiong
    Zhu, La Ba Dun
    Ren, Mi Ma Ci
    Zhang, Rui
    Wu, Yinghen
    He, Wenting
    Li, Mingjia
    [J]. 2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 703 - 707
  • [4] Deep reinforcement learning based resource allocation in edge-cloud gaming
    Iryanto Jaya
    Yusen Li
    Wentong Cai
    [J]. Multimedia Tools and Applications, 2024, 83 (26) : 67903 - 67926
  • [5] Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System
    Xu, Jianqiao
    Xu, Zhuohan
    Shi, Bing
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [6] Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System
    Xu, Zhuohan
    Zhong, Zeheng
    Shi, Bing
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing
    Deng, Xiaoheng
    Zhang, Jingjing
    Zhang, Honggang
    Jiang, Ping
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (06) : 5364 - 5377
  • [8] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Wang, Jiadai
    Zhao, Lei
    Liu, Jiajia
    Kato, Nei
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (03) : 1529 - 1541
  • [9] Joint Computation Offloading and Resource Allocation for Edge-Cloud Collaboration in Internet of Vehicles via Deep Reinforcement Learning
    Huang, Jiwei
    Wan, Jiangyuan
    Lv, Bofeng
    Ye, Qiang
    Chen, Ying
    [J]. IEEE SYSTEMS JOURNAL, 2023, 17 (02): : 2500 - 2511
  • [10] A Reinforcement Learning based Edge Cloud Collaboration
    Kobari, Hiroki
    Du, Zhaoyang
    Wu, Celimuge
    Yoshinaga, Tsutomu
    Bao, Wugedele
    [J]. 2021 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES FOR DISASTER MANAGEMENT (ICT-DM), 2021, : 26 - 29