Deep reinforcement learning assisted edge-terminal collaborative offloading algorithm of blockchain computing tasks for energy Internet

被引:16
|
作者
Xu, Siya [1 ]
Liao, Boxian [1 ]
Yang, Chao [2 ]
Guo, Shaoyong [1 ]
Hu, Bo [3 ]
Zhao, Jinghong [2 ]
Jin, Lei [2 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] State Grid Liaoning Elect Power Co Ltd, Informat & Commun Branch, Shenyang, Liaoning, Peoples R China
[3] State Grid Liaoning Elect Power Supply Co Ltd, Shenyang, Liaoning, Peoples R China
关键词
Blockchain; Edge-terminal collaboration; Task offloading; Deep reinforcement learning; RESOURCE-ALLOCATION; SYSTEMS;
D O I
10.1016/j.ijepes.2021.107022
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the regional distribution network, microgrid is often used to build local energy system to realize regional autonomy in the process of power generation, transmission, and consumption. Applying blockchain technology in microgrid can meet the needs of security and privacy in energy transactions, and can conduct secure point-topoint transactions between anonymous entities. However, blockchain nodes will generate numerous computingintensive tasks in the process of mining, and cause high delay in energy transaction. Therefore, we take advantage of mobile edge computing (MEC) technology and propose an edge-terminal collaborative mining task processing framework to increase the computing ability of the blockchain system. This framework includes three working modes: local computing, user collaboration and edge node collaboration. Particularly, the trust value of collaborative user nodes is considered to avoid security threats caused by malicious nodes. Furthermore, we establish a delay-and-throughput-based blockchain computing task offloading model, and use asynchronous advantage actor-critic (A3C) algorithm to jointly optimize offloading decision, transmission power allocation, block interval and size configuration. Simulation results show that, compared with Only-MEC and FixedBlockSize algorithms, the proposed algorithm can reduce the average delay by 1.7% and 2.5%, and improve the average transaction throughput by 12.1% and 28.5% respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Distributed Edge Computing Offloading Algorithm Based on Deep Reinforcement Learning
    Li, Yunzhao
    Qi, Feng
    Wang, Zhili
    Yu, Xiuming
    Shao, Sujie
    [J]. IEEE ACCESS, 2020, 8 : 85204 - 85215
  • [2] Mobile edge computing task distribution and offloading algorithm based on deep reinforcement learning in internet of vehicles
    Wang, Jianxi
    Wang, Liutao
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021,
  • [3] An Energy-Efficient Dynamic Offloading Algorithm for Edge Computing Based on Deep Reinforcement Learning
    Zhu, Keyu
    Li, Shaobo
    Zhang, Xingxing
    Wang, Jinming
    Xie, Cankun
    Wu, Fengbin
    Xie, Rongxiang
    [J]. IEEE ACCESS, 2024, 12 : 127489 - 127506
  • [4] Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT
    Hu, Jiangyi
    Li, Yang
    Zhao, Gaofeng
    Xu, Bo
    Ni, Yiyang
    Zhao, Haitao
    [J]. IEEE ACCESS, 2021, 9 : 93892 - 93901
  • [5] Associative tasks computing offloading scheme in Internet of medical things with deep reinforcement learning
    Fan, Jiang
    Junwei, Qin
    Lei, Liu
    Hui, Tian
    [J]. CHINA COMMUNICATIONS, 2024, 21 (04) : 38 - 52
  • [6] Associative Tasks Computing Offloading Scheme in Internet of Medical Things with Deep Reinforcement Learning
    Jiang Fan
    Qin Junwei
    Liu Lei
    Tian Hui
    [J]. China Communications, 2024, 21 (04) : 38 - 52
  • [7] A Clustering Offloading Decision Method for Edge Computing Tasks Based on Deep Reinforcement Learning
    Zhen Zhang
    Huanzhou Li
    Zhangguo Tang
    Dinglin Gu
    Jian Zhang
    [J]. New Generation Computing, 2023, 41 : 85 - 108
  • [8] A Clustering Offloading Decision Method for Edge Computing Tasks Based on Deep Reinforcement Learning
    Zhang, Zhen
    Li, Huanzhou
    Tang, Zhangguo
    Gu, Dinglin
    Zhang, Jian
    [J]. NEW GENERATION COMPUTING, 2023, 41 (01) : 85 - 108
  • [9] Edge Computing Task Offloading Optimization for a UAV-Assisted Internet of Vehicles via Deep Reinforcement Learning
    Yan, Ming
    Xiong, Rui
    Wang, Yan
    Li, Chunguo
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5647 - 5658
  • [10] Deep reinforcement learning based offloading decision algorithm for vehicular edge computing
    Hu, Xi
    Huang, Yang
    [J]. PEERJ COMPUTER SCIENCE, 2022, 8