Deep reinforcement learning assisted edge-terminal collaborative offloading algorithm of blockchain computing tasks for energy Internet

被引:16
|
作者
Xu, Siya [1 ]
Liao, Boxian [1 ]
Yang, Chao [2 ]
Guo, Shaoyong [1 ]
Hu, Bo [3 ]
Zhao, Jinghong [2 ]
Jin, Lei [2 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] State Grid Liaoning Elect Power Co Ltd, Informat & Commun Branch, Shenyang, Liaoning, Peoples R China
[3] State Grid Liaoning Elect Power Supply Co Ltd, Shenyang, Liaoning, Peoples R China
关键词
Blockchain; Edge-terminal collaboration; Task offloading; Deep reinforcement learning; RESOURCE-ALLOCATION; SYSTEMS;
D O I
10.1016/j.ijepes.2021.107022
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the regional distribution network, microgrid is often used to build local energy system to realize regional autonomy in the process of power generation, transmission, and consumption. Applying blockchain technology in microgrid can meet the needs of security and privacy in energy transactions, and can conduct secure point-topoint transactions between anonymous entities. However, blockchain nodes will generate numerous computingintensive tasks in the process of mining, and cause high delay in energy transaction. Therefore, we take advantage of mobile edge computing (MEC) technology and propose an edge-terminal collaborative mining task processing framework to increase the computing ability of the blockchain system. This framework includes three working modes: local computing, user collaboration and edge node collaboration. Particularly, the trust value of collaborative user nodes is considered to avoid security threats caused by malicious nodes. Furthermore, we establish a delay-and-throughput-based blockchain computing task offloading model, and use asynchronous advantage actor-critic (A3C) algorithm to jointly optimize offloading decision, transmission power allocation, block interval and size configuration. Simulation results show that, compared with Only-MEC and FixedBlockSize algorithms, the proposed algorithm can reduce the average delay by 1.7% and 2.5%, and improve the average transaction throughput by 12.1% and 28.5% respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Computation offloading Optimization in Edge Computing based on Deep Reinforcement Learning
    Zhu Qinghua
    Chang Ying
    Zhao Jingya
    Liu Yong
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1552 - 1558
  • [42] Deep Reinforcement Learning for Offloading and Shunting in Hybrid Edge Computing Network
    Zhang, Jiadong
    Shi, Wenxiao
    Zhang, Ruidong
    Liu, Sicheng
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,
  • [43] Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things
    Lu, Haodong
    He, Xiaoming
    Du, Miao
    Ruan, Xiukai
    Sun, Yanfei
    Wang, Kun
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10): : 9255 - 9265
  • [44] Deep reinforcement learning for computation offloading in mobile edge computing environment
    Chen, Miaojiang
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    [J]. COMPUTER COMMUNICATIONS, 2021, 175 (175) : 1 - 12
  • [45] Deep Reinforcement Learning for Vehicular Edge Computing: An Intelligent Offloading System
    Ning, Zhaolong
    Dong, Peiran
    Wang, Xiaojie
    Rodrigues, Joel J. P. C.
    Xia, Feng
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (06)
  • [46] Binary Computation Offloading in Edge Computing Using Deep Reinforcement Learning
    Rajwar, Dipankar
    Kumar, Dinesh
    [J]. ADVANCED NETWORK TECHNOLOGIES AND INTELLIGENT COMPUTING, ANTIC 2023, PT II, 2024, 2091 : 215 - 227
  • [47] Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing
    Zhou, Huan
    Jiang, Kai
    Liu, Xuxun
    Li, Xiuhua
    Leung, Victor C. M.
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (02): : 1517 - 1530
  • [48] NOMA-Assisted Secure Offloading for Vehicular Edge Computing Networks With Asynchronous Deep Reinforcement Learning
    Ju, Ying
    Cao, Zhiwei
    Chen, Yuchao
    Liu, Lei
    Pei, Qingqi
    Mumtaz, Shahid
    Dong, Mianxiong
    Guizani, Mohsen
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (03) : 2627 - 2640
  • [49] Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning
    Qi, Huamei
    Zhou, Zheng
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [50] Blockchain Sharding Strategy for Collaborative Computing Internet of Things Combining Dynamic Clustering and Deep Reinforcement Learning
    Yang, Zhaoxin
    Li, Meng
    Yang, Ruizhe
    Yu, F. Richard
    Zhang, Yanhua
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 2786 - 2791