Optimal energy management strategies for energy Internet via deep reinforcement learning approach

被引:195
|
作者
Hua, Haochen [1 ]
Qin, Yuchao [1 ]
Hao, Chuantong [1 ]
Cao, Junwei [1 ]
机构
[1] Tsinghua Univ, Res Inst Informat Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy Internet; Energy routers; Optimal control; Deep reinforcement learning; RENEWABLE ENERGY; MICROGRIDS; ALGORITHM; SYSTEM; OPTIMIZATION;
D O I
10.1016/j.apenergy.2019.01.145
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper investigates the energy management problem in the field of energy Internet (EI) with interdisciplinary techniques. The concept of EI has been proposed for a while. However, there still exist many fundamental and technical issues that have not been fully investigated. In this paper, a new energy regulation issue is considered based on the operational principles of EI. Multiple targets are considered along with constraints. Then, the practical energy management problem is formulated as a constrained optimal control problem. Notably, no explicit mathematical model for power of renewable power generation devices and loads is utilized. Due to the complexity of this problem, conventional methods appear to be inapplicable. To obtain the desired control scheme, a model-free deep reinforcement learning algorithm is applied. A practical solution is obtained, and the feasibility as well as the performance of the proposed method are evaluated with numerical simulations.
引用
收藏
页码:598 / 609
页数:12
相关论文
共 50 条
  • [1] Optimal energy management of energy hub: A reinforcement learning approach
    Yadollahi, Zahra
    Gharibi, Reza
    Dashti, Rahman
    Jahromi, Amin Torabi
    [J]. SUSTAINABLE CITIES AND SOCIETY, 2024, 102
  • [2] Indirect Multi-Energy Transactions of Energy Internet With Deep Reinforcement Learning Approach
    Yang, Lingxiao
    Sun, Qiuye
    Zhang, Ning
    Li, Yushuai
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (05) : 4067 - 4077
  • [3] Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid
    Foruzan, Elham
    Soh, Leen-Kiat
    Asgarpoor, Sohrab
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (05) : 5749 - 5758
  • [4] Deep Reinforcement Learning for Optimal Energy Management of Multi-energy Smart Grids
    Bousnina, Dhekra
    Guerassimoff, Gilles
    [J]. MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE (LOD 2021), PT II, 2022, 13164 : 15 - 30
  • [5] Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach
    Zhu, Jiaoyiling
    Hu, Weihao
    Xu, Xiao
    Liu, Haoming
    Pan, Li
    Fan, Haoyang
    Zhang, Zhenyuan
    Chen, Zhe
    [J]. RENEWABLE ENERGY, 2022, 201 : 792 - 801
  • [6] Optimal Energy Management of Energy Internet: A Distributed Actor-Critic Reinforcement Learning Method
    Cheng, Yijun
    Peng, Jun
    Gu, Xin
    Jiang, Fu
    Li, Heng
    Liu, Weirong
    Huang, Zhiwu
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 521 - 526
  • [7] Reactive Power Optimization for Transient Voltage Stability in Energy Internet via Deep Reinforcement Learning Approach
    Cao, Junwei
    Zhang, Wanlu
    Xiao, Zeqing
    Hua, Haochen
    [J]. ENERGIES, 2019, 12 (08)
  • [8] Optimal energy management in smart energy systems: A deep reinforcement learning approach and a digital twin case-study
    Bousnina, Dhekra
    Guerassimoff, Gilles
    [J]. Smart Energy, 2024, 16
  • [9] Energy Management System by Deep Reinforcement Learning Approach in a Building Microgrid
    Dini, Mohsen
    Ossart, Florence
    [J]. ELECTRIMACS 2022, VOL 2, 2024, 1164 : 257 - 269
  • [10] A Deep Reinforcement Learning Based Approach for Home Energy Management System
    Li, Hepeng
    Wan, Zhiqiang
    He, Haibo
    [J]. 2020 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2020,