Smart Grid Optimization by Deep Reinforcement Learning over Discrete and Continuous Action Space

被引:0
|
作者
Sogabe, Tomah [1 ,2 ,3 ]
Malla, Dinesh Bahadur [2 ]
Takayama, Shota [2 ]
Shin, Seiichi [1 ]
Sakamoto, Katsuyoshi [2 ]
Yamaguchi, Koichi [2 ]
Singh, Thakur Praveen [3 ]
Sogabe, Masaru [3 ]
Hirata, Tomohiro [4 ]
Okada, Yoshitaka [4 ]
机构
[1] Univ Electrocommun, Info Powered Energy Syst Res Ctr, Chofu, Tokyo 1828585, Japan
[2] Univ Electrocommun, Dept Engn Sci, Chofu, Tokyo 1828585, Japan
[3] Grid Inc, Technol Solut Grp, Minato Ku, Tokyo 1070061, Japan
[4] Univ Tokyo, Res Ctr Adv Sci & Technol, Tokyo 1538904, Japan
关键词
D O I
暂无
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Energy optimization in smart grid has gradually shifted to agent-based machine learning method represented by the state of art deep learning and deep reinforcement learning. Especially deep neural network based reinforcement learning methods are emerging and gain popularity to for smart grid application. In this work, we have applied the applied two deep reinforcement learning algorithms designed for both discrete and continuous action space. These algorithms were well embedded in a rigorous physical model using Simscape Power SystemsTM (Matlab/Simulink (TM) Environment) for smart grid optimization. The results showed that the agent successfully captured the energy demand and supply feature in the training data and learnt to choose behavior leading to maximize its reward.
引用
收藏
页码:3794 / 3796
页数:3
相关论文
共 50 条
  • [1] Mixed Deep Reinforcement Learning Considering Discrete-continuous Hybrid Action Space for Smart Home Energy Management
    Chao Huang
    Hongcai Zhang
    Long Wang
    Xiong Luo
    Yonghua Song
    Journal of Modern Power Systems and Clean Energy, 2022, (03) : 743 - 754
  • [2] Mixed Deep Reinforcement Learning Considering Discrete-continuous Hybrid Action Space for Smart Home Energy Management
    Huang, Chao
    Zhang, Hongcai
    Wang, Long
    Luo, Xiong
    Song, Yonghua
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2022, 10 (03) : 743 - 754
  • [3] Soft Action Particle Deep Reinforcement Learning for a Continuous Action Space
    Kang, Minjae
    Lee, Kyungjae
    Oh, Songhwai
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 5028 - 5033
  • [4] Deep Reinforcement Learning for Discrete and Continuous Massive Access Control Optimization
    Jiang, Nan
    Deng, Yansha
    Nallanathan, Arumugam
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [5] Algorithmic trading using continuous action space deep reinforcement learning
    Majidi, Naseh
    Shamsi, Mahdi
    Marvasti, Farokh
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 235
  • [6] Deep reinforcement learning in continuous action space for autonomous robotic surgery
    Shahkoo, Amin Abbasi
    Abin, Ahmad Ali
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2023, 18 (03) : 423 - 431
  • [7] Deep reinforcement learning in continuous action space for autonomous robotic surgery
    Amin Abbasi Shahkoo
    Ahmad Ali Abin
    International Journal of Computer Assisted Radiology and Surgery, 2023, 18 : 423 - 431
  • [8] Obstacle Avoidance for UAS in Continuous Action Space Using Deep Reinforcement Learning
    Hu, Jueming
    Yang, Xuxi
    Wang, Weichang
    Wei, Peng
    Ying, Lei
    Liu, Yongming
    IEEE ACCESS, 2022, 10 : 90623 - 90634
  • [9] Adversarial Attacks on Multiagent Deep Reinforcement Learning Models in Continuous Action Space
    Zhou, Ziyuan
    Liu, Guanjun
    Guo, Weiran
    Zhou, MengChu
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024,
  • [10] Active Exploration Deep Reinforcement Learning for Continuous Action Space with Forward Prediction
    Zhao, Dongfang
    Huanshi, Xu
    Xun, Zhang
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2024, 17 (01)