Power Allocation Based on Reinforcement Learning for MIMO System With Energy Harvesting

被引:11
|
作者
Mu, Xingchi [1 ]
Zhao, Xiaohui [1 ]
Liang, Hui [1 ]
机构
[1] Jilin Univ, Coll Commun Engn, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Resource management; MIMO communication; Wireless communication; Approximation algorithms; Energy harvesting; Transmitters; Batteries; Power allocation; throughout maximization; reinforcement learning; energy harvesting; multiple-input multiple-output; MASSIVE MIMO; TRANSMISSION; WIRELESS; NETWORKS; SECURITY;
D O I
10.1109/TVT.2020.2993275
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on the use of a reinforcement learning (RL) approach to find two online power allocation policies in a point to point EH-MIMO wireless communication system. In our study, we train the power allocation policies in order to learn the map between the environment and the agent. Particularly, in order to avoid "dimension disaster" problem which may happen in our proposed SARSA power allocation policy, we introduce a linear approximation method to get an approximate SARSA power allocation policy. The linear approximation can handle infinite number of states and trade-off between complexity and performance of power allocation is significantly improved. The simulation results show that the proposed SARSA and approximate SARSA power allocation policies have a considerable throughput increase compared with the benchmark policies, such as greedy, random and conservative policies.
引用
收藏
页码:7622 / 7633
页数:12
相关论文
共 50 条
  • [1] Reinforcement Learning in MIMO Wireless Networks with Energy Harvesting
    Ayatollahi, Hoda
    Tapparello, Cristiano
    Heinzelman, Wendi
    2017 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2017,
  • [2] Power Control in Energy Harvesting Multiple Access System with Reinforcement Learning
    Chu, Man
    Liao, Xuewen
    Li, Hang
    Cui, Shuguang
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [3] Power Control in Energy Harvesting Multiple Access System With Reinforcement Learning
    Chu, Man
    Liao, Xuewen
    Li, Hang
    Cui, Shuguang
    IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (05) : 9175 - 9186
  • [4] Reinforcement Learning for Energy Harvesting in Spatial Modulated MIMO Systems
    Renjith, R. J.
    UmaMaheswari, M.
    Nithya, N.
    Velmurugan, P. G. S.
    PROCEEDINGS OF 2019 1ST INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION AND COMMUNICATION TECHNOLOGY (ICIICT 2019), 2019,
  • [5] Reinforcement Learning-based Energy-Efficient Power Allocation for Underwater Full-Duplex Relay Network with Energy Harvesting
    Wang, Ranning
    Makled, Esraa A.
    Yadav, Animesh
    Dobre, Octavia A.
    Zhao, Ruiqin
    2020 IEEE 92ND VEHICULAR TECHNOLOGY CONFERENCE (VTC2020-FALL), 2020,
  • [6] Optimal Power Allocation for CR MIMO Energy Harvesting Coexisting Systems
    He, Peter
    Zhao, Lian
    2015 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2015,
  • [7] Deep Reinforcement Learning for Task Allocation in Energy Harvesting Mobile Crowdsensing
    Dongare, Sumedh
    Ortiz, Andrea
    Klein, Anja
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 269 - 274
  • [8] OPTIMAL POWER ALLOCATION FOR AN ENERGY HARVESTING ESTIMATION SYSTEM
    Zhao, Yu
    Chen, Biao
    Zhang, Rui
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 4549 - 4553
  • [9] Power allocation algorithm for a cooperative MIMO system based on minimum energy consumption
    Meng, W. (wxmeng@hit.edu.cn), 1600, Editorial Board of Journal of Harbin Engineering (33):
  • [10] Online Learning Schemes for Power Allocation in Energy Harvesting Communications
    Sakulkar, Pranav
    Krishnamachari, Bhaskar
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (06) : 4610 - 4628