Deep Reinforcement Learning-based Energy Efficiency Optimization For Flying LoRa Gateways

被引:0
|
作者
Jouhari, Mohammed [1 ]
Ibrahimi, Khalil [2 ]
Ben Othman, Jalel [3 ,4 ,5 ]
Amhoud, El Mehdi [1 ]
机构
[1] Mohammed VI Polytech Univ, Sch Comp Sci, Ben Guerir, Morocco
[2] Ibn Tofail Univ, Fac Sci, Lab Res Informat LaRI, Kenitra, Morocco
[3] Univ Paris Saclay, CNRS, Cent Supelec, Lab Signaux & Syst, Gif Sur Yvette, France
[4] Univ Sorbonne Paris North, Villetaneuse, France
[5] Zayed Univ, Coll Technol Innovat, Abu Dhabi, U Arab Emirates
关键词
LoRaWAN; Deep Reinforcement Learning; Energy Efficiency;
D O I
10.1109/ICC45041.2023.10279198
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
A resource-constrained unmanned aerial vehicle (UAV) can be used as a flying LoRa gateway (GW) to move inside the target area for efficient data collection and LoRa resource management. In this work, we propose deep reinforcement learning (DRL) to optimize the energy efficiency (EE) in wireless LoRa networks composed of LoRa end devices (EDs) and a flying GW to extend the network lifetime. The trained DRL agent can efficiently allocate the spreading factors (SFs) and transmission powers (TPs) to EDs while considering the air-to-ground wireless link and the availability of SFs. In addition, we allow the flying GW to adjust its optimal policy onboard and perform online resource allocation. This is accomplished through retraining the DRL agent using reduced action space. Simulation results demonstrate that our proposed DRL-based online resource allocation scheme can achieve higher EE in LoRa networks over three benchmark schemes.
引用
收藏
页码:6157 / 6162
页数:6
相关论文
共 50 条
  • [31] InTune: Reinforcement Learning-based Data Pipeline Optimization for Deep Recommendation Models
    Nagrecha, Kabir
    Liu, Lingyi
    Delgado, Pablo
    Padmanabhan, Prasanna
    PROCEEDINGS OF THE 17TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2023, 2023, : 430 - 442
  • [32] Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing
    Zhang, Hao
    Wu, Wenjun
    Wang, Chaoyi
    Li, Meng
    Yang, Ruizhe
    2019 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2019,
  • [33] On-policy learning-based deep reinforcement learning assessment for building control efficiency and stability
    Lee, Joon-Yong
    Rahman, Aowabin
    Huang, Sen
    Smith, Amanda D.
    Katipamula, Srinivas
    SCIENCE AND TECHNOLOGY FOR THE BUILT ENVIRONMENT, 2022, 28 (09) : 1150 - 1165
  • [34] DEEP REINFORCEMENT LEARNING-BASED IRRIGATION SCHEDULING
    Yang, Y.
    Hu, J.
    Porter, D.
    Marek, T.
    Heflin, K.
    Kong, H.
    Sun, L.
    TRANSACTIONS OF THE ASABE, 2020, 63 (03) : 549 - 556
  • [35] Reinforcement learning-based energy efficiency optimization for RIS-Assisted UAV hybrid uplink and downlink system
    Wang, Yi
    Deng, Yu
    Kang, Ling
    Jiang, Fang
    Jiang, Fulin
    COMPUTER NETWORKS, 2024, 245
  • [36] Reinforcement Learning-Based Resource Allocation and Energy Efficiency Optimization for a Space-Air-Ground-Integrated Network
    Chen, Zhiyu
    Zhou, Hongxi
    Du, Siyuan
    Liu, Jiayan
    Zhang, Luyang
    Liu, Qi
    ELECTRONICS, 2024, 13 (09)
  • [37] Coordinative energy efficiency improvement of buildings based on deep reinforcement learning
    Xu C.
    Li W.
    Rao Y.
    Qi B.
    Yang B.
    Wang Z.
    Cyber-Physical Systems, 2023, 9 (03) : 260 - 272
  • [38] Deep reinforcement learning-based multi-objective optimization for electricity–gas–heat integrated energy systems
    Li, Feng
    Liu, Lei
    Yu, Yang
    Expert Systems with Applications, 2025, 262
  • [39] Deep Learning-Based Sum Data Rate and Energy Efficiency Optimization for MIMO-NOMA Systems
    Huang, Hongji
    Yang, Yuchun
    Ding, Zhiguo
    Wang, Hong
    Sari, Hikmet
    Adachi, Fumiyuki
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (08) : 5373 - 5388
  • [40] Reward Mechanism Design for Deep Reinforcement Learning-Based Microgrid Energy Management
    Hu, Mingjie
    Han, Baohui
    Lv, Shilin
    Bao, Zhejing
    Lu, Lingxia
    Yu, Miao
    2023 6TH INTERNATIONAL CONFERENCE ON RENEWABLE ENERGY AND POWER ENGINEERING, REPE 2023, 2023, : 201 - 205