Deep Reinforcement Learning-based Energy Efficiency Optimization For Flying LoRa Gateways

被引:0
|
作者
Jouhari, Mohammed [1 ]
Ibrahimi, Khalil [2 ]
Ben Othman, Jalel [3 ,4 ,5 ]
Amhoud, El Mehdi [1 ]
机构
[1] Mohammed VI Polytech Univ, Sch Comp Sci, Ben Guerir, Morocco
[2] Ibn Tofail Univ, Fac Sci, Lab Res Informat LaRI, Kenitra, Morocco
[3] Univ Paris Saclay, CNRS, Cent Supelec, Lab Signaux & Syst, Gif Sur Yvette, France
[4] Univ Sorbonne Paris North, Villetaneuse, France
[5] Zayed Univ, Coll Technol Innovat, Abu Dhabi, U Arab Emirates
关键词
LoRaWAN; Deep Reinforcement Learning; Energy Efficiency;
D O I
10.1109/ICC45041.2023.10279198
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
A resource-constrained unmanned aerial vehicle (UAV) can be used as a flying LoRa gateway (GW) to move inside the target area for efficient data collection and LoRa resource management. In this work, we propose deep reinforcement learning (DRL) to optimize the energy efficiency (EE) in wireless LoRa networks composed of LoRa end devices (EDs) and a flying GW to extend the network lifetime. The trained DRL agent can efficiently allocate the spreading factors (SFs) and transmission powers (TPs) to EDs while considering the air-to-ground wireless link and the availability of SFs. In addition, we allow the flying GW to adjust its optimal policy onboard and perform online resource allocation. This is accomplished through retraining the DRL agent using reduced action space. Simulation results demonstrate that our proposed DRL-based online resource allocation scheme can achieve higher EE in LoRa networks over three benchmark schemes.
引用
收藏
页码:6157 / 6162
页数:6
相关论文
共 50 条
  • [41] Deep Reinforcement Learning-Based Demand Response for Smart Facilities Energy Management
    Lu, Renzhi
    Bai, Ruichang
    Luo, Zhe
    Jiang, Junhui
    Sun, Mingyang
    Zhang, Hai-Tao
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (08) : 8554 - 8565
  • [42] Multiagent Reinforcement Learning with an Attention Mechanism for Improving Energy Efficiency in LoRa Networks
    Zhang, Xu
    Lin, Ziqi
    Gong, Shimin
    Gu, Bo
    Niyato, Dusit
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 4152 - 4157
  • [43] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45
  • [44] LoRa-RL: Deep Reinforcement Learning for Resource Management in Hybrid Energy LoRa Wireless Networks
    Hamdi, Rami
    Baccour, Emna
    Erbad, Aiman
    Qaraqe, Marwa
    Hamdi, Mounir
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (09) : 6458 - 6476
  • [45] A multi-agent federated reinforcement learning-based optimization of quality of service in various LoRa network slices
    Ossongo, Eric
    Esseghir, Moez
    Merghem-Boulahia, Leila
    COMPUTER COMMUNICATIONS, 2024, 213 : 320 - 330
  • [46] A multi-agent federated reinforcement learning-based optimization of quality of service in various LoRa network slices
    Ossongo, Eric
    Esseghir, Moez
    Merghem-Boulahia, Leila
    Computer Communications, 2024, 213 : 320 - 330
  • [47] Energy Storage Scheduling Optimization Strategy Based on Deep Reinforcement Learning
    Hou, Shixi
    Han, Jienan
    Liu, Xiangjiang
    Guo, Ruoshan
    Chu, Yundi
    ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 33 - 44
  • [48] Optimization Strategy Based on Deep Reinforcement Learning for Home Energy Management
    Liu, Yuankun
    Zhang, Dongxia
    Gooi, Hoay Beng
    CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2020, 6 (03): : 572 - 582
  • [49] Reinforcement learning-based optimization for power scheduling in a renewable energy connected grid
    Ebrie, Awol Seid
    Kim, Young Jin
    RENEWABLE ENERGY, 2024, 230
  • [50] Optimizing Energy Efficiency in Vehicular Edge-Cloud Networks Through Deep Reinforcement Learning-Based Computation Offloading
    Elgendy, Ibrahim A.
    Muthanna, Ammar
    Alshahrani, Abdullah
    Hassan, Dina S. M.
    Alkanhel, Reem
    Elkawkagy, Mohamed
    IEEE Access, 2024, 12 : 191537 - 191550