Deep Reinforcement Learning-based Energy Efficiency Optimization For Flying LoRa Gateways

被引:0
|
作者
Jouhari, Mohammed [1 ]
Ibrahimi, Khalil [2 ]
Ben Othman, Jalel [3 ,4 ,5 ]
Amhoud, El Mehdi [1 ]
机构
[1] Mohammed VI Polytech Univ, Sch Comp Sci, Ben Guerir, Morocco
[2] Ibn Tofail Univ, Fac Sci, Lab Res Informat LaRI, Kenitra, Morocco
[3] Univ Paris Saclay, CNRS, Cent Supelec, Lab Signaux & Syst, Gif Sur Yvette, France
[4] Univ Sorbonne Paris North, Villetaneuse, France
[5] Zayed Univ, Coll Technol Innovat, Abu Dhabi, U Arab Emirates
关键词
LoRaWAN; Deep Reinforcement Learning; Energy Efficiency;
D O I
10.1109/ICC45041.2023.10279198
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
A resource-constrained unmanned aerial vehicle (UAV) can be used as a flying LoRa gateway (GW) to move inside the target area for efficient data collection and LoRa resource management. In this work, we propose deep reinforcement learning (DRL) to optimize the energy efficiency (EE) in wireless LoRa networks composed of LoRa end devices (EDs) and a flying GW to extend the network lifetime. The trained DRL agent can efficiently allocate the spreading factors (SFs) and transmission powers (TPs) to EDs while considering the air-to-ground wireless link and the availability of SFs. In addition, we allow the flying GW to adjust its optimal policy onboard and perform online resource allocation. This is accomplished through retraining the DRL agent using reduced action space. Simulation results demonstrate that our proposed DRL-based online resource allocation scheme can achieve higher EE in LoRa networks over three benchmark schemes.
引用
收藏
页码:6157 / 6162
页数:6
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-Based Vehicle Energy Efficiency Autonomous Learning System
    Qi, Xuewei
    Luo, Yadan
    Wu, Guoyuan
    Boriboonsomsin, Kanok
    Barth, Matthew J.
    2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 1228 - 1233
  • [2] Optimization of LoRa SF Allocation Based on Deep Reinforcement Learning
    Zhong, Han
    Ning, Lei
    Wang, Junsong
    Suo, Siliang
    Chen, Liming
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [3] Energy Efficiency Optimization in Heterogeneous Networks Based on Deep Reinforcement Learning
    Shi, Daoping
    Tian, Feng
    Wu, Shengchen
    2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [4] Energy Efficiency Optimization in LoRa Networks-A Deep Learning Approach
    Tu, Lam-Thanh
    Bradai, Abbas
    Ben Ahmed, Olfa
    Garg, Sahil
    Pousset, Yannis
    Kaddoum, Georges
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (12) : 15435 - 15447
  • [5] A Deep Reinforcement Learning-based Task Scheduling Algorithm for Energy Efficiency in Data Centers
    Song, Penglei
    Chi, Ce
    Ji, Kaixuan
    Liu, Zhiyong
    Zhang, Fa
    Zhang, Shikui
    Qiu, Dehui
    Wan, Xiaohua
    30TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN 2021), 2021,
  • [6] Deep Reinforcement Learning for Energy Efficiency Optimization in Wireless Networks
    Fan, Haoren
    Zhu, Lei
    Yao, Changhua
    Guo, Jibin
    Lu, Xiaowen
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2019, : 465 - 471
  • [7] A Deep Reinforcement Learning-Based Geographic Packet Routing Optimization
    Bai, Yijie
    Zhang, Xia
    Yu, Daojie
    Li, Shengxiang
    Wang, Yu
    Lei, Shuntian
    Tian, Zhoutai
    IEEE ACCESS, 2022, 10 : 108785 - 108796
  • [8] Deep Reinforcement Learning-Based Optimization Method for D2D Communication Energy Efficiency in Heterogeneous Cellular Networks
    Pan, Ziyu
    Yang, Jie
    IEEE Access, 2024, 12 : 140439 - 140455
  • [9] Reinforcement Learning-Based BEMS Architecture for Energy Usage Optimization
    Park, Sanguk
    Park, Sangmin
    Choi, Myeong-in
    Lee, Sanghoon
    Lee, Tacklim
    Kim, Seunghwan
    Cho, Keonhee
    Park, Sehyun
    SENSORS, 2020, 20 (17) : 1 - 33
  • [10] Deep reinforcement learning-based optimization strategy for the cooperative scheduling of harvesters
    Li, Zikang
    Zhang, Fan
    Teng, Guifa
    Li, Zheng
    Wang, Ziyi
    Ma, Shiji
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 40 (14): : 23 - 32