Multi-UAV Reinforcement Learning for Data Collection in Cellular MIMO Networks

被引:0
|
作者
Diaz-Vilor, Carles [1 ]
Abdelhady, Amr M. [2 ]
Eltawil, Ahmed M. [2 ]
Jafarkhani, Hamid [1 ]
机构
[1] University of California at Irvine, Center for Pervasive Communications and Computing, Irvine,CA,92697, United States
[2] King Abdullah University of Science and Technology, Computer Electrical, and Mathematical Science and Engineering Division, Thuwal,23955, Saudi Arabia
关键词
Antennas - Data acquisition - Internet of things - Learning algorithms - MIMO systems - Trajectories - Unmanned aerial vehicles (UAV);
D O I
10.1109/TWC.2024.3430228
中图分类号
学科分类号
摘要
Uncrewed Aerial Vehicles (UAVs) provide a compelling solution for data collection in Internet of Things (IoT) networks due to their mobility and adaptability. However, the line-of-sight dominance in their channels may result in severe interference to ground users during UAV operations. To address this, we present an optimization framework that concurrently optimizes UAV trajectories and transmit powers. Our approach efficiently results in the collection of data from a variety of IoT sensors while (a) minimizing the UAVs flying time and (b) mitigating interference with terrestrial networks. Given the complex nature of such an optimization problem, this paper leverages reinforcement learning, specifically the twin delayed deep deterministic policy gradient algorithm, where a distributed learning algorithm is presented. Experimental results validate the efficacy of our proposed approach, demonstrating its capability to significantly enhance data collection in IoT networks while minimizing UAV flight time and interference with ground user links. © 2024 The Authors.
引用
收藏
页码:15462 / 15476
相关论文
共 50 条
  • [21] Resource Allocation in High Dynamic Multi-UAV Networks for Coverage Continuity: A Reinforcement Learning Approach
    Zhou, Chengyi
    Li, Jiandong
    Liu, Junyu
    Sheng, Min
    Zhao, Nan
    2023 INTERNATIONAL CONFERENCE ON FUTURE COMMUNICATIONS AND NETWORKS, FCN, 2023,
  • [22] PPOSWC: Deep Reinforcement Learning Recharging Scheduling for Effective Service in Multi-UAV Aided Networks
    Osrhir, Youssef
    El Khamlichi, Btissam
    El Fallah-Seghrouchni, Amal
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [23] An MA-HPPO Approach for Multi-UAV Data Collection
    Bai, Zixuan
    Shi, Jia
    Li, Zan
    Li, Meng
    Liao, Xiaomin
    IEEE Transactions on Wireless Communications, 2024, 23 (12) : 17974 - 17986
  • [24] Cellular UAV-to-X Communications: Design and Optimization for Multi-UAV Networks
    Zhang, Shuhang
    Zhang, Hongliang
    Di, Boya
    Song, Lingyang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (02) : 1346 - 1359
  • [25] Energy optimization and age of information enhancement in multi-UAV networks using deep reinforcement learning
    Kim, Jeena
    Park, Seunghyun
    Park, Hyunhee
    Electronics Letters, 2024, 60 (20)
  • [26] A Deep Reinforcement Learning Approach for Multi-UAV-Assisted Data Collection in Wireless Powered IoT networks
    Li, Zhiming
    Liu, Juan
    Xie, Lingfu
    Wang, Xijun
    Jin, Ming
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 44 - 49
  • [27] Multi-UAV trajectory optimizer: A sustainable system for wireless data harvesting with deep reinforcement learning
    Seong, Mincheol
    Jo, Ohyun
    Shin, Kyungseop
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [28] A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning
    Zhao, Xiaohu
    Jiang, Hanli
    An, Chenyang
    Wu, Ruocheng
    Guo, Yijun
    Yang, Daquan
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [29] Dynamic deployment of multi-UAV base stations with deep reinforcement learning
    Wu, Guanhan
    Jia, Weimin
    Zhao, Jianwei
    ELECTRONICS LETTERS, 2021, 57 (15) : 600 - 602
  • [30] Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking
    Moon, Jiseon
    Papaioannou, Savvas
    Laoudias, Christos
    Kolios, Panayiotis
    Kim, Sunwoo
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (20) : 15441 - 15455