Multi-UAV Reinforcement Learning for Data Collection in Cellular MIMO Networks

被引:0
|
作者
Diaz-Vilor, Carles [1 ]
Abdelhady, Amr M. [2 ]
Eltawil, Ahmed M. [2 ]
Jafarkhani, Hamid [1 ]
机构
[1] University of California at Irvine, Center for Pervasive Communications and Computing, Irvine,CA,92697, United States
[2] King Abdullah University of Science and Technology, Computer Electrical, and Mathematical Science and Engineering Division, Thuwal,23955, Saudi Arabia
关键词
Antennas - Data acquisition - Internet of things - Learning algorithms - MIMO systems - Trajectories - Unmanned aerial vehicles (UAV);
D O I
10.1109/TWC.2024.3430228
中图分类号
学科分类号
摘要
Uncrewed Aerial Vehicles (UAVs) provide a compelling solution for data collection in Internet of Things (IoT) networks due to their mobility and adaptability. However, the line-of-sight dominance in their channels may result in severe interference to ground users during UAV operations. To address this, we present an optimization framework that concurrently optimizes UAV trajectories and transmit powers. Our approach efficiently results in the collection of data from a variety of IoT sensors while (a) minimizing the UAVs flying time and (b) mitigating interference with terrestrial networks. Given the complex nature of such an optimization problem, this paper leverages reinforcement learning, specifically the twin delayed deep deterministic policy gradient algorithm, where a distributed learning algorithm is presented. Experimental results validate the efficacy of our proposed approach, demonstrating its capability to significantly enhance data collection in IoT networks while minimizing UAV flight time and interference with ground user links. © 2024 The Authors.
引用
收藏
页码:15462 / 15476
相关论文
共 50 条
  • [41] Optimization of Urban Target Area Accessibility for Multi-UAV Data Gathering Based on Deep Reinforcement Learning
    Jin, Zhengmiao
    Chen, Renxiang
    Wu, Ke
    Yu, Tengwei
    Fu, Linghua
    Drones, 2024, 8 (09)
  • [42] Multi-UAV Escape Target Search: A Multi-Agent Reinforcement Learning Method
    Liao, Guang
    Wang, Jian
    Yang, Dujia
    Yang, Junan
    Sensors, 2024, 24 (21)
  • [43] Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning
    Zhao, Xiaoru
    Yang, Rennong
    Zhong, Liangsheng
    Hou, Zhiwei
    DRONES, 2024, 8 (01)
  • [44] An evolutionary multi-agent reinforcement learning algorithm for multi-UAV air combat
    Wang, Baolai
    Gao, Xianzhong
    Xie, Tao
    KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [45] Maintaining Connectivity for Multi-UAV Multi-Target Search Using Reinforcement Learning
    Guven, Islam
    Yanmaz, Evsen
    PROCEEDINGS OF THE INT'L ACM SYMPOSIUM ON DESIGN AND ANALYSIS OF INTELLIGENT VEHICULAR NETWORKS AND APPLICATIONS, DIVANET 2023, 2023, : 109 - 114
  • [46] A Deep Learning Trained by Genetic Algorithm to Improve the Efficiency of Path Planning for Data Collection With Multi-UAV
    Pan, Yuwen
    Yang, Yuanwang
    Li, Wenzao
    IEEE ACCESS, 2021, 9 : 7994 - 8005
  • [47] Machine Learning-Based Multi-UAV Deployment for Uplink Traffic Sizing and Offloading in Cellular Networks
    Mostafa, Ahmed Fahim
    Abdel-Kader, Mohamed
    Gadallah, Yasser
    Elayat, Omar
    IEEE ACCESS, 2023, 11 : 71314 - 71325
  • [48] QoE-Driven Adaptive Deployment Strategy of Multi-UAV Networks Based on Hybrid Deep Reinforcement Learning
    Zhou, Yi
    Ma, Xiaoyong
    Hu, Shuting
    Zhou, Danyang
    Cheng, Nan
    Lu, Ning
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (08) : 5868 - 5881
  • [49] Multi-UAV Navigation for Partially Observable Communication Coverage by Graph Reinforcement Learning
    Ye, Zhenhui
    Wang, Ke
    Chen, Yining
    Jiang, Xiaohong
    Song, Guanghua
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (07) : 4056 - 4069
  • [50] Transformer-Based Reinforcement Learning for Scalable Multi-UAV Area Coverage
    Chen, Dezhi
    Qi, Qi
    Fu, Qianlong
    Wang, Jingyu
    Liao, Jianxin
    Han, Zhu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 1 - 16