Multi-UAV Reinforcement Learning for Data Collection in Cellular MIMO Networks

被引:0
|
作者
Diaz-Vilor, Carles [1 ]
Abdelhady, Amr M. [2 ]
Eltawil, Ahmed M. [2 ]
Jafarkhani, Hamid [1 ]
机构
[1] University of California at Irvine, Center for Pervasive Communications and Computing, Irvine,CA,92697, United States
[2] King Abdullah University of Science and Technology, Computer Electrical, and Mathematical Science and Engineering Division, Thuwal,23955, Saudi Arabia
关键词
Antennas - Data acquisition - Internet of things - Learning algorithms - MIMO systems - Trajectories - Unmanned aerial vehicles (UAV);
D O I
10.1109/TWC.2024.3430228
中图分类号
学科分类号
摘要
Uncrewed Aerial Vehicles (UAVs) provide a compelling solution for data collection in Internet of Things (IoT) networks due to their mobility and adaptability. However, the line-of-sight dominance in their channels may result in severe interference to ground users during UAV operations. To address this, we present an optimization framework that concurrently optimizes UAV trajectories and transmit powers. Our approach efficiently results in the collection of data from a variety of IoT sensors while (a) minimizing the UAVs flying time and (b) mitigating interference with terrestrial networks. Given the complex nature of such an optimization problem, this paper leverages reinforcement learning, specifically the twin delayed deep deterministic policy gradient algorithm, where a distributed learning algorithm is presented. Experimental results validate the efficacy of our proposed approach, demonstrating its capability to significantly enhance data collection in IoT networks while minimizing UAV flight time and interference with ground user links. © 2024 The Authors.
引用
收藏
页码:15462 / 15476
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based Energy Efficient Multi-UAV Data Collection for IoT Networks
    Khodaparast, Seyed Saeed
    Lu, Xiao
    Wang, Ping
    Uyen Trang Nguyen
    IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2021, 2 : 249 - 260
  • [2] Multi-UAV Data Collection Framework for Wireless Sensor Networks
    Alfattani, Safwan
    Jaafar, Wael
    Yanikomeroglu, Halim
    Yongacoglu, Abbas
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [3] Optimization of UAV Flight Paths in Multi-UAV Networks for Efficient Data Collection
    Abid, Mohamed
    El Kafhali, Said
    Amzil, Abdellah
    Hanini, Mohamed
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024,
  • [4] MULTI-UAV ARCHITECTURE FOR GROUND DATA COLLECTION
    Vlasceanu, Emilian
    Popescu, Dan
    Ichim, Loretta
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 9192 - 9195
  • [5] Deep Reinforcement Learning Enabled Multi-UAV Scheduling for Disaster Data Collection With Time-Varying Value
    Wan, Pengfu
    Xu, Gangyan
    Chen, Jiawei
    Zhou, Yaoming
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (07) : 6691 - 6702
  • [6] Multi-UAV Aided Data Collection for Age Minimization in Wireless Sensor Networks
    Mao, Chixiong
    Liu, Juan
    Xie, Lingfu
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 80 - 85
  • [7] Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement Learning
    Bayerlein, Harald
    Theile, Mirco
    Caccamo, Marco
    Gesbert, David
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2021, 2 : 1171 - 1187
  • [8] Dynamic Attention Network for Multi-UAV Reinforcement Learning
    Xu, Dongsheng
    Wu, Shang
    INTERNATIONAL CONFERENCE ON ALGORITHMS, HIGH PERFORMANCE COMPUTING, AND ARTIFICIAL INTELLIGENCE (AHPCAI 2021), 2021, 12156
  • [9] Multi-Agent Deep Reinforcement Learning for Full-Duplex Multi-UAV Networks
    Dai, Chen
    Zhu, Kun
    Hossain, Ekram
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 2232 - 2237
  • [10] On Collaborative Multi-UAV Trajectory Planning for Data Collection
    Rahim, Shahnila
    Peng, Limei
    Chang, Shihyu
    Ho, Pin-Han
    JOURNAL OF COMMUNICATIONS AND NETWORKS, 2023, 25 (06) : 722 - 733