Multi-UAV Reinforcement Learning for Data Collection in Cellular MIMO Networks

被引:0
|
作者
Diaz-Vilor, Carles [1 ]
Abdelhady, Amr M. [2 ]
Eltawil, Ahmed M. [2 ]
Jafarkhani, Hamid [1 ]
机构
[1] University of California at Irvine, Center for Pervasive Communications and Computing, Irvine,CA,92697, United States
[2] King Abdullah University of Science and Technology, Computer Electrical, and Mathematical Science and Engineering Division, Thuwal,23955, Saudi Arabia
关键词
Antennas - Data acquisition - Internet of things - Learning algorithms - MIMO systems - Trajectories - Unmanned aerial vehicles (UAV);
D O I
10.1109/TWC.2024.3430228
中图分类号
学科分类号
摘要
Uncrewed Aerial Vehicles (UAVs) provide a compelling solution for data collection in Internet of Things (IoT) networks due to their mobility and adaptability. However, the line-of-sight dominance in their channels may result in severe interference to ground users during UAV operations. To address this, we present an optimization framework that concurrently optimizes UAV trajectories and transmit powers. Our approach efficiently results in the collection of data from a variety of IoT sensors while (a) minimizing the UAVs flying time and (b) mitigating interference with terrestrial networks. Given the complex nature of such an optimization problem, this paper leverages reinforcement learning, specifically the twin delayed deep deterministic policy gradient algorithm, where a distributed learning algorithm is presented. Experimental results validate the efficacy of our proposed approach, demonstrating its capability to significantly enhance data collection in IoT networks while minimizing UAV flight time and interference with ground user links. © 2024 The Authors.
引用
收藏
页码:15462 / 15476
相关论文
共 50 条
  • [31] Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning
    Westheider, Jonas
    Rueckin, Julius
    Popovic, Marija
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 649 - 656
  • [32] Optimization Design of Multi-UAV Communication Network Based on Reinforcement Learning
    Cao, Zhengyang
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [33] Collision Detection and Avoidance for Multi-UAV based on Deep Reinforcement Learning
    Wang, Guanzheng
    Liu, Zhihong
    Xiao, Kun
    Xu, Yinbo
    Yang, Lingjie
    Wang, Xiangke
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7783 - 7789
  • [34] Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation
    Estevez, Julian
    Manuel Lopez-Guede, Jose
    Del Valle-Echavarri, Javier
    Grana, Manuel
    IEEE Access, 2024, 12 : 144009 - 144016
  • [35] Multi-UAV Cooperative Target Assignment Method Based on Reinforcement Learning
    Ding, Yunlong
    Kuang, Minchi
    Shi, Heng
    Gao, Jiazhan
    Drones, 2024, 8 (10)
  • [36] Deep Reinforcement Learning for Multi-UAV Exploration Under Energy Constraints
    Zhou, Yating
    Shi, Dianxi
    Yang, Huanhuan
    Hu, Haomeng
    Yang, Shaowu
    Zhang, Yongjun
    COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING, COLLABORATECOM 2022, PT II, 2022, 461 : 363 - 379
  • [37] Bayesian Optimization Enhanced Deep Reinforcement Learning for Trajectory Planning and Network Formation in Multi-UAV Networks
    Gong, Shimin
    Wang, Meng
    Gu, Bo
    Zhang, Wenjie
    Dinh Thai Hoang
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10933 - 10948
  • [38] Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks
    Yi, Mengjie
    Wang, Xijun
    Liu, Juan
    Zhang, Yan
    Bai, Bo
    IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2020, : 716 - 721
  • [39] Multi-UAV Collaborative Data Collection for IoT Devices Powered by Battery
    Wang, Yue
    Wen, Xiangming
    Hu, Zhiqun
    Lu, Zhaoming
    Miao, Jiansong
    Sun, Chuanzhi
    Qi, Hang
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [40] Deployment Optimization of Multiple UAVs in Multi-UAV Assisted Cellular Networks
    Yang, Xuan
    Li, Zipeng
    Ge, Xiaohu
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,