Delanalty Minimization With Reinforcement Learning in UAV-Aided Mobile Network

被引:0
|
作者
Tseng, Fan-Hsun [1 ]
Hsieh, Yu-Jung [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
关键词
Actor-critic (AC); data offloading; deep reinforcement learning (DRL); trajectory planning; unmanned aerial vehicle (UAV); COMMUNICATION; OPTIMIZATION; DESIGN; ENERGY; ALLOCATION;
D O I
10.1109/TCSS.2023.3283016
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicle (UAV)-assisted mobile communication has been studied in recent years. UAVs can be used as aerial base stations (BSs) to improve the performance of terrestrial mobile network. In this article, mobile data offloading with UAV trajectory optimization is investigated. To tackle with the delay of requesting data and the immediacy of requested data at the same time, a new metric named delanalty is newly proposed. The delanalty metric jointly considers the delay of user requesting data, the immediacy of requested data file, and the quantity of residual requesting data. A find max delanalty user mechanism is proposed to eliminate the user who has the largest delay time. Furthermore, an actor-critic (AC)-based deep reinforcement learning (DRL) algorithm called AC-based delanalty trajectory optimization (ACDTO) algorithm is proposed to solve UAV's trajectory optimization problem. Simulation results show that the proposed ACDTO algorithm can find an optimal flight trajectory with minimal delanalty for all users.
引用
收藏
页码:1991 / 2001
页数:11
相关论文
共 50 条
  • [1] Actor-Critic Deep Reinforcement Learning for Energy Minimization in UAV-Aided Networks
    Yuan, Yaxiong
    Lei, Lei
    Vu, Thang X.
    Chatzinotas, Symeon
    Ottersten, Bjorn
    2020 EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS (EUCNC 2020), 2020, : 348 - 352
  • [2] Trajectory Design in UAV-Aided Mobile Crowdsensing: A Deep Reinforcement Learning Approach
    Tao, Xi
    Hafid, Abdelhakim Senhaji
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [3] Deep Reinforcement Learning for AoI Minimization in UAV-Aided Data Collection for WSN and IoT Applications: A Survey
    Amodu, Oluwatosin Ahmed
    Jarray, Chedia
    Mahmood, Raja Azlina Raja
    Althumali, Huda
    Bukar, Umar Ali
    Nordin, Rosdiadee
    Abdullah, Nor Fadzilah
    Luong, Nguyen Cong
    IEEE ACCESS, 2024, 12 : 108000 - 108040
  • [4] Intelligent Trajectory Design in UAV-Aided Communications With Reinforcement Learning
    Yin, Sixing
    Zhao, Shuo
    Zhao, Yifei
    Yu, F. Richard
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (08) : 8227 - 8231
  • [5] Cooperative Multiagent Deep Reinforcement Learning Methods for UAV-Aided Mobile Edge Computing Networks
    Kim, Mintae
    Lee, Hoon
    Hwang, Sangwon
    Debbah, Merouane
    Lee, Inkyu
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (23): : 38040 - 38053
  • [6] UAV-Aided Cellular Communications with Deep Reinforcement Learning against Jamming
    Lu, Xiaozhen
    Xiao, Liang
    Dai, Canhuang
    Dai, Huaiyu
    IEEE Wireless Communications, 2020, 27 (04): : 48 - 53
  • [7] UAV-AIDED CELLULAR COMMUNICATIONS WITH DEEP REINFORCEMENT LEARNING AGAINST JAMMING
    Lu, Xiaozhen
    Xiao, Liang
    Dai, Canhuang
    Dai, Huaiyu
    IEEE WIRELESS COMMUNICATIONS, 2020, 27 (04) : 48 - 53
  • [8] Federated Learning-Based Task Offloading in a UAV-Aided Cloud Computing Mobile Network
    Agarwal, Nipun
    Joshi, Sandeep
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (10) : 15751 - 15756
  • [9] Goal-Oriented Reinforcement Learning in THz-Enabled UAV-Aided Network Using Supervised Learning
    Termehchi, Atefeh
    Bao, Tingnan
    Syed, Aisha
    Kennedy, William Sean
    Erol-Kantarci, Melike
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 5027 - 5036
  • [10] Continual Meta-Reinforcement Learning for UAV-Aided Vehicular Wireless Networks
    Marini, Riccardo
    Park, Sangwoo
    Simeone, Osvaldo
    Buratti, Chiara
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 5664 - 5669