Delanalty Minimization With Reinforcement Learning in UAV-Aided Mobile Network

被引:0
|
作者
Tseng, Fan-Hsun [1 ]
Hsieh, Yu-Jung [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
关键词
Actor-critic (AC); data offloading; deep reinforcement learning (DRL); trajectory planning; unmanned aerial vehicle (UAV); COMMUNICATION; OPTIMIZATION; DESIGN; ENERGY; ALLOCATION;
D O I
10.1109/TCSS.2023.3283016
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicle (UAV)-assisted mobile communication has been studied in recent years. UAVs can be used as aerial base stations (BSs) to improve the performance of terrestrial mobile network. In this article, mobile data offloading with UAV trajectory optimization is investigated. To tackle with the delay of requesting data and the immediacy of requested data at the same time, a new metric named delanalty is newly proposed. The delanalty metric jointly considers the delay of user requesting data, the immediacy of requested data file, and the quantity of residual requesting data. A find max delanalty user mechanism is proposed to eliminate the user who has the largest delay time. Furthermore, an actor-critic (AC)-based deep reinforcement learning (DRL) algorithm called AC-based delanalty trajectory optimization (ACDTO) algorithm is proposed to solve UAV's trajectory optimization problem. Simulation results show that the proposed ACDTO algorithm can find an optimal flight trajectory with minimal delanalty for all users.
引用
收藏
页码:1991 / 2001
页数:11
相关论文
共 50 条
  • [21] Energy-Efficient Multidimensional Trajectory of UAV-Aided IoT Networks With Reinforcement Learning
    Silvirianti
    Shin, Soo Young
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (19): : 19214 - 19226
  • [22] QoE-Aware Power Control for UAV-aided Media Transmission with Reinforcement Learning
    Ding, Yuzhen
    Jiang, Donghua
    Huang, Jinhao
    Xiao, Liang
    Liu, Sicong
    Tang, Yuliang
    Dai, Huaiyu
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [23] A Deep Reinforcement Learning Approach to Energy-harvesting UAV-aided Data Collection
    Zhang, Ning
    Liu, Juan
    Xie, Lingfu
    Tong, Peng
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 93 - 98
  • [24] Proactive eavesdropping in UAV-aided mobile relay systems
    Lu, Haiquan
    Dai, Haibo
    Sun, Ping
    Li, Pei
    Wang, Baoyun
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2020, 2020 (01)
  • [25] Proactive eavesdropping in UAV-aided mobile relay systems
    Haiquan Lu
    Haibo Dai
    Ping Sun
    Pei Li
    Baoyun Wang
    EURASIP Journal on Wireless Communications and Networking, 2020
  • [26] Energy Minimization in UAV-Aided Networks: Actor-Critic Learning for Constrained Scheduling Optimization
    Yuan, Yaxiong
    Lei, Lei
    Vu, Thang X.
    Chatzinotas, Symeon
    Sun, Sumei
    Ottersten, Bjorn
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (05) : 5028 - 5042
  • [27] Flow-Time Minimization for Timely Data Stream Processing in UAV-Aided Mobile Edge Computing
    Xu, Zichuan
    Qiao, Haiyang
    Liang, Weifa
    Xu, Zhou
    Xia, Qiufen
    Zhou, Pan
    Rana, Omer F.
    Xu, Wenzheng
    ACM TRANSACTIONS ON SENSOR NETWORKS, 2024, 20 (03)
  • [28] Reliability-Aware Offloading in UAV-Aided Mobile Edge Network by Lyapunov Optimization
    Yao, Jingjing
    Cal, Semih
    Sun, Xiang
    2024 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2024, : 856 - 861
  • [29] Peak Age-of-Information Minimization of UAV-Aided Relay Transmission
    Cao, Ailin
    Shen, Chao
    Zong, Jiaying
    Chang, Tsung-Hui
    2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [30] Peak Age of Information Minimization for UAV-Aided Wireless Sensing and Communications
    Jiang, Wenwen
    Shen, Chao
    Ai, Bo
    Li, Hang
    2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,