DDQN-Based Trajectory and Resource Optimization for UAV-Aided MEC Secure Communications

被引:8
|
作者
Ding, Yu [1 ]
Han, Huimei [1 ]
Lu, Weidang [1 ]
Zhao, Nan [3 ]
Wang, Ye [2 ]
Wang, Xianbin [4 ]
Yang, Xiaoniu [1 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou 310023, Peoples R China
[2] Lishui Univ, Fac Engn, Lishui 323000, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
[4] Western Univ, Dept Elect & Comp Engn, London, ON N6A 5B9, Canada
关键词
Double-deep Q-learning (DDQN); mobile edge computing (MEC); secure communications; unmanned aerial vehicle; ALLOCATION; TIME;
D O I
10.1109/TVT.2023.3335210
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicles (UAVs) have been emerged as cost-effective platforms to extend the coverage of mobile edge computing (MEC) system. However, the broadcast and line-of-sight (LoS) channels in UAV communications create opportunities for malicious eavesdroppers to intercept the offloaded information from ground users, posing a serious challenge to both communication and computing security. In this correspondence, we investigate the problem of secure transmission in UAV-aided MEC systems. Our goal is to maximize the average secure computing capacity by jointly designing the UAV trajectory, time allocation and offloading decision strategy. To this end, we propose a novel double-deep Q-learning (DDQN) based trajectory optimization and resource allocation scheme. Furthermore, the size of the original action space is reduced to boost the convergence of the proposed DDQN-based scheme. Additionally, we design a reward function to navigate the UAV towards its intended destination. Simulation results demonstrate that the proposed DDQN-based scheme outperforms the baselines in terms of average secure computing capacity.
引用
收藏
页码:6006 / 6011
页数:6
相关论文
共 50 条
  • [1] Robust Trajectory and Resource Allocation Design for Secure UAV-aided Communications
    Sun, Xiaofang
    Shen, Chao
    Ng, Derrick Wing Kwan
    Zhong, Zhangdui
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2019,
  • [2] UAV-aided Secure NOMA Transmission via Trajectory and Resource Optimization
    Li, Yanxin
    Wang, Wei
    Liu, Mingqian
    Zhao, Nan
    Jiang, Xu
    Chen, Yunfei
    Wang, Xianbin
    13th International Conference on Wireless Communications and Signal Processing, WCSP 2021, 2021,
  • [3] UAV-Aided Backscatter Communications: Performance Analysis and Trajectory Optimization
    Han, Rui
    Bai, Lin
    Wen, Yongqing
    Liu, Jianwei
    Choi, Jinho
    Zhang, Wei
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (10) : 3129 - 3143
  • [4] UAV-Aided Secure Communications With Cooperative Jamming
    Lee, Hoon
    Eom, Subin
    Park, Junhee
    Lee, Inkyu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (10) : 9385 - 9392
  • [5] Joint Resource Allocation and Trajectory Optimization for UAV-Aided Relay Networks
    Hu, Qiyu
    Cai, Yunlong
    Liu, An
    Yu, Guanding
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [6] Capacity Maximization in RIS-UAV Networks: A DDQN-Based Trajectory and Phase Shift Optimization Approach
    Zhang, Haijun
    Huang, Miaolin
    Zhou, Huan
    Wang, Xianmei
    Wang, Ning
    Long, Keping
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (04) : 2583 - 2591
  • [7] Resource and Trajectory Optimization for UAV-Relay-Assisted Secure Maritime MEC
    Lu, Fangwei
    Liu, Gongliang
    Lu, Weidang
    Gao, Yuan
    Cao, Jiang
    Zhao, Nan
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (03) : 1641 - 1652
  • [8] Reinforcement Learning-Based Trajectory Planning For UAV-aided Vehicular Communications
    Marini, Riccardo
    Spampinato, Leonardo
    Mignardi, Silvia
    Verdone, Roberto
    Buratti, Chiara
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 967 - 971
  • [9] Covert and Secure Communications in UAV-Aided Untrusted Relay Systems
    Yang, Kai
    Shen, Shikai
    Bin Yang
    Deng, Fei
    She, Yumei
    Qian, Kaiguo
    Zhang, Yiwen
    Wang, Riyu
    2024 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS, NANA 2024, 2024, : 84 - 88
  • [10] Intelligent Trajectory Design in UAV-Aided Communications With Reinforcement Learning
    Yin, Sixing
    Zhao, Shuo
    Zhao, Yifei
    Yu, F. Richard
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (08) : 8227 - 8231