DDQN-Based Trajectory and Resource Optimization for UAV-Aided MEC Secure Communications

被引:8
|
作者
Ding, Yu [1 ]
Han, Huimei [1 ]
Lu, Weidang [1 ]
Zhao, Nan [3 ]
Wang, Ye [2 ]
Wang, Xianbin [4 ]
Yang, Xiaoniu [1 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou 310023, Peoples R China
[2] Lishui Univ, Fac Engn, Lishui 323000, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
[4] Western Univ, Dept Elect & Comp Engn, London, ON N6A 5B9, Canada
关键词
Double-deep Q-learning (DDQN); mobile edge computing (MEC); secure communications; unmanned aerial vehicle; ALLOCATION; TIME;
D O I
10.1109/TVT.2023.3335210
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicles (UAVs) have been emerged as cost-effective platforms to extend the coverage of mobile edge computing (MEC) system. However, the broadcast and line-of-sight (LoS) channels in UAV communications create opportunities for malicious eavesdroppers to intercept the offloaded information from ground users, posing a serious challenge to both communication and computing security. In this correspondence, we investigate the problem of secure transmission in UAV-aided MEC systems. Our goal is to maximize the average secure computing capacity by jointly designing the UAV trajectory, time allocation and offloading decision strategy. To this end, we propose a novel double-deep Q-learning (DDQN) based trajectory optimization and resource allocation scheme. Furthermore, the size of the original action space is reduced to boost the convergence of the proposed DDQN-based scheme. Additionally, we design a reward function to navigate the UAV towards its intended destination. Simulation results demonstrate that the proposed DDQN-based scheme outperforms the baselines in terms of average secure computing capacity.
引用
收藏
页码:6006 / 6011
页数:6
相关论文
共 50 条
  • [31] Joint Precoding Optimization for Secure SWIPT in UAV-Aided NOMA Networks
    Wang, Wei
    Tang, Jie
    Zhao, Nan
    Liu, Xin
    Zhang, Xiu Yin
    Chen, Yunfei
    Qian, Yi
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (08) : 5028 - 5040
  • [32] Deep Reinforcement Learning-based Trajectory Optimization and Resource Allocation for Secure UAV-Enabled MEC Networks
    Gao, Yuan
    Ding, Yu
    Wang, Ye
    Lu, Weidang
    Guo, Yang
    Wang, Ping
    Caoi, Jiang
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,
  • [33] Resource Allocation and Trajectory Design in UAV-Aided Cellular Networks Based on Multiagent Reinforcement Learning
    Yin, Sixing
    Yu, F. Richard
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (04) : 2933 - 2943
  • [34] Dinkelbach-Guided Deep Reinforcement Learning for Secure Communication in UAV-Aided MEC Networks
    Lu, Weidang
    Ding, Yu
    Feng, Yunqi
    Huang, Guoxing
    Zhao, Nan
    Nallanathan, Arumugam
    Yang, Xiaoniu
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1740 - 1745
  • [35] Joint Trajectory Design and Radio Resource Management for UAV-Aided Vehicular Networks
    Spampinato, Leonardo
    Ferretti, Danila
    Buratti, Chiara
    Marini, Riccardo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (01) : 847 - 860
  • [36] NOMA-Based UAV-Aided Networks for Emergency Communications
    Wanmei Feng
    Jie Tang
    Nan Zhao
    Yuli Fu
    Xiuyin Zhang
    Kanapathippillai Cumanan
    Kai-Kit Wong
    中国通信, 2020, 17 (11) : 54 - 66
  • [37] NOMA-Based UAV-Aided Networks for Emergency Communications
    Feng, Wanmei
    Tang, Jie
    Zhao, Nan
    Fu, Yuli
    Zhang, Xiuyin
    Cumanan, Kanapathippillai
    Wong, Kai-Kit
    CHINA COMMUNICATIONS, 2020, 17 (11) : 54 - 66
  • [38] Energy Optimization in Massive MIMO UAV-Aided MEC-Enabled Vehicular Networks
    Michailidis, Emmanouel T.
    Miridakis, Nikolaos, I
    Michalas, Angelos
    Skondras, Emmanouil
    Vergados, Dimitrios J.
    Vergados, Dimitrios D.
    IEEE ACCESS, 2021, 9 : 117388 - 117403
  • [39] Establishing UAV-Aided VBSs for Secure Multicasting
    Wang, Qian
    Chen, Zhi
    Cai, Jiansheng
    Tian, Zhongbao
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (07) : 1009 - 1013
  • [40] Joint Trajectory and Scheduling Design for UAV Aided Secure Backscatter Communications
    Hu, Jie
    Cai, Xingpeng
    Yang, Kun
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (12) : 2168 - 2172