Offloading Optimization in Digital Twin-Aided UAV Networks

被引:0
|
作者
Miao J. [1 ]
Zheng H. [1 ]
Xie Z. [1 ]
Lai J. [1 ]
Jiang L. [1 ]
机构
[1] Guangdong Key Laboratory of Internet of Things Information Technology, Guangdong University of Technology, Guangzhou
关键词
Computing tasks offloading; Digital twin; Proximal policy optimization; Unmanned aerial vehicle networks; Virtual-real mapping error;
D O I
10.13190/j.jbupt.2022-181
中图分类号
学科分类号
摘要
To address the problemthat limited resource cannot meet the computing requirements of resource-intensive tasks in dynamic and time-varying unmanned aerial vehicle (UAV) networks, a digital twin technology is leveraged to construct the twin model of UAV networks, and a scheme of computing tasks offloading is developed for smart terminal. Then, the problem of computing offloading is modeled as a Markov decision process, and an optimization model is established for jointly optimizing UAV hovering point selection, computing tasks offloading decision, and UAV computing resource allocation. Considering the virtual-real mapping error between the twin model and the real UAV networks, a computing tasks offloading approach is designed based on proximal strategy optimization. Numerical results illustrate that the proposed approach can better adapt to the virtual-real mapping error comparing with the traditional deep reinforcement learning. © 2022, Editorial Department of Journal of Beijing University of Posts and Telecommunications. All right reserved.
引用
收藏
页码:133 / 139
页数:6
相关论文
共 12 条
  • [1] GERACI G, GARCIA-RODRIGUEZ A, AZARI M M, Et al., What will the future of UAV cellular communications be? a flight from 5G to 6G, IEEE Communications Surveys & Tutorials, 24, 3, pp. 1304-1335, (2022)
  • [2] JIANG L, CHEN B, XIE S L, Et al., Incentivizing resource cooperation for blockchain empowered wireless power transfer in UAV networks, IEEE Transactions on Vehicular Technology, 69, 12, pp. 15828-15841, (2020)
  • [3] HAYAT S, YANMAZ E, MUZAFFAR R., Survey on unmanned aerial vehicle networks for civil applications: a communications viewpoint, IEEE Communications Surveys & Tutorials, 18, 4, pp. 2624-2661, (2016)
  • [4] ZHOU F H, HU R Q, LI Z, Et al., Mobile edge computing in unmanned aerial vehicle networks, IEEE Wireless Communications, 27, 1, pp. 140-146, (2020)
  • [5] SEID A M, BOATENG G O, MARERI B, Et al., Multi-agent DRL for task offloading and resource allocation in multi-UAV enabled IoT edge network, IEEE Transactions on Network and Service Management, 18, 4, pp. 4531-4547, (2021)
  • [6] GLAESSGEN E, STARGEL D., The digital twin paradigm for future NASA and US air force vehicles, 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference< BR> 20th AIAA/ASME/AHS Adaptive Structures Conference< BR> 14th AIAA, pp. 1-15, (2012)
  • [7] JIANG L, ZHENG H, TIAN H, Et al., Cooperative federated learning and model update verification in blockchain-empowered digital twin edge networks, IEEE Internet of Things Journal, 9, 13, pp. 11154-11167, (2022)
  • [8] CHEN X F, CHEN T, ZHAO Z F, Et al., Resource awareness in unmanned aerial vehicle-assisted mobile-edge computing systems, 2020 IEEE 91st Vehicular Technology Conference, pp. 1-6, (2020)
  • [9] LI B, LIU Y F, TAN L, Et al., Digital twin assisted task offloading for aerial edge computing and networks, IEEE Transactions on Vehicular Technology, 71, 10, pp. 1-16, (2022)
  • [10] CRONRATH C, ADERIANI A R, LENNARTSON B., Enhancing digital twins through reinforcement learning, 2019 IEEE 15th International Conference on Automation Science and Engineering, pp. 293-298, (2019)