Joint Charging Scheduling and Computation Offloading in EV-Assisted Edge Computing: A Safe DRL Approach

被引:9
|
作者
Zhang, Yongchao [1 ]
Hu, Jia [1 ]
Min, Geyong [1 ]
Chen, Xin [2 ]
Georgalas, Nektarios [3 ]
机构
[1] Univ Exeter, Dept Comp Sci, Exeter EX4 4QF, Devon, England
[2] Beijing Informat Sci & Technol Univ, Comp Sch, Beijing 100101, Peoples R China
[3] British Telecommun PLC, Appl Res Dept, London EC1A 7AJ, England
关键词
Task analysis; Processor scheduling; Optimization; Vehicle dynamics; Charging stations; Oceans; Resource management; Electric vehicles; edge computing; charging scheduling; computation offloading; safe reinforcement learning; ELECTRIC VEHICLES; RESOURCE-ALLOCATION; SYSTEM;
D O I
10.1109/TMC.2024.3355868
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Electric Vehicle-assisted Multi-access Edge Computing (EV-MEC) is a promising paradigm where EVs share their computation resources at the network edge to perform intensive computing tasks while charging. In EV-MEC, a fundamental problem is to jointly decide the charging power of EVs and computation task allocation to EVs, for meeting both the diverse charging demands of EVs and stringent performance requirements of heterogeneous tasks. To address this challenge, we propose a new joint charging scheduling and computation offloading scheme (OCEAN) for EV-MEC. Specifically, we formulate a cooperative two-timescale optimization problem to minimize the charging load and its variance subject to the performance requirements of computation tasks. We then decompose this sophisticated optimization problem into two sub-problems: charging scheduling and computation offloading. For the former, we develop a novel safe deep reinforcement learning (DRL) algorithm, and theoretically prove the feasibility of learned charging scheduling policy. For the latter, we reformulate it as an integer non-linear programming problem to derive the optimal offloading decisions. Extensive experimental results demonstrate that OCEAN can achieve similar performances as the optimal strategy and realize up to 24% improvement in charging load variance over three state-of-the-art algorithms while satisfying the charging demands of all EVs.
引用
收藏
页码:8757 / 8772
页数:16
相关论文
共 50 条
  • [41] Joint Computation Offloading and Resource Allocation for Mobile-Edge Computing Assisted Ultra-Dense Networks
    Gao Y.
    Zhang H.
    Yu F.
    Xia Y.
    Shi Y.
    Journal of Communications and Information Networks, 2022, 7 (01) : 96 - 106
  • [42] Minimizing Response Delay in UAV-Assisted Mobile Edge Computing by Joint UAV Deployment and Computation Offloading
    Zhang, Jianshan
    Luo, Haibo
    Chen, Xing
    Shen, Hong
    Guo, Longkun
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1372 - 1386
  • [43] Joint Computation Offloading and Wireless Resource Allocation in Vehicular Edge Computing Networks
    Zhang, Jiao
    Liu, Zhanjun
    Gu, Bowen
    Liang, Chengchao
    Chen, Qianbin
    COMMUNICATIONS AND NETWORKING (CHINACOM 2021), 2022, : 377 - 391
  • [44] Joint Offloading and Computation Energy Efficiency Maximization in a Mobile Edge Computing System
    Sun, Haijian
    Zhou, Fuhui
    Hu, Rose Qingyang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (03) : 3052 - 3056
  • [45] Joint Sensing and Computation Offloading for Wireless Powered Mobile Edge Computing System
    Wu, Wenxin
    Chang, Zheng
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5348 - 5353
  • [46] Joint Task Offloading, Resource Sharing and Computation Incentive for Edge Computing Networks
    Zhao, Nan
    Du, Wei
    Ren, Fan
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    IEEE COMMUNICATIONS LETTERS, 2023, 27 (01) : 258 - 262
  • [47] Joint Task Allocation and Computation Offloading in Mobile Edge Computing With Energy Harvesting
    Yin, Li
    Guo, Songtao
    Jiang, Qiucen
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (23): : 38441 - 38454
  • [48] Intelligent Edge Computing in Internet of Vehicles: A Joint Computation Offloading and Caching Solution
    Ning, Zhaolong
    Zhang, Kaiyuan
    Wang, Xiaojie
    Guo, Lei
    Hu, Xiping
    Huang, Jun
    Hu, Bin
    Kwok, Ricky Y. K.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (04) : 2212 - 2225
  • [49] Joint Management of Wireless and Computing Resources for Computation Offloading in Mobile Edge Clouds
    Josilo, Sladana
    Dan, Gyorgy
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (04) : 1507 - 1520
  • [50] Joint Computation Offloading and Multiuser Scheduling Using Approximate Dynamic Programming in NB-IoT Edge Computing System
    Lei, Lei
    Xu, Huijuan
    Xiong, Xiong
    Zheng, Kan
    Xiang, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) : 5345 - 5362