Security computing resource allocation based on deep reinforcement learning in serverless multi-cloud edge computing

被引:6
|
作者
Zhang, Hang [1 ,2 ,3 ]
Wang, Jinsong [1 ,2 ,3 ]
Zhang, Hongwei [1 ,2 ,3 ]
Bu, Chao [1 ,2 ,3 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
[2] Tianjin Key Lab Intelligence Comp & Novel Software, Tianjin 300384, Peoples R China
[3] Natl Engn Lab Comp Virus Prevent & Control Techno, Tianjin 300457, Peoples R China
基金
中国国家自然科学基金;
关键词
Serverless cloud edge computing; Resource allocation; Deep reinforcement learning; EFFICIENT; BLOCKCHAIN; NETWORKS; IOT;
D O I
10.1016/j.future.2023.09.016
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Handling computationally intensive tasks is challenging for user devices (UDs) with limited computing resources. Serverless cloud edge computing solves this problem and reduces maintenance and management. Its crucial function is to allocate computing resources reasonably. However, linking multiple computing resource nodes to perform computing resource allocation and ensure data security is a significant challenge. This study proposes an approach based on action-constrained deep reinforcement learning (DRL) to allocate computing resources securely. First, we consider a model of a serverless multi-cloud edge computing network with multiple computing resource nodes that possess various attribute characteristics. Then, we design a security mechanism to guarantee data security. Afterward, we formalize the network model and objectives and further transform them into a modeling process known as the Markov decision process. Finally, we propose DRL based on action constraints to provide an optimal resource allocation scheduling policy. Simulation results demonstrate that our approach can reduce system costs and improve working performance compared with the comparison schemes.
引用
收藏
页码:152 / 161
页数:10
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System
    Xu, Jianqiao
    Xu, Zhuohan
    Shi, Bing
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [2] Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System
    Xu, Zhuohan
    Zhong, Zeheng
    Shi, Bing
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [3] Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing
    Deng, Xiaoheng
    Zhang, Jingjing
    Zhang, Honggang
    Jiang, Ping
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (06) : 5364 - 5377
  • [4] Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
    Xiong, Xiong
    Zheng, Kan
    Lei, Lei
    Hou, Lu
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (06) : 1133 - 1146
  • [5] Supporting Multi-Cloud in Serverless Computing
    Zhao, Haidong
    Benomar, Zakaria
    Pfandzelter, Tobias
    Georgantas, Nikolaos
    [J]. 2022 IEEE/ACM 15TH INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING, UCC, 2022, : 285 - 290
  • [6] Deep reinforcement learning-based resource allocation in multi-access edge computing
    Khani, Mohsen
    Sadr, Mohammad Mohsen
    Jamali, Shahram
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023,
  • [7] Joint Data Offloading and Resource Allocation for Multi-cloud Heterogeneous Mobile Edge Computing Using Multi-agent Reinforcement Learning
    Zhang, Yutong
    Di, Boya
    Zheng, Zijie
    Lin, Jinlong
    Song, Lingyang
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [8] Novel Resource Allocation Algorithm of Edge Computing Based on Deep Reinforcement Learning Mechanism
    Zhang, Degan
    Fan, Hongrui
    Zhang, Jie
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 437 - 444
  • [9] Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment
    Yiwei Zhang
    Min Zhang
    Caixia Fan
    Fuqiang Li
    Baofang Li
    [J]. EURASIP Journal on Advances in Signal Processing, 2021
  • [10] Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment
    Zhang, Yiwei
    Zhang, Min
    Fan, Caixia
    Li, Fuqiang
    Li, Baofang
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2021, 2021 (01)