Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems

被引:3
|
作者
Ansere, James Adu [1 ]
Gyamfi, Eric [2 ]
Sharma, Vishal [3 ]
Shin, Hyundong [4 ]
Dobre, Octavia A. [5 ]
Duong, Trung Q. [3 ,6 ,7 ]
机构
[1] Sunyani Tech Univ, Dept Elect & Elect Engn, Sunyani, Ghana
[2] Univ Coll Dublin, Sch Comp Sci, Dublin D04 V1W8 4, Ireland
[3] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[4] Kyung Hee Univ, Dept Elect & Informat Convergence Engn, Yongin 17104, Gyeonggi Do, South Korea
[5] Mem Univ, Fac Engn & Appl Sci, St John, NF AIC 5S7, Canada
[6] Mem Univ Newfoundland, Fac Engn & Appl Sci, St John, NF A1C 5S7, Canada
[7] Kyung Hee Univ, Dept Elect Engn, Yongin 17104, Gyeonggi Do, South Korea
关键词
Quantum computing; Task analysis; Internet of Things; Heuristic algorithms; Resource management; Dynamic scheduling; Computational efficiency; quantum reinforcement learning; computation offloading; Grover's algorithm; the Internet of Things; INTERNET; THINGS;
D O I
10.1109/TWC.2023.3330868
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper exploits a quantum-empowered machine learning algorithm to enhance computation learning speed. We leverage quantum phenomena such as superposition and entanglement to work on large-scale multi-dimensional data represented by quantum states. Under stochastic behaviors and quantum uncertainty, we examine the offloading problem to maximize the computational task processing efficiency, considering the computation latency, energy consumption, and quantum network adaptability. From the Markov decision process, the paper proposes a novel quantum-empowered deep reinforcement learning (Qe-DRL) approach, combining quantum computing theory and machine learning to achieve exploration and exploitation trade-off via quantum parallelism significantly. Furthermore, we develop a modified Grover's algorithm with exponential convergence speed to provide a searching strategy for transition quantum states probabilities. Simulation results establish the effectiveness of the proposed Qe-DRL algorithm and its superior computational learning speed. Our proposed Qe-DRL algorithm outperforms other benchmarks in terms of energy efficiency performance.
引用
收藏
页码:6221 / 6233
页数:13
相关论文
共 50 条
  • [1] Quantum Deep Reinforcement Learning for 6G Mobile Edge Computing-based IoT Systems
    Ansere, James Adu
    Duong, Trung Q.
    Khosravirad, Saeed R.
    Sharma, Vishal
    Masaracchia, Antonino
    Dobre, Octavia A.
    [J]. 2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 406 - 411
  • [2] Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
    Xiong, Xiong
    Zheng, Kan
    Lei, Lei
    Hou, Lu
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (06) : 1133 - 1146
  • [3] A Computing Offloading Resource Allocation Scheme Using Deep Reinforcement Learning in Mobile Edge Computing Systems
    Li, Xuezhu
    [J]. JOURNAL OF GRID COMPUTING, 2021, 19 (03)
  • [4] A Computing Offloading Resource Allocation Scheme Using Deep Reinforcement Learning in Mobile Edge Computing Systems
    Xuezhu Li
    [J]. Journal of Grid Computing, 2021, 19
  • [5] Blockchain-Based Edge Computing Resource Allocation in IoT: A Deep Reinforcement Learning Approach
    He, Ying
    Wang, Yuhang
    Qiu, Chao
    Lin, Qiuzhen
    Li, Jianqiang
    Ming, Zhong
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) : 2226 - 2237
  • [6] Edge Computing Resource Allocation Algorithm for NB-IoT Based on Deep Reinforcement Learning
    Chu, Jiawen
    Pan, Chunyun
    Wang, Yafei
    Yun, Xiang
    LI, Xuehua
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2023, E106B (05) : 439 - 447
  • [7] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Wang, Jiadai
    Zhao, Lei
    Liu, Jiajia
    Kato, Nei
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (03) : 1529 - 1541
  • [8] Task Offloading and Resource Allocation in IoT Based Mobile Edge Computing Using Deep Learning
    Abdullaev, Ilyos
    Prodanova, Natalia
    Bhaskar, K. Aruna
    Lydia, E. Laxmi
    Kadry, Seifedine
    Kim, Jungeun
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (02): : 1463 - 1477
  • [9] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    [J]. Liu, Jiajia (liujiajia@nwpu.edu.cn), 1600, IEEE Computer Society (09):
  • [10] Deep reinforcement learning for dynamic computation offloading and resource allocation in cache-assisted mobile edge computing systems
    Walmart Inc., Bentonville
    AR
    72716, United States
    不详
    AR
    72701, United States
    [J]. Intell. Converg. Netw, 2020, 2 (181-198): : 181 - 198