Optimal Computation Offloading in Collaborative LEO-IoT Enabled MEC: A Multiagent Deep Reinforcement Learning Approach

被引:22
|
作者
Lyu, Yifeng [1 ]
Liu, Zhi [2 ]
Fan, Rongfei [3 ]
Zhan, Cheng [4 ]
Hu, Han [1 ]
An, Jianping [3 ]
机构
[1] Beijing Inst Technol, Sch Informat & Electr, Beijing 100081, Peoples R China
[2] Univ Electrocommun, Grad Sch Informat & Engn, Tokyo 1828585, Japan
[3] Beijing Inst Technol, Sch Cyberspace Sci & Technol, Beijing 100081, Peoples R China
[4] Southwest Univ, Sch Comp & Informat Sci, Chongqing 400715, Peoples R China
基金
中国国家自然科学基金;
关键词
LEO-IoT; mobile-edge computing; data offloading; resource allocation; reinforcement learning; RESOURCE-ALLOCATION; MANAGEMENT; 5G; INTERNET;
D O I
10.1109/TGCN.2022.3186792
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Recently, Low Earth Orbit (LEO) satellite-based Internet of Things (LEO-IoT) becomes attractive for computation offloading in mobile-edge computing (MEC) since it can overcome terrain obstacles, such as in depopulated villages and disaster sites. However, it is extremely hard to allocate bandwidth and power resources jointly with multiple users and satellites. In this paper, we study offloading in collaborative LEO-IoT where satellites forward data from users to the MEC server, with the goal of making offloading fast and energy efficient. To achieve this goal, we first define the data offloading in collaborative LEO-IoT as an optimization problem with resource constraints. Then we formulate the optimization problem as a Partially Observable Markov Decision Processes (POMDP), which differs from the existing Markov Decision Processes (MDP) work for the offloading scenario. We further propose a novel Multi-Agent Information Broadcasting and Judging (MAIBJ) algorithm to allocate resources in a collaborative manner. Finally, extensive experiments are conducted with various configurations and the results show that MAIBJ can shorten at least 33% of transmission latency and save at least 42% of energy consumption compared with several baseline algorithms.
引用
收藏
页码:996 / 1011
页数:16
相关论文
共 50 条
  • [1] Multiagent Deep Reinforcement Learning for Vehicular Computation Offloading in IoT
    Zhu, Xiaoyu
    Luo, Yueyi
    Liu, Anfeng
    Bhuiyan, Md Zakirul Alam
    Zhang, Shaobo
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (12) : 9763 - 9773
  • [2] Computation Offloading and Trajectory Planning of Multi-UAV-Enabled MEC: A Knowledge-Assisted Multiagent Reinforcement Learning Approach
    Li, Xulong
    Qin, Yunhui
    Huo, Jiahao
    Wei, Huangfu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 7077 - 7088
  • [3] A deep reinforcement approach for computation offloading in MEC dynamic networks
    Fan, Yibiao
    Cai, Xiaowei
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2024, 2024 (01)
  • [4] Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach
    Shang, Ce
    Sun, Yan
    Luo, Hong
    Guizani, Mohsen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (17) : 15464 - 15476
  • [5] Deep Reinforcement Learning based Computation Offloading and Resource Allocation for MEC
    Li, Ji
    Gao, Hui
    Lv, Tiejun
    Lu, Yueming
    [J]. 2018 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2018,
  • [6] Decentralized Computation Offloading and Resource Allocation in MEC by Deep Reinforcement Learning
    Liang, Yeteng
    He, Yejun
    Zhong, Xiaoxu
    [J]. 2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 244 - 249
  • [7] Collaborative Computation Offloading Scheme Based on Deep Reinforcement Learning
    Park, Jinho
    Chung, Kwangsue
    [J]. 2023 INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN, 2023, : 110 - 115
  • [8] Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning Approach
    Seid, Abegaz Mohammed
    Boateng, Gordon Owusu
    Anokye, Stephen
    Kwantwi, Thomas
    Sun, Guolin
    Liu, Guisong
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (15) : 12203 - 12218
  • [9] Deep Reinforcement Learning for Collaborative Computation Offloading on Internet of Vehicles
    Li, Yureng
    Xu, Shouzhi
    Li, Dawei
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [10] Deep reinforcement learning approach for computation offloading in blockchain-enabled communications systems
    Alam, Tanweer
    Ullah, Arif
    Benaida, Mohamed
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 14 (8) : 9959 - 9972