Dynamic Resource Configuration for Low-Power IoT Networks: A Multi-Objective Reinforcement Learning Method

被引:13
|
作者
Huang, Yang [1 ,2 ]
Hao, Caiyong [3 ,4 ]
Mao, Yijie [5 ]
Zhou, Fuhui [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Minist Ind & Informat Technol, Key Lab Dynam Cognit Syst Electromagnet Spectrum, Nanjing 210016, Peoples R China
[2] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210016, Peoples R China
[3] Shenzhen Stn State Radio Monitoring Ctr, Shenzhen 518000, Peoples R China
[4] Wuhan Univ, Sch Elect Informat, Wuhan 430072, Peoples R China
[5] Imperial Coll London, Dept Elect & Elect Engn, London SW7 2AZ, England
关键词
The IoT networks; multi-objective reinforcement learning; grant-free; spectrum sharing;
D O I
10.1109/LCOMM.2021.3074756
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Considering grant-free transmissions in low-power IoT networks with unknown time-frequency distribution of interference, we address the problem of Dynamic Resource Configuration (DRC), which amounts to a Markov decision process. Unfortunately, off-the-shelf methods based on single-objective reinforcement learning cannot guarantee energy-efficient transmission, especially when all frequency-domain channels in a time interval are interfered. Therefore, we propose a novel DRC scheme where configuration policies are optimized with a Multi-Objective Reinforcement Learning (MORL) framework. Numerical results show that the average decision error rate achieved by the MORL-based DRC can be even less than 12% of that yielded by the conventional R-learning-based approach.
引用
收藏
页码:2285 / 2289
页数:5
相关论文
共 50 条
  • [1] Multi-Objective Resource Scheduling for IoT Systems Using Reinforcement Learning
    Shresthamali, Shaswot
    Kondo, Masaaki
    Nakamura, Hiroshi
    [J]. JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS, 2022, 12 (04)
  • [2] Leveraging Reinforcement Learning for Adaptive Monitoring of Low-Power IoT Networks
    Frikha, Mohamed Said
    Lahmadi, Abdelkader
    Gammar, Sonia Mettali
    Andrey, Laurent
    [J]. 2020 16TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS (WIMOB), 2020,
  • [3] A Dynamic Resource Allocation Strategy with Reinforcement Learning for Multimodal Multi-objective Optimization
    Qian-Long Dang
    Wei Xu
    Yang-Fei Yuan
    [J]. Machine Intelligence Research, 2022, (02) : 138 - 152
  • [4] A Dynamic Resource Allocation Strategy with Reinforcement Learning for Multimodal Multi-objective Optimization
    Dang, Qian-Long
    Xu, Wei
    Yuan, Yang-Fei
    [J]. MACHINE INTELLIGENCE RESEARCH, 2022, 19 (02) : 138 - 152
  • [5] A Dynamic Resource Allocation Strategy with Reinforcement Learning for Multimodal Multi-objective Optimization
    Qian-Long Dang
    Wei Xu
    Yang-Fei Yuan
    [J]. Machine Intelligence Research, 2022, 19 : 138 - 152
  • [6] Multi-Objective Task Allocation for Dynamic IoT Networks
    Weikert, Dominik
    Steup, Christoph
    Mostaghim, Sanaz
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON OMNI-LAYER INTELLIGENT SYSTEMS (IEEE COINS 2022), 2022, : 343 - 347
  • [7] Learning-Based Resource Management for Low-Power and Lossy IoT Networks
    Musaddiq, Arslan
    Ali, Rashid
    Kim, Sung Won
    Kim, Dong-Seong
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (17): : 16006 - 16016
  • [8] Multi-Objective Routing and Resource Allocation Based on Reinforcement Learning in Optical Transport Networks
    Li, Xin
    Zhao, Yongli
    Li, Yajie
    Rahman, Sabidur
    Wang, Feng
    Li, Xinghua
    Zhang, Jie
    [J]. 2020 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP) AND INTERNATIONAL CONFERENCE ON INFORMATION PHOTONICS AND OPTICAL COMMUNICATIONS (IPOC), 2020,
  • [9] Dynamic Weights in Multi-Objective Deep Reinforcement Learning
    Abels, Axel
    Roijers, Diederik M.
    Lenaerts, Tom
    Nowe, Ann
    Steckelmacher, Denis
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [10] A reinforcement learning approach for dynamic multi-objective optimization
    Zou, Fei
    Yen, Gary G.
    Tang, Lixin
    Wang, Chunfeng
    [J]. INFORMATION SCIENCES, 2021, 546 : 815 - 834