A Lightweight Decentralized Reinforcement Learning Based Channel Selection Approach for High-Density LoRaWAN

被引:6
|
作者
Li, Aohan [1 ]
Fujisawa, Minoru [1 ]
Urabe, Ikumi [1 ]
Kitagawa, Ryoma [1 ]
Kim, Song-Ju [2 ,3 ]
Hasegawa, Mikio [1 ]
机构
[1] Tokyo Univ Sci, Dept Elect Engn, Tokyo, Japan
[2] SOBIN Inst LLC, Kawanishi, Japan
[3] Keio Univ, Grad Sch Media & Governance, Yokohama, Kanagawa, Japan
来源
2021 IEEE INTERNATIONAL SYMPOSIUM ON DYNAMIC SPECTRUM ACCESS NETWORKS (DYSPAN) | 2021年
关键词
IoT; LoRaWAN; Lightweight Decentralized; Reinforcement Learning; Dynamic Spectrum Access; Channel Selection; INTERNET;
D O I
10.1109/DySPAN53946.2021.9677146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is predicted that the number of IoT devices will reach 125 billion by 2030. The collisions among IoT devices will increase as the number of devices grows, which will reduce the communication performance of the IoT systems. To avoid collisions among high-density IoT devices, some researchers studied the solutions to adapt communication parameters of devices including channels to the environment. However, most of them are difficult to be applied to IoT devices with limited memory and computational ability. To solve the disadvantages of the existing work, we propose a lightweight decentralized reinforcement learning-based channel selection approach for high-density IoT systems in this paper. In our proposed approach, IoT devices can select appropriate channels only based on Acknowledge (ACK) information to avoid collisions among IoT devices with low computational complexity and memory requirement. Performance in terms of frame success rate (FSR) is evaluated by experiments using LoRa devices in the real world. Experimental results show that our proposed approach can efficiently avoid collisions in high-density LoRaWAN both with and without varying available channels compared to other lightweight reinforcement learning-based channel selection approaches.
引用
收藏
页码:9 / 14
页数:6
相关论文
共 50 条
  • [41] Joint relay and channel selection against mobile and smart jammer: A deep reinforcement learning approach
    Yuan, Hongcheng
    Song, Fei
    Chu, Xiaojing
    Li, Wen
    Wang, Ximing
    Han, Hao
    Gong, Yuping
    IET COMMUNICATIONS, 2021, 15 (17) : 2237 - 2251
  • [42] Deep Learning-Based Channel Adaptive Resource Allocation in LoRaWAN
    Farhad, Arshad
    Kim, Dae-Ho
    Yoon, Jeong-Sun
    Pyun, Jae-Young
    2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2022,
  • [43] A Study on Cooperative Action Selection Considering Unfairness in Decentralized Multiagent Reinforcement Learning
    Matsui, Toshihiro
    Matsuo, Hiroshi
    ICAART: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL 1, 2017, : 88 - 95
  • [44] Decentralized Cluster Head Selection in IoV using Federated Deep Reinforcement Learning
    Scott, Chandler
    Khan, Mohammad S.
    Paranjothi, Anirudh
    Li, Joshua Qiang
    2024 IEEE 21ST CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2024,
  • [45] Reducing calibration effort for clonal selection based algorithms: A reinforcement learning approach
    Cristina Riff, Maria
    Montero, Elizabeth
    Neveu, Bertrand
    KNOWLEDGE-BASED SYSTEMS, 2013, 41 : 54 - 67
  • [46] A Deep Reinforcement Learning Based Approach for Intelligent Reconfigurable Surface Elements Selection
    Zan, Shiming
    Pang, Yu
    Gravina, Raffaele
    Cao, Enling
    Li, Ye
    Zang, Weilin
    2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 56 - 62
  • [47] Cork waste valorization as reinforcement in high-density polyethylene matrix
    Dairi, Badrina
    Bellili, Nadira
    Hamour, Noura
    Boulassel, Amel
    Djidjelli, Hocine
    Boukerrou, Amar
    Bendib, Riab
    MATERIALS TODAY-PROCEEDINGS, 2022, 53 : 117 - 122
  • [48] Formation Tracking of Spatiotemporal Multiagent Systems: A Decentralized Reinforcement Learning Approach
    Liu, Tianrun
    Chen, Yang-Yang
    IEEE SYSTEMS MAN AND CYBERNETICS MAGAZINE, 2024, 10 (04): : 52 - 60
  • [49] Mean-Field Multiagent Reinforcement Learning: A Decentralized Network Approach
    Gu, Haotian
    Guo, Xin
    Wei, Xiaoli
    Xu, Renyuan
    MATHEMATICS OF OPERATIONS RESEARCH, 2025, 50 (01) : 506 - 536
  • [50] An Approach to Hierarchical Deep Reinforcement Learning for a Decentralized Walking Control Architecture
    Schilling, Malte
    Melnik, Andrew
    BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES 2018, 2019, 848 : 272 - 282