A Lightweight Decentralized Reinforcement Learning Based Channel Selection Approach for High-Density LoRaWAN

被引:6
|
作者
Li, Aohan [1 ]
Fujisawa, Minoru [1 ]
Urabe, Ikumi [1 ]
Kitagawa, Ryoma [1 ]
Kim, Song-Ju [2 ,3 ]
Hasegawa, Mikio [1 ]
机构
[1] Tokyo Univ Sci, Dept Elect Engn, Tokyo, Japan
[2] SOBIN Inst LLC, Kawanishi, Japan
[3] Keio Univ, Grad Sch Media & Governance, Yokohama, Kanagawa, Japan
来源
2021 IEEE INTERNATIONAL SYMPOSIUM ON DYNAMIC SPECTRUM ACCESS NETWORKS (DYSPAN) | 2021年
关键词
IoT; LoRaWAN; Lightweight Decentralized; Reinforcement Learning; Dynamic Spectrum Access; Channel Selection; INTERNET;
D O I
10.1109/DySPAN53946.2021.9677146
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is predicted that the number of IoT devices will reach 125 billion by 2030. The collisions among IoT devices will increase as the number of devices grows, which will reduce the communication performance of the IoT systems. To avoid collisions among high-density IoT devices, some researchers studied the solutions to adapt communication parameters of devices including channels to the environment. However, most of them are difficult to be applied to IoT devices with limited memory and computational ability. To solve the disadvantages of the existing work, we propose a lightweight decentralized reinforcement learning-based channel selection approach for high-density IoT systems in this paper. In our proposed approach, IoT devices can select appropriate channels only based on Acknowledge (ACK) information to avoid collisions among IoT devices with low computational complexity and memory requirement. Performance in terms of frame success rate (FSR) is evaluated by experiments using LoRa devices in the real world. Experimental results show that our proposed approach can efficiently avoid collisions in high-density LoRaWAN both with and without varying available channels compared to other lightweight reinforcement learning-based channel selection approaches.
引用
收藏
页码:9 / 14
页数:6
相关论文
共 50 条
  • [11] Detecting Communities in Networks: a Decentralized Approach Based on Multiagent Reinforcement Learning
    Paim, Eduardo C.
    Bazzan, Ana L. C.
    Chira, Camelia
    2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2020, : 2225 - 2232
  • [12] A Fast and Efficient Approach for Genomic Selection with High-Density Markers
    Pungpapong, Vitara
    Muir, William M.
    Li, Xianran
    Zhang, Dabao
    Zhang, Min
    G3-GENES GENOMES GENETICS, 2012, 2 (10): : 1179 - 1184
  • [13] Lightweight sCMOS-based high-density diffuse optical tomography
    Bergonzi, Karla M.
    Burns-Yocum, Tracy M.
    Bumstead, Jonathan R.
    Buckley, Elise M.
    Mannion, Patrick C.
    Tracy, Christopher H.
    Mennerick, Eli
    Ferradal, Silvina L.
    Dehghani, Hamid
    Eggebrecht, Adam T.
    Culver, Joseph P.
    NEUROPHOTONICS, 2018, 5 (03)
  • [14] Reinforcement Learning-Based Multihop Relaying: A Decentralized Q-Learning Approach
    Wang, Xiaowei
    Wang, Xin
    ENTROPY, 2021, 23 (10)
  • [15] Frequency Hopping Scheduling Algorithm in Green LoRaWAN: Reinforcement Learning Approach
    Mhatre, Jui
    Lee, Ahyoung
    Lee, Hoseon
    2023 IEEE CONFERENCE ON STANDARDS FOR COMMUNICATIONS AND NETWORKING, CSCN, 2023, : 216 - 221
  • [16] Intercell Interference Management in OFDMA Networks: A Decentralized Approach Based on Reinforcement Learning
    Bernardo, F.
    Agusti, R.
    Perez-Romero, J.
    Sallent, O.
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2011, 41 (06): : 968 - 976
  • [17] Decentralized Reinforcement Learning Based MAC Optimization
    Nisioti, Eleni
    Thomos, Nikolaos
    2018 IEEE 29TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2018,
  • [18] Autonomous Separation Assurance in An High-Density En Route Sector: A Deep Multi-Agent Reinforcement Learning Approach
    Brittain, Marc
    Wei, Peng
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 3256 - 3262
  • [19] Lightweight Automatic Modulation Classification Based on Decentralized Learning
    Fu, Xue
    Gui, Guan
    Wang, Yu
    Ohtsuki, Tomoaki
    Adebisi, Bamidele
    Gacanin, Haris
    Adachi, Fumiyuki
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (01) : 57 - 70
  • [20] JOINT TRANSACTION TRANSMISSION AND CHANNEL SELECTION IN COGNITIVE RADIO BASED BLOCKCHAIN NETWORKS: A DEEP REINFORCEMENT LEARNING APPROACH
    Nguyen Cong Luong
    Tran The Anh
    Huynh Thi Thanh Binh
    Niyato, Dusit
    Kim, Dong In
    Liang, Ying-Chang
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8409 - 8413