Learning Backoff: Deep Reinforcement Learning-Based Wireless Channel Access

被引:0
|
作者
Lee, Taegyeom [1 ]
Jo, Ohyun [1 ]
机构
[1] Chungbuk Natl Univ, Dept Comp Sci, Cheongju 28644, South Korea
来源
IEEE SYSTEMS JOURNAL | 2024年 / 18卷 / 01期
基金
新加坡国家研究基金会;
关键词
Autonomous aerial vehicles; Throughput; Load modeling; Deep learning; Trajectory; Q-learning; Optimization; Autoscheduling; deep reinforcement learning (RL); multiple channel access; unmanned aerial vehicle (UAV);
D O I
10.1109/JSYST.2023.3309977
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicles (UAVs) have been attracting a lot of interest for their significant advantages in terms of mobility and cost. Herein, we address a learning-based channel access method for UAV networks, which is named learning backoff algorithm. The proposed algorithm allows UAVs to determine the adequate backoff time without any information exchanges in distributed network environments. Each UAV in the network learns the network characteristics by analyzing its own location information and the pattern of the network obtained from the received signals. By employing the reinforcement learning (RL) model, UAVs learn repetitive flight patterns and select a proper backoff time to ensure link stability while avoiding collisions. The RL model utilizes a deep learning model and replay memory to handle the large amount of state-action data generated in UAV networks. The proposed algorithm shows promising results as a solution to the channel access problem in UAV networks.
引用
收藏
页码:351 / 354
页数:4
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-Based Enhancement of SATMAC for Reliable Channel Access in VANETs
    Wu, Jingbang
    Yu, Ye
    Guo, Yihan
    Zhou, Shufen
    [J]. 2022 IEEE 10TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATION AND NETWORKS (ICICN 2022), 2022, : 109 - 113
  • [2] Deep Reinforcement Learning-Based Channel Allocation for Wireless LANs with Graph Convolutional Networks
    Nakashima, Kota
    Kamiya, Shotaro
    Ohtsu, Kazuki
    Yamamoto, Koji
    Nishio, Takayuki
    Morikura, Masahiro
    [J]. 2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL), 2019,
  • [3] Deep Reinforcement Learning-Based Channel Allocation for Wireless LANs With Graph Convolutional Networks
    Nakashima, Kota
    Kamiya, Shotaro
    Ohtsu, Kazuki
    Yamamoto, Koji
    Nishio, Takayuki
    Morikura, Masahiro
    [J]. IEEE ACCESS, 2020, 8 : 31823 - 31834
  • [4] Model-Based Deep Reinforcement Learning Framework for Channel Access in Wireless Networks
    Park, Jong In
    Chae, Jun Byung
    Choi, Kae Won
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (06) : 10150 - 10167
  • [5] Deep Reinforcement Learning-Based Edge Caching in Wireless Networks
    Zhong, Chen
    Gursoy, M. Cenk
    Velipasalar, Senem
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2020, 6 (01) : 48 - 61
  • [6] Deep Reinforcement Learning-Based Multichannel Access for Industrial Wireless Networks With Dynamic Multiuser Priority
    Liu, Xiaoyu
    Xu, Chi
    Yu, Haibin
    Zeng, Peng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (10) : 7048 - 7058
  • [7] Deep Reinforcement Learning-based Adaptive Wireless Resource Allocation Algorithm for Heterogeneous Cloud Wireless Access Network
    Chen Qianbin
    Guang Lingjin
    Li Ziyu
    Wang Zhaokun
    Yang Heng
    Tang Lun
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (06) : 1468 - 1477
  • [8] Dynamic Multi-channel Access in Wireless System with Deep Reinforcement Learning
    Li, Fan
    Zhu, Yun
    Xu, Youyun
    [J]. 2020 12TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2020, : 283 - 287
  • [9] Multi-Agent Reinforcement Learning-Based Distributed Channel Access for Next Generation Wireless Networks
    Guo, Ziyang
    Chen, Zhenyu
    Liu, Peng
    Luo, Jianjun
    Yang, Xun
    Sun, Xinghua
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (05) : 1587 - 1599
  • [10] Wireless Access Control in Edge-Aided Disaster Response: A Deep Reinforcement Learning-Based Approach
    Zhou, Hang
    Wang, Xiaoyan
    Umehira, Masahiro
    Chen, Xianfu
    Wu, Celimuge
    Ji, Yusheng
    [J]. IEEE ACCESS, 2021, 9 : 46600 - 46611