Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning

被引:1
|
作者
Xu, Chen [1 ]
Wang, Jian [1 ]
Yu, Tianhang [1 ]
Kong, Chuili [1 ]
Huangfu, Yourui [1 ]
Li, Rong [1 ]
Ge, Yiqun [2 ]
Wang, Jun [1 ]
机构
[1] Huawei Technol, Wireless Technol Lab, Hangzhou, Peoples R China
[2] Huawei Technol, Wireless Technol Lab, Ottawa, ON, Canada
关键词
radio resource scheduling; deep reinforcement learning; cellular networks; multi-objective optimization;
D O I
10.1109/wcnc45663.2020.9120729
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore the solution space. A deep reinforcement learning (DRL) framework with Advantage actor-critic (A2C) algorithm is proposed for the optimization problem. Several methods have been utilized in the framework to improve the sampling and training efficiency and to adapt the algorithm to a specific scheduling problem. Numerical results show that DRL outperforms the baseline algorithm and achieves similar performance as genie-aided methods without using the future information.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Buffer-Aware Streaming in Small-Scale Wireless Networks: A Deep Reinforcement Learning Approach
    Guo, Yashuang
    Yu, F. Richard
    An, Jianping
    Yang, Kai
    He, Ying
    Leung, Victor C. M.
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (07) : 6891 - 6902
  • [2] Buffer-Aware Network Coding for Wireless Networks
    Chen, Wei
    Letaief, Khaled B.
    Cao, Zhigang
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2012, 20 (05) : 1389 - 1401
  • [3] Buffer-aware and traffic-dependent packet scheduling in wireless OFDM networks
    Huang, Jinri
    Niu, Zhisheng
    [J]. 2007 IEEE WIRELESS COMMUNICATIONS & NETWORKING CONFERENCE, VOLS 1-9, 2007, : 1556 - 1560
  • [4] Buffer-Aware Packet Scheduling in Downlink Multiuser Systems
    Wang, Yufeng
    Yue, Guosen
    Rangarajan, Sampath
    Sankar, Ravi
    Morgera, Salvatore
    [J]. 2013 IEEE 24TH INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2013, : 1495 - 1500
  • [5] Channel-Adapted and Buffer-Aware Packet Scheduling in LTE Wireless Communication System
    Lin, Yan
    Yue, Guangxin
    [J]. 2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, : 122 - 125
  • [6] Buffer-Aware Opportunistic Routing for Wireless Sensor Networks
    Cui, Wenyang
    Yao, Ye
    Song, Liang
    [J]. 2017 14TH IEEE ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2017, : 268 - 271
  • [7] Delay-Optimal Buffer-Aware Scheduling With Adaptive Transmission
    Chen, Xiang
    Chen, Wei
    Lee, Joohyun
    Shroff, Ness B.
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2017, 65 (07) : 2917 - 2930
  • [8] Delay-Optimal Buffer-Aware Probabilistic Scheduling with Adaptive Transmission
    Chen, Xiang
    Chen, Wei
    [J]. 2015 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2015,
  • [9] Buffer-Aware Packet Scheduling in Multi-Flow Carrier Aggregation
    Alorainy, Abdulaziz
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [10] Forwarding efficiency aware traffic scheduling algorithm based on deep reinforcement learning
    Sha, Zongxuan
    Huo, Ru
    Sun, Chuang
    Wang, Shuo
    Huang, Tao
    [J]. Tongxin Xuebao/Journal on Communications, 2022, 43 (08): : 30 - 40