Smart Power Control for Quality-Driven Multi-User Video Transmissions: A Deep Reinforcement Learning Approach

被引:0
|
作者
Zhang, Ticao [1 ]
Mao, Shiwen [1 ]
机构
[1] Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA
来源
IEEE ACCESS | 2020年 / 8卷
关键词
Multi-user video transmission; multi-agent deep reinforcement learning; power control; quality of experience; LAYER RESOURCE-ALLOCATION; SCALABLE VIDEO; NETWORKS; COMMUNICATION; MANAGEMENT; FAIRNESS; SYSTEMS; ACCESS;
D O I
10.1109/ACCESS.2019.2961914
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Device-to-device (D2D) communications have been regarded as a promising technology to meet the dramatically increasing video data demand in the 5G network. In this paper, we consider the power control problem in a multi-user video transmission system. Due to the non-convex nature of the optimization problem, it is challenging to obtain an optimal strategy. In addition, many existing solutions require instantaneous channel state information (CSI) for each link, which is hard to obtain in resource-limited wireless networks. We developed a multi-agent deep reinforcement learning-based power control method, where each agent adaptively controls its transmit power based on the observed local states. The proposed method aims to maximize the average quality of received videos of all users while satisfying the quality requirement of each user. After off-line training, the method can be distributedly implemented such that all the users can achieve their target state from any initial state. Compared with conventional optimization based approach, the proposed method is model-free, does not require CSI, and is scalable to large networks.
引用
收藏
页码:611 / 622
页数:12
相关论文
共 50 条
  • [21] Multi-user Edge-assisted Video Analytics Task Offloading Game based on Deep Reinforcement Learning
    Chen, Yu
    Zhang, Sheng
    Xiao, Mingjun
    Qian, Zhuzhong
    Wu, Jie
    Lu, Sanglu
    [J]. 2020 IEEE 26TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2020, : 266 - 273
  • [22] A Reinforcement Learning Approach to Age of Information in Multi-User Networks With HARQ
    Ceran, Elif Tugce
    Gunduz, Deniz
    Gyorgy, Andras
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (05) : 1412 - 1426
  • [23] Resource Allocation in Multi-User Cellular Networks: A Transformer-Based Deep Reinforcement Learning Approach
    Di, Zhao
    Zhong, Zheng
    Pengfei, Qin
    Hao, Qin
    Bin, Song
    [J]. CHINA COMMUNICATIONS, 2024, 21 (05) : 77 - 96
  • [24] Resource Allocation in Multi-User Cellular Networks: A Transformer-Based Deep Reinforcement Learning Approach
    Zhao Di
    Zheng Zhong
    Qin Pengfei
    Qin Hao
    Song Bin
    [J]. China Communications, 2024, 21 (05) : 77 - 96
  • [25] Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning
    Liu, Shuai
    He, Jing
    Wu, Jiayun
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (04): : 1 - 16
  • [26] Deep Reinforcement Learning Based Multi-User Anti-Jamming Strategy
    Bi, Yue
    Wu, Yue
    Hua, Cunqing
    [J]. IEEE International Conference on Communications, 2019, 2019-May
  • [27] Wireless Channel Prediction for Multi-user Physical Layer with Deep Reinforcement Learning
    Chu, Man
    Liu, An
    Jiang, Chen
    Vincent, K.
    Lau, N.
    Yang, Tingting
    [J]. 2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [28] Multi-User Delay-Constrained Scheduling With Deep Recurrent Reinforcement Learning
    Hu, Pihe
    Chen, Yu
    Pan, Ling
    Fang, Zhixuan
    Xiao, Fu
    Huang, Longbo
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (03) : 2344 - 2359
  • [29] Inverse Reinforcement Learning Meets Power Allocation in Multi-user Cellular Networks
    Zhang, Ruichen
    Xiong, Ke
    Tian, Xingcong
    Lu, Yang
    Fan, Pingyi
    Ben Letaief, Khaled
    [J]. IEEE INFOCOM 2022 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2022,
  • [30] Multi-agent deep reinforcement learning (MADRL) meets multi-user MIMO systems
    Lee, Heunchul
    Jeong, Jaeseong
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,