Toward Reinforcement-Learning-Based Intelligent Network Control in 6G Networks

被引:1
|
作者
Li, Junling [1 ]
Wu, Huaqing [2 ]
Huang, Xi [3 ]
Huang, Qisheng [5 ]
Huang, Jianwei [3 ,4 ]
Shen, Xuemin [6 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing, Peoples R China
[2] Univ Calgary, Dept Elect & Software Engn, Calgary, AB, Canada
[3] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Peoples R China
[4] Chinese Univ Hong Kong, Shenzhen, Peoples R China
[5] Harbin Inst Technol, Shenzhen, Peoples R China
[6] Univ Waterloo, Dept Elect & Comp Engn, Waterloo, ON, Canada
来源
IEEE NETWORK | 2023年 / 37卷 / 04期
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
6G mobile communication; Intelligent networks; Cross layer design; Power system management; Power system dynamics; Reinforcement learning; User experience; Machine learning;
D O I
10.1109/MNET.003.2200641
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Reinforcement learning (RL) is a critical enabler for optimizing performance, automating the deployment, and increasing the intelligence level of 6G networks. In this article, we first identify some advanced RL frameworks for diversified 6G service scenarios. We then envision RL-based intelligent network management for 6G from three different perspectives: cross-layer end-to-end network control for service-oriented software-defined networking (SOSDN), cross-network control for global coverage, and cross-service control for service customization. We also present the new challenges associated with RL-assisted network management in 6G networks and provide potential research directions. Finally, we use the smart grid as a typical 6G application scenario to demonstrate the critical role of RL-based methods in capacitating intelligent power system management.
引用
收藏
页码:104 / 111
页数:8
相关论文
共 50 条
  • [41] Intelligent decision making framework for 6G network
    Hu, Zheng
    Zhang, Ping
    Zhang, Chunhong
    Zhuang, Benhui
    Zhang, Jianhua
    Lin, Shangjing
    Sun, Tao
    [J]. CHINA COMMUNICATIONS, 2022, 19 (03) : 16 - 35
  • [42] Distributed GAN: Toward a Faster Reinforcement-Learning-Based Architecture Search
    Shi, Jiachen
    Fan, Yi
    Zhou, Guoqiang
    Shen, Jun
    [J]. IEEE Transactions on Artificial Intelligence, 2022, 3 (03): : 391 - 401
  • [43] Evolved Prevention Strategies for 6G Networks Through Stochastic Games and Reinforcement Learning
    Figetakis, Emanuel
    Hussein, Ahmed Refaey
    Ulema, Mehmet
    [J]. IEEE Networking Letters, 2023, 5 (03): : 164 - 168
  • [44] Reinforcement-Learning-Based Intelligent Maximum Power Point Tracking Control for Wind Energy Conversion Systems
    Wei, Chun
    Zhang, Zhe
    Qiao, Wei
    Qu, Liyan
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2015, 62 (10) : 6360 - 6370
  • [45] Operational Safe Control for Reinforcement-Learning-Based Robot Autonomy
    Zhou, Xu
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4091 - 4095
  • [46] Reinforcement-Learning-Based Job-Shop Scheduling for Intelligent Intersection Management
    Huang, Shao-Ching
    Lin, Kai-En
    Kuo, Cheng-Yen
    Lin, Li-Heng
    Sayin, Muhammed O.
    Lin, Chung-Wei
    [J]. 2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
  • [47] Survey on Machine Learning for Intelligent End-to-End Communication Toward 6G: From Network Access, Routing to Traffic Control and Streaming Adaption
    Tang, Fengxiao
    Mao, Bomin
    Kawamoto, Yuichi
    Kato, Nei
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2021, 23 (03): : 1578 - 1598
  • [48] Spectrum-Learning-Aided Reconfigurable Intelligent Surfaces for "Green" 6G Networks
    Yang, Bo
    Cao, Xuelin
    Huang, Chongwen
    Guan, Yong Liang
    Yuen, Chau
    Di Renzo, Marco
    Niyato, Dusit
    Debbah, Merouane
    Hanzo, Lajos
    [J]. IEEE NETWORK, 2021, 35 (06): : 20 - 26
  • [49] Digital Twin for Open RAN: Toward Intelligent and Resilient 6G Radio Access Networks
    Masaracchia, Antonino
    Sharma, Vishal
    Fahim, Muhammad
    Dobre, Octavia A.
    Duong, Trung Q.
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2023, 61 (11) : 112 - 118
  • [50] Toward Intelligent and Efficient 6G Networks: JCSC Enabled On-Purpose Machine Communications
    Zhang, Ping
    Yang, Heng
    Feng, Zhiyong
    Cui, Yanpeng
    Dai, Jincheng
    Qin, Xiaoqi
    Li, Jinglin
    Zhang, Qixun
    [J]. IEEE WIRELESS COMMUNICATIONS, 2023, 30 (01) : 150 - 157