Multi-Agent Deep Reinforcement Learning-Based Fine-Grained Traffic Scheduling in Data Center Networks

被引:0
|
作者
Wang, Huiting [1 ]
Liu, Yazhi [1 ]
Li, Wei [1 ]
Yang, Zhigang [2 ]
机构
[1] North China Univ Sci & Technol, Coll Artificial Intelligence, Tangshan 063210, Peoples R China
[2] North China Univ Sci & Technol, Coll Elect Engn, Tangshan 063210, Peoples R China
关键词
data center network; traffic scheduling; multi-agent deep reinforcement learning; in-band network telemetry; programmable data plane;
D O I
10.3390/fi16040119
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In data center networks, when facing challenges such as traffic volatility, low resource utilization, and the difficulty of a single traffic scheduling strategy to meet demands, it is necessary to introduce intelligent traffic scheduling mechanisms to improve network resource utilization, optimize network performance, and adapt to the traffic scheduling requirements in a dynamic environment. This paper proposes a fine-grained traffic scheduling scheme based on multi-agent deep reinforcement learning (MAFS). This approach utilizes In-Band Network Telemetry to collect real-time network states on the programmable data plane, establishes the mapping relationship between real-time network state information and the forwarding efficiency on the control plane, and designs a multi-agent deep reinforcement learning algorithm to calculate the optimal routing strategy under the current network state. The experimental results demonstrate that compared to other traffic scheduling methods, MAFS can effectively enhance network throughput. It achieves a 1.2x better average throughput and achieves a 1.4-1.7x lower packet loss rate.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Multi-Agent Reinforcement Learning-Based Fairness-Aware Scheduling for Bursty Traffic
    Yuan, Mingqi
    Cao, Qi
    Pun, Man-On
    Chen, Yi
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [2] Deep reinforcement learning based multi-layered traffic scheduling scheme in data center networks
    Wu, Guihua
    [J]. WIRELESS NETWORKS, 2024, 30 (05) : 4133 - 4144
  • [3] Multi-agent Reinforcement Learning-based Adaptive Heterogeneous DAG Scheduling
    Zhadan, Anastasia
    Allahverdyan, Alexander
    Kondratov, Ivan
    Mikheev, Vikenty
    Petrosian, Ovanes
    Romanovskii, Aleksei
    Kharin, Vitaliy
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (05)
  • [4] Satellite Network Traffic Scheduling Algorithm Based on Multi-Agent Reinforcement Learning
    Zhang, Tingting
    Zhang, Mingqi
    Yang, Lintao
    Dong, Tao
    Yin, Jie
    Liu, Zhihui
    Wu, Jing
    Jiang, Hao
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 761 - 768
  • [5] A Multi-Agent Deep Reinforcement Learning-Based Popular Content Distribution Scheme in Vehicular Networks
    Chen, Wenwei
    Huang, Xiujie
    Guan, Quanlong
    Zhao, Shancheng
    [J]. ENTROPY, 2023, 25 (05)
  • [6] Multi-agent Deep Reinforcement Learning-Based Content Caching in Cache-Enabled Networks
    Liu, Sai
    Chen, Jia
    Gao, Deyun
    Yang, Meiyi
    Ma, Junfeng
    [J]. EMERGING NETWORKING ARCHITECTURE AND TECHNOLOGIES, ICENAT 2022, 2023, 1696 : 146 - 157
  • [7] Real-time production scheduling using a deep reinforcement learning-based multi-agent approach
    Taghipour, Sharareh
    Namoura, Hamed A.
    Sharifi, Mani
    Ghaleb, Mageed
    [J]. INFOR, 2024, 62 (02) : 186 - 210
  • [8] Multi-Agent Reinforcement Learning-Based Resource Allocation for UAV Networks
    Cui, Jingjing
    Liu, Yuanwei
    Nallanathan, Arumugam
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (02) : 729 - 743
  • [9] On the Efficacy of Fine-Grained Traffic Splitting Protocols in Data Center Networks
    Dixit, Advait
    Prakash, Pawan
    Kompella, Ramana Rao
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2011, 41 (04) : 430 - 431
  • [10] Reinforcement learning-based multi-agent system for network traffic signal control
    Arel, I.
    Liu, C.
    Urbanik, T.
    Kohls, A. G.
    [J]. IET INTELLIGENT TRANSPORT SYSTEMS, 2010, 4 (02) : 128 - 135