Intelligent multipath congestion control algorithm based on subflow coupling perception

被引:0
|
作者
Xu, Yanyan [1 ]
Wang, Bingqi [1 ]
Pan, Shaoming [1 ]
Chen, Shihe [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430072, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Congestion control; Subflow coupling; Deep reinforcement Learning; Heterogeneous wireless network; TCP; BBR;
D O I
10.1007/s10586-024-04939-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multiple network interfaces equipped with terminal nodes in heterogeneous wireless networks can be used for multi-path transmission, transmitting data in parallel to improve the throughput of network communication, as well as the stability and resilience of the connection. However, existing multipath congestion control algorithms have difficulty in dealing dynamic changing network environments and ignore the subflow coupling feature, resulting in problems such as underutilization of multipath resources and transmission fairness. To address these challenges, we propose a novel multi-path intelligent congestion control algorithm based on subflow coupling perception (MSCP), which utilizes deep reinforcement learning (DRL) techniques to improve the adaptability to dynamic network environments. The subflow coupling features are perceived through the analysis of trends in subflow transmission round-trip time. To further refine this understanding, Long Short-Term Memory (LSTM) is utilized to eliminate network noise and extract the latent temporal information inherent in subflow states. By providing a more precise estimation of network conditions, this approach enhances the ability of DRL agents to learn more effectively from their interactions with the environment. Proximal Policy Optimization (PPO) algorithm is combined with Coupled Bottleneck Bandwidth and Round-trip propagation time (Coupled BBR) multipath congestion control algorithm, where the transmission gain coefficients of each subflow is adaptively adjusted using PPO agents to control the transmission rate of each subflows, improving the algorithm's responsiveness to dynamic network environments. Experimental results show that the proposed algorithm effectively utilizes link resources, leading to significant improvements in both transmission throughput and transmission fairness.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] BBR Congestion Control Analysis with Multipath TCP (MPTCP) and Asymmetrical Latency Subflow
    Austria, Phillipe
    Park, Chol Hyun
    Jo, Ju-Yeon
    Kim, Yoohwan
    Sundaresan, Rahul
    Pham, Khanh
    2022 IEEE 12TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2022, : 1065 - 1069
  • [2] Multipath congestion control algorithm based on link capacity
    Wang Z.
    Yuan Q.
    Hao F.
    Fang L.
    Li F.
    Tongxin Xuebao/Journal on Communications, 2020, 41 (05): : 59 - 71
  • [3] A Fairness-based Congestion Control Algorithm for Multipath TCP
    Melki, Reem
    Mansour, Mohammad M.
    Chehab, Ali
    2018 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2018,
  • [4] Dynamic Window Coupling for Multipath Congestion Control
    Hassayoun, Sofiane
    Iyengar, Janardhan
    Ros, David
    2011 19TH IEEE INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS (ICNP), 2011,
  • [5] Breaking the Inertial Thinking: Non-Blocking Multipath Congestion Control Based on the Single-Subflow Reinforcement Learning Model
    Wei, Dehui
    Zhang, Jiao
    Li, Haozhe
    Liu, Yuanjie
    Zhang, Xuan
    Pan, Tian
    Huang, Tao
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (03): : 2876 - 2887
  • [6] An Implementation of Adaptive Multipath Routing Algorithm for congestion control
    Chaitanya, N. Krishna
    Varadarajan, S.
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2016, 16 (02): : 6 - 9
  • [7] Dynamic Congestion Control Algorithm for Multipath Transport Protocols
    Lubna, Tabassum
    Mahmud, Imtiaz
    Cho, You-Ze
    2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2018, : 672 - 674
  • [8] Intelligent scheduling algorithm based on the flow balance control of multipath network
    Qian, Yi
    Li, Zuxin
    MODERN COMPUTER SCIENCE AND APPLICATIONS (MCSA 2016), 2016, : 37 - 45
  • [9] Congestion control algorithm based on congestion level and data rate for concurrent multipath transfer in wireless mesh networks
    Liu, Kai-ming
    Fan, Yuan-yuan
    Liu, Yuan-an
    Fu, Hao
    WIRELESS COMMUNICATION AND SENSOR NETWORK, 2016, : 128 - 137
  • [10] Delay-based Congestion Control for Multipath TCP
    Guo, Wenlan
    Huang, Jin
    Zhang, Yun
    INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2014, 7 (01): : 97 - 104