Intelligent multipath congestion control algorithm based on subflow coupling perception

被引:0
|
作者
Xu, Yanyan [1 ]
Wang, Bingqi [1 ]
Pan, Shaoming [1 ]
Chen, Shihe [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430072, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Congestion control; Subflow coupling; Deep reinforcement Learning; Heterogeneous wireless network; TCP; BBR;
D O I
10.1007/s10586-024-04939-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multiple network interfaces equipped with terminal nodes in heterogeneous wireless networks can be used for multi-path transmission, transmitting data in parallel to improve the throughput of network communication, as well as the stability and resilience of the connection. However, existing multipath congestion control algorithms have difficulty in dealing dynamic changing network environments and ignore the subflow coupling feature, resulting in problems such as underutilization of multipath resources and transmission fairness. To address these challenges, we propose a novel multi-path intelligent congestion control algorithm based on subflow coupling perception (MSCP), which utilizes deep reinforcement learning (DRL) techniques to improve the adaptability to dynamic network environments. The subflow coupling features are perceived through the analysis of trends in subflow transmission round-trip time. To further refine this understanding, Long Short-Term Memory (LSTM) is utilized to eliminate network noise and extract the latent temporal information inherent in subflow states. By providing a more precise estimation of network conditions, this approach enhances the ability of DRL agents to learn more effectively from their interactions with the environment. Proximal Policy Optimization (PPO) algorithm is combined with Coupled Bottleneck Bandwidth and Round-trip propagation time (Coupled BBR) multipath congestion control algorithm, where the transmission gain coefficients of each subflow is adaptively adjusted using PPO agents to control the transmission rate of each subflows, improving the algorithm's responsiveness to dynamic network environments. Experimental results show that the proposed algorithm effectively utilizes link resources, leading to significant improvements in both transmission throughput and transmission fairness.
引用
收藏
页数:25
相关论文
共 50 条
  • [31] Intelligent Control of Congestion based on Multi-SoftMan
    Zhao, Yu-hong
    Zheng, Xue-feng
    Tu, Xu-yan
    AUTOMATION EQUIPMENT AND SYSTEMS, PTS 1-4, 2012, 468-471 : 2033 - +
  • [32] IMPROVING CONGESTION CONTROL IN WSN BY MULTIPATH ROUTING WITH PRIORITY BASED SCHEDULING
    Shree, Iniya S.
    Karthiga, M.
    Mariyammal, C.
    PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON INVENTIVE SYSTEMS AND CONTROL (ICISC 2017), 2017, : 324 - 329
  • [33] A Timestamp Based Multipath Source Routing Protocol for Congestion Control in MANET
    Yerajana, Rambabu
    Sarje, A. K.
    2009 IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE, VOLS 1-3, 2009, : 32 - 34
  • [34] A Unified Approach to Congestion Control and Node-Based Multipath Routing
    Paganini, Fernando
    Mallada, Enrique
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2009, 17 (05) : 1413 - 1426
  • [35] Stability of node-based multipath routing and dual congestion control
    Mallada, Enrique
    Paganini, Fernando
    47TH IEEE CONFERENCE ON DECISION AND CONTROL, 2008 (CDC 2008), 2008, : 1398 - 1403
  • [36] Adaptive Congestion Control Algorithm Based on Predictive Control
    Sun Peilin
    Niu Yugang
    2008 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-11, 2008, : 644 - 648
  • [37] Enhancing Fairness and Congestion Control in Multipath TCP
    Singh, Amanpreet
    Xiang, Mei
    Koensgen, Andreas
    Goerg, Carmelita
    Zaki, Yasir
    2013 6TH JOINT IFIP WIRELESS AND MOBILE NETWORKING CONFERENCE (WMNC 2013), 2013,
  • [38] Combining multipath routing and congestion control for robustness
    Key, Peter
    Massoulie, Laurent
    Towsley, Don
    2006 40TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, VOLS 1-4, 2006, : 345 - 350
  • [39] Network congestion control with Markovian multipath routing
    Cominetti, Roberto
    Guzman, Cristobal
    MATHEMATICAL PROGRAMMING, 2014, 147 (1-2) : 231 - 251
  • [40] Low Priority Congestion Control for Multipath TCP
    Zhang, Yuan
    Li, Jian
    Yang, Jiayu
    Xing, Yitao
    Zhuang, Rui
    Xue, Kaiping
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,