Intelligent multipath congestion control algorithm based on subflow coupling perception

被引:0
|
作者
Xu, Yanyan [1 ]
Wang, Bingqi [1 ]
Pan, Shaoming [1 ]
Chen, Shihe [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430072, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Congestion control; Subflow coupling; Deep reinforcement Learning; Heterogeneous wireless network; TCP; BBR;
D O I
10.1007/s10586-024-04939-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multiple network interfaces equipped with terminal nodes in heterogeneous wireless networks can be used for multi-path transmission, transmitting data in parallel to improve the throughput of network communication, as well as the stability and resilience of the connection. However, existing multipath congestion control algorithms have difficulty in dealing dynamic changing network environments and ignore the subflow coupling feature, resulting in problems such as underutilization of multipath resources and transmission fairness. To address these challenges, we propose a novel multi-path intelligent congestion control algorithm based on subflow coupling perception (MSCP), which utilizes deep reinforcement learning (DRL) techniques to improve the adaptability to dynamic network environments. The subflow coupling features are perceived through the analysis of trends in subflow transmission round-trip time. To further refine this understanding, Long Short-Term Memory (LSTM) is utilized to eliminate network noise and extract the latent temporal information inherent in subflow states. By providing a more precise estimation of network conditions, this approach enhances the ability of DRL agents to learn more effectively from their interactions with the environment. Proximal Policy Optimization (PPO) algorithm is combined with Coupled Bottleneck Bandwidth and Round-trip propagation time (Coupled BBR) multipath congestion control algorithm, where the transmission gain coefficients of each subflow is adaptively adjusted using PPO agents to control the transmission rate of each subflows, improving the algorithm's responsiveness to dynamic network environments. Experimental results show that the proposed algorithm effectively utilizes link resources, leading to significant improvements in both transmission throughput and transmission fairness.
引用
收藏
页数:25
相关论文
共 50 条
  • [21] Path Selection and Multipath Congestion Control
    Key, Peter
    Massoulie, Laurent
    Towsley, Don
    COMMUNICATIONS OF THE ACM, 2011, 54 (01) : 109 - 116
  • [22] An IoT based Congestion Control Algorithm
    Verma, Lal Pratap
    Kumar, Mahesh
    INTERNET OF THINGS, 2020, 9
  • [23] A DISTRIBUTED MULTIPATH ROUTING ALGORITHM TO MINIMIZE CONGESTION
    Xin, Guo
    Jun, Zhang
    Tao, Zhang
    2009 IEEE/AIAA 28TH DIGITAL AVIONICS SYSTEMS CONFERENCE, VOLS 1-3, 2009, : 1671 - 1678
  • [24] Subflow scheduling strategy for multipath transmission in SDN-based spatial network
    Hui Qi
    Junrui Si
    Jiahui Hou
    Zhe Tian
    Aowei Zhang
    Jing Chen
    Weiwu Ren
    Shiwei Zhang
    Xiaoqiang Di
    Wireless Networks, 2023, 29 : 941 - 953
  • [25] System Investigation of a Gateway Implementing Subflow Control Policies using a Multipath TCP Proxy
    Okada, Yu
    Shimamura, Masayoshi
    Iida, Katsuyoshi
    2015 IEEE PACIFIC RIM CONFERENCE ON COMMUNICATIONS, COMPUTERS AND SIGNAL PROCESSING (PACRIM), 2015, : 292 - 297
  • [26] Subflow scheduling strategy for multipath transmission in SDN-based spatial network
    Qi, Hui
    Si, Junrui
    Hou, Jiahui
    Tian, Zhe
    Zhang, Aowei
    Chen, Jing
    Ren, Weiwu
    Zhang, Shiwei
    Di, Xiaoqiang
    WIRELESS NETWORKS, 2023, 29 (02) : 941 - 953
  • [27] Packet Scheduling and Congestion Control Schemes for Multipath Datagram Congestion Control Protocol
    Huang, Chung-Ming
    Chen, Yih-Chung
    Lin, Shih-Yang
    COMPUTER JOURNAL, 2015, 58 (02): : 188 - 203
  • [28] Multipath Transmission Control Mechanism Based on Deep Reinforcement Learning and Sub-flow Coupling Perception
    Qin J.-R.
    Xu C.-Q.
    Yang S.-J.
    Gao K.
    Zhang H.-K.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (02): : 346 - 357
  • [29] Fuzzy priority based intelligent traffic congestion control and emergency vehicle management using congestion-aware routing algorithm
    Shelke, Maya
    Malhotra, Akshay
    Mahalle, Parikshit N.
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2019,
  • [30] wBBR: a Bottleneck Estimation-Based Congestion Control for Multipath TCP
    Zhu, Ting
    Qin, Xiaowei
    Chen, Li
    Chen, Xiaohui
    Wei, Guo
    2018 IEEE 88TH VEHICULAR TECHNOLOGY CONFERENCE (VTC-FALL), 2018,