Reconfiguring multicast sessions in elastic optical networks adaptively with graph-aware deep reinforcement learning

被引:14
|
作者
Tian, Xiaojian [1 ]
Li, Baojia [1 ]
Gu, Rentao [2 ]
Zhu, Zuqing [1 ]
机构
[1] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230027, Anhui, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
LIGHT-TREES; ALLOCATION;
D O I
10.1364/JOCN.431225
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the fast deployment of datacenters (DCs), bandwidth-intensive multicast services are becoming more and more popular in metro and wide-area networks, to support dynamic applications such as DC synchronization and backup. Hence, this work studies the problem of how to formulate and reconfigure multicast sessions in an elastic optical network (EON) dynamically. We propose a deep reinforcement learning (DRL) model based on graph neural networks to solve the sub-problem of multicast session selection in a more universal and adaptive manner. The DRL model abstracts topology information of the EON and the current provisioning scheme of a multicast session as graph-structured data, and analyzes the data to intelligently determine whether the session should be selected for reconfiguration. We evaluate our proposal with extensive simulations that consider different EON topologies, and the results confirm its effectiveness and universality. Specifically, the results show that it can balance the trade-off between the number of reconfiguration operations and blocking performance much better than existing algorithms, and the DRL model trained in one EON topology can easily adapt to solve the problem of dynamic multicast session reconfiguration in other topologies, without being redesigned or retrained. (C) 2021 Optical Society of America
引用
收藏
页码:253 / 265
页数:13
相关论文
共 50 条
  • [21] Spectrum-Usage-Aware Resource Allocation and Multicast Routing in Elastic Optical Networks
    Moharrami, Mehrdad
    Beyranvand, Hamzeh
    Fallahpour, Ahmad
    Salehi, Jawad A.
    2016 8TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), 2016, : 45 - 50
  • [22] Real-Time Coordination of Dynamic Network Reconfiguration and Volt-VAR Control in Active Distribution Network: A Graph-Aware Deep Reinforcement Learning Approach
    Wang, Ruoheng
    Bi, Xiaowen
    Bu, Siqi
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (03) : 3288 - 3302
  • [23] Routing in optical transport networks with deep reinforcement learning
    Suarez-Varela, Jose
    Mestres, Albert
    Yu, Junlin
    Kuang, Li
    Feng, Haoyu
    Cabellos-Aparicio, Albert
    Barlet-Ros, Pere
    JOURNAL OF OPTICAL COMMUNICATIONS AND NETWORKING, 2019, 11 (11) : 547 - 558
  • [24] Evaluation of Deep Reinforcement Learning for Restoration in Optical Networks
    Hernandez-Chulde, C.
    Casellas, R.
    Martinez, R.
    Vilalta, R.
    Munoz, R.
    2022 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION (OFC), 2022,
  • [25] Exploiting Multi-Task Learning to Achieve Effective Transfer Deep Reinforcement Learning in Elastic Optical Networks
    Chen, Xiaoliang
    Proietti, Roberto
    Liu, Che-Yu
    Zhu, Zuqing
    Ben Yoo, S. J.
    2020 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXPOSITION (OFC), 2020,
  • [26] Deep learning and hierarchical graph-assisted crosstalk-aware fragmentation avoidance strategy in space division multiplexing elastic optical networks
    Xiong, Yu
    Ye, Yulong
    Zhang, Hua
    He, Jinyou
    Wang, Baohua
    Yang, Kunrong
    OPTICS EXPRESS, 2020, 28 (03) : 2758 - 2777
  • [27] A Reinforcement Learning Framework for Parameter Optimization in Elastic Optical Networks
    Weixer, Rebekka
    Kuehl, Sebastian
    Morais, Rui Manuel
    Spinnler, Bernhard
    Schairer, Wolfgang
    Sommerkorn-Krombholz, Bernd
    Pachnicke, Stephan
    2020 EUROPEAN CONFERENCE ON OPTICAL COMMUNICATIONS (ECOC), 2020,
  • [28] Reinforcement Learning for Generalized Parameter Optimization in Elastic Optical Networks
    Koch, Rebekka
    Kuehl, Sebastian
    Morais, Rui Manuel
    Spinnler, Bernhard
    Schairer, Wolfgang
    Sommernkorn-Krombholz, Bernd
    Pachnicke, Stephan
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2022, 40 (03) : 567 - 574
  • [29] Robust Restoration of IP Traffic from Optical Failures by Deep Reinforcement Learning and Graph Neural Networks
    Bekri, Malek
    Reyes, Ronald Romero
    Bauschert, Thomas
    2024 24TH INTERNATIONAL CONFERENCE ON TRANSPARENT OPTICAL NETWORKS, ICTON 2024, 2024,
  • [30] Deep-RMSA: A Deep-Reinforcement-Learning Routing, Modulation and Spectrum Assignment Agent for Elastic Optical Networks
    Chen, Xiaoliang
    Guo, Jiannan
    Zhu, Zuqing
    Proietti, Roberto
    Castro, Alberto
    Yoo, S. J. B.
    2018 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXPOSITION (OFC), 2018,