Resilient Topology Design for Wireless Backhaul: A Deep Reinforcement Learning Approach

被引:5
|
作者
Abdelmoaty, Ahmed [1 ,2 ]
Naboulsi, Diala [2 ,3 ]
Dahman, Ghassan [2 ,4 ]
Poitau, Gwenael [5 ]
Gagnon, Francois
机构
[1] Ecole Technol Super, Elect Engn Dept, Montreal, PQ H3C 1K3, Canada
[2] Ecole Technol Super, Resilient Machine Learning Inst, Montreal, PQ H3C 1K3, Canada
[3] Ecole Technol Super, Software Engn Dept & IT, Montreal, PQ H3C 1K3, Canada
[4] Ultra Intelligence & Commun, Montreal, PQ H4T 1V7, Canada
[5] Dell Technol, Toronto, ON M2H 3N5, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Deep reinforcement learning; graph theory; Integer Linear Program (ILP); resiliency; wireless backhaul;
D O I
10.1109/LWC.2022.3207358
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ultra-dense 5G and beyond deployments are setting significant burden on cellular networks, especially for wireless backhauls. Today, a careful planning for wireless backhaul is more critical than ever. In this letter, we study the hierarchical wireless backhaul topology design problem. We introduce a Deep Reinforcement Learning (DRL) based algorithm that can solve the problem efficiently. We compare the quality of the solutions derived by our DRL approach to the optimal solution, derived according to the Integer Linear Program (ILP) formulation in our previous work. A simulation using practical channel propagation scenarios and different network densities proves that our DRL-based algorithm is providing a sub-optimal solution with different levels of resiliency. Our DRL algorithm is further shown to scale for larger instances of the problem.
引用
收藏
页码:2532 / 2536
页数:5
相关论文
共 50 条
  • [11] An Incentive Mechanism Design for Efficient Edge Learning by Deep Reinforcement Learning Approach
    Zhan, Yufeng
    Zhang, Jiang
    [J]. IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2020, : 2489 - 2498
  • [12] Wireless Network Design Optimization for Computer Teaching with Deep Reinforcement Learning Application
    Luo, Yumei
    Zhang, Deyu
    [J]. APPLIED ARTIFICIAL INTELLIGENCE, 2023, 37 (01)
  • [13] Dynamic Topology Design of NFV-Enabled Services Using Deep Reinforcement Learning
    Alhussein, Omar
    Zhuang, Weihua
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (02) : 1228 - 1238
  • [14] Deep Reinforcement Learning Based Autonomous Control Approach for Power System Topology Optimization
    Han, Xiaoyun
    Hao, Yi
    Chong, Zhiqiang
    Ma, Shiqiang
    Mu, Chaoxu
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6041 - 6046
  • [15] UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach
    Bayerlein, Harald
    Theile, Mirco
    Caccamo, Marco
    Gesbert, David
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [16] Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey
    Frikha, Mohamed Said
    Gammar, Sonia Mettali
    Lahmadi, Abdelkader
    Andrey, Laurent
    [J]. COMPUTER COMMUNICATIONS, 2021, 178 : 98 - 113
  • [17] Network Topology Optimization via Deep Reinforcement Learning
    Li, Zhuoran
    Wang, Xing
    Pan, Ling
    Zhu, Lin
    Wang, Zhendong
    Feng, Junlan
    Deng, Chao
    Huang, Longbo
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (05) : 2847 - 2859
  • [18] Resilient Operation of Distribution Grids Using Deep Reinforcement Learning
    Hosseini, Mohammad Mehdi
    Parvania, Masood
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (03) : 2100 - 2109
  • [19] A Safe Deep Reinforcement Learning Approach for Energy Efficient Federated Learning in Wireless Communication Networks
    Koursioumpas, Nikolaos
    Magoula, Lina
    Petropouleas, Nikolaos
    Thanopoulos, Alexandros-Ioannis
    Panagea, Theodora
    Alonistioti, Nancy
    Gutierrez-Estevez, M.A.
    Khalili, Ramin
    [J]. IEEE Transactions on Green Communications and Networking, 2024, 8 (04): : 1862 - 1874
  • [20] Deep Reinforcement Learning-Based Topology Optimization for Self-Organized Wireless Sensor Networks
    Meng, Xiangyue
    Inaltekin, Hazer
    Krongold, Brian
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,