On Intelligent Traffic Control for Large-Scale Heterogeneous Networks: A Value Matrix-Based Deep Learning Approach

Recently, deep learning has emerged as an attractive technique to intelligently control network traffic. However, the contemporary researches only focused on small-/mediumscale networks, since the computational complexity of deep learning based traffic control algorithm significantly increases with the network size. In this paper, we address this issue and envision a reward-based deep learning structure, which jointly employs deep convolutional neural network (CNN) and a deep belief network (DBN) to predict the traffic load value matrix and construct the final action matrix, respectively. In our proposal, the deep CNN is used to construct the award prediction network, while the deep DBN constructs the action decision network. Thus, the final action space is simplified to a next destination action matrix, and the computational complexity is substantially reduced. Computer-based simulation results demonstrate that our proposal is able to achieve an improved performance in the large-scale network in terms of the packets loss rate and throughput in contrast with those in the conventional routing method.