A MDP-Based Network Selection Scheme in 5G Ultra-Dense Network

With the rapid development of the mobile Internet and the Internet of Things, the number of mobile communication services has grown rapidly. When multiple different types of networks cover the same region, it is important to decide which one users connect to, known as the network selection problem. In this paper, we explore the optimal network selection problem in 5G ultra-dense network. We consider several different types of transmission data such as session, media, background and interactive, which conclude different QoS requirements. And then, we formulate the network selection problem as an MDP model in ultra-dense system, and propose NS-MDP algorithm which aims to obtain best target network by calculating the benefits of the utility function. NS-MDP algorithm takes into account user data requirements, current system status, and network load conditions. Comparison experiments with Best Rate, Random and Greedy_AHP strategies, show that NS-MDP algorithm's average throughput is 8.6%, 17.8% and 20.5% higher than them, and NS-MDP can reduce blocking rate by 33.3%, 17.6%, and 37.7%.