A Markov Decision Process-Based Opportunistic Spectral Access

Recent interest in Internet of Things has resulted in increased activities in the area of dynamic spectrum access, which fosters cognitive radio networks that provide opportunistic access. This letter proposes optimal opportunistic access through a Markov decision process for a user of interest in a single channel environment competing with other users. Consequently, we analyze the model in terms of interference and wastage and compare it with other Markov models from the existing literature. One should note that the models are compared to give an overall evaluation of performance, as a detailed comparison cannot be made, due to the use of different system models, transitional probabilities, etc.