Decentralized Cognitive MAC Protocol Design Based on POMDP and Q-Learning

被引：0
|
作者：
Lan, Zhongli [1 ]
Jiang, Hong [1 ]
Wu, Xiaoli [2 ]
机构：
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Peoples R China
[2] China Acad Engn Phys, Inst Nucl Phys & Chem, Mianyang, Peoples R China
来源：
2012 7TH INTERNATIONAL ICST CONFERENCE ON COMMUNICATIONS AND NETWORKING IN CHINA (CHINACOM) | 2012年
基金：
美国国家科学基金会;
关键词：
Q-Learning; POMDP; Cognitive MAC Protocol; Decentralized; NETWORKS;
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
A decentralized cognitive MAC protocol is proposed in this paper, whose core depends on the partially observed Markov process (POMDP) and Q-Learning. Limited by the hardware and environment, a secondary user may not be able to have ability to sense the entire spectrum space. Therefore, the POMDP is exploited to model the secondary network. In this paper, Q-Learning is applied to solve the POMDP because it can make full advantage of the past observation and decision experiences to optimize current action, and needs not transfer the POMDP into a belief MDP. The numeral simulation results show that Q-Learning-based decentralized cognitive MAC protocol improves the overall performance of the networks.
引用
收藏
页码：548 / 551
页数：4
相关论文
共 50 条
  • [41] Cooperative Q-learning based channel selection for cognitive radio networks
    Feten Slimeni
    Zied Chtourou
    Bart Scheers
    Vincent Le Nir
    Rabah Attia
    Wireless Networks, 2019, 25 : 4161 - 4171
  • [42] Molecular design based on Q-learning and maximum likelihood estimation
    Liu, Ying
    Zhang, Bingfeng
    Zhao, Jun
    Wang, Wei
    Lv, Zheng
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 2119 - 2124
  • [43] Cooperative Q-learning based channel selection for cognitive radio networks
    Slimeni, Feten
    Chtourou, Zied
    Scheers, Bart
    Le Nir, Vincent
    Attia, Rabah
    WIRELESS NETWORKS, 2019, 25 (07) : 4161 - 4171
  • [44] MAC Protocol Selection Based on Machine Learning in Cognitive Radio Networks
    Qiao, Mu
    Zhao, Haitao
    Wang, Shan
    Wei, Jibo
    2016 19TH INTERNATIONAL SYMPOSIUM ON WIRELESS PERSONAL MULTIMEDIA COMMUNICATIONS (WPMC), 2016,
  • [45] Decentralized Predictive MAC Protocol for Ad Hoc Cognitive Radio Networks
    Gyanendra Prasad Joshi
    Seung Yeob Nam
    Sung Won Kim
    Wireless Personal Communications, 2014, 74 : 803 - 821
  • [46] Decentralized Predictive MAC Protocol for Ad Hoc Cognitive Radio Networks
    Joshi, Gyanendra Prasad
    Nam, Seung Yeob
    Kim, Sung Won
    WIRELESS PERSONAL COMMUNICATIONS, 2014, 74 (02) : 803 - 821
  • [47] A decentralized MAC protocol for opportunistic spectrum access in cognitive wireless networks
    Ansari, Junaid
    Zhang, Xi
    Maehoenen, Petri
    COMPUTER COMMUNICATIONS, 2013, 36 (13) : 1399 - 1410
  • [48] QGrid: Q-learning Based Routing Protocol for Vehicular Ad Hoc Networks
    Li, Ruiling
    Li, Fan
    Li, Xin
    Wang, Yu
    2014 IEEE INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCCC), 2014,
  • [49] Q-learning based Stepwise Routing Protocol for Multi-UAV Networks
    Lim, Jae Won
    Ko, Young-Bae
    3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (IEEE ICAIIC 2021), 2021, : 307 - 309
  • [50] Decentralized Reinforcement Learning Based MAC Optimization
    Nisioti, Eleni
    Thomos, Nikolaos
    2018 IEEE 29TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2018,
12345