Decentralized Cognitive MAC Protocol Design Based on POMDP and Q-Learning

被引：0
|
作者：
Lan, Zhongli [1 ]
Jiang, Hong [1 ]
Wu, Xiaoli [2 ]
机构：
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Peoples R China
[2] China Acad Engn Phys, Inst Nucl Phys & Chem, Mianyang, Peoples R China
来源：
2012 7TH INTERNATIONAL ICST CONFERENCE ON COMMUNICATIONS AND NETWORKING IN CHINA (CHINACOM) | 2012年
基金：
美国国家科学基金会;
关键词：
Q-Learning; POMDP; Cognitive MAC Protocol; Decentralized; NETWORKS;
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
A decentralized cognitive MAC protocol is proposed in this paper, whose core depends on the partially observed Markov process (POMDP) and Q-Learning. Limited by the hardware and environment, a secondary user may not be able to have ability to sense the entire spectrum space. Therefore, the POMDP is exploited to model the secondary network. In this paper, Q-Learning is applied to solve the POMDP because it can make full advantage of the past observation and decision experiences to optimize current action, and needs not transfer the POMDP into a belief MDP. The numeral simulation results show that Q-Learning-based decentralized cognitive MAC protocol improves the overall performance of the networks.
引用
收藏
页码：548 / 551
页数：4
相关论文
共 50 条
  • [21] A Reinforcement Learning-based Cognitive MAC Protocol
    Kakalou, I.
    Papadimitriou, G. I.
    Nicopolitidis, P.
    Sarigiannidis, P. G.
    Obaidat, M. S.
    2015 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2015, : 5608 - 5612
  • [22] A cognitive framework for WSN based on weighted cognitive maps and Q-learning
    El-Mougy, Amr
    Ibnkahla, Mohamed
    AD HOC NETWORKS, 2014, 16 : 46 - 69
  • [23] Double Q-learning based routing protocol for opportunistic networks
    Singh, Jagdeep
    Dhurandher, Sanjay Kumar
    Woungang, Isaac
    Barolli, Leonard
    JOURNAL OF HIGH SPEED NETWORKS, 2023, 29 (01) : 1 - 14
  • [24] Q-FANET: Improved Q-learning based routing protocol for FANETs
    da Costa, Luis Antonio L. F.
    Kunst, Rafael
    de Freitas, Edison Pignaton
    COMPUTER NETWORKS, 2021, 198
  • [25] A POMDP Framework for Cognitive MAC Based on Primary Feedback Exploitation
    Seddik, Karim G.
    El-Sherif, Amr A.
    2014 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2014, : 1281 - 1285
  • [26] Decentralized Q-Learning with Constant Aspirations in Stochastic Games
    Yongacoglu, Bora
    Arslan, Gurdal
    Yuksel, Serdar
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 1744 - 1749
  • [27] I2Q: A Fully Decentralized Q-Learning Algorithm
    Jiang, Jiechuan
    Lu, Zongqing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [28] Decentralized Q-learning for Aggregated Interference Control in Completely and Partially Observable Cognitive Radio Networks
    Galindo-Serrano, Ana
    Giupponi, L.
    2010 7TH IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE-CCNC 2010, 2010, : 153 - 158
  • [29] Performance analysis of Decentralized MAC protocol in Cognitive Radio networks
    Chaudhari, Chaitali
    Patil, Hemlata
    Kadam, Sujata
    2019 IEEE 5TH INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2019,
  • [30] Anypath Routing Protocol Design via Q-Learning for Underwater Sensor Networks
    Zhou, Yuan
    Cao, Tao
    Xiang, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (10): : 8173 - 8190
12345