Reinforcement Learning Based Signal Quality Aware Handover Scheme for LEO Satellite Communication Networks

被引:2
|
作者
Chen, Menting [1 ]
Zhang, Yong [1 ]
Teng, YingLei [1 ]
Liu, Baoling [1 ]
Zhang, Lili [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing, Peoples R China
[2] State Grid Shenwang Locat Based Serv Co Ltd, Shuangchuang Ctr Lab, Beijing, Peoples R China
来源
HUMAN CENTERED COMPUTING | 2019年 / 11956卷
基金
中国国家自然科学基金; 北京市自然科学基金; 国家重点研发计划;
关键词
LEO satellite network; Handover; Q-Learning; Signal quality; CHANNEL ALLOCATION TECHNIQUES;
D O I
10.1007/978-3-030-37429-7_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the increasing of Low Earth Orbit (LEO) satellites emission, utilizing existing LEO satellite network systems have lower CAPEX/OPEX than deploying fixed terrestrial network systems in the remote area. Due to the high mobility of LEO satellites, mobility management mechanisms such as handover schemes are the key issue should be settled on leveraging the merits of LEO satellites telecommunications (e.g. lower propagation delay than GEO satellites). In traditional handover schemes, choosing which one is the next-hop satellite for one user is only determined by evaluating some specific criteria in the current state, not guaranteeing long-term and global optimization. To solve this problem, we use the cumulative signal quality that involves the remaining service time and signal quality and propose a Q-Learning based handover scheme. The simulation results show that the proposed scheme improves the overall signal quality and reduce the average handover number of users compared with other handover schemes.
引用
收藏
页码:44 / 55
页数:12
相关论文
共 50 条
  • [21] A Satellite Handover Strategy Based on MIMO Technology in LEO Satellite Networks
    Feng, Lang
    Liu, Yifei
    Wu, Liang
    Zhang, Zaichen
    Dang, Jian
    [J]. IEEE COMMUNICATIONS LETTERS, 2020, 24 (07) : 1505 - 1509
  • [22] A Satellite Handover Strategy Based on Heuristic Algorithm for LEO Satellite Networks
    Zhang, Senbai
    Liu, Aijun
    Han, Chen
    Liang, Xiaohu
    Ding, Xiang
    Lu, Aihong
    [J]. IEICE TRANSACTIONS ON COMMUNICATIONS, 2022, E105B (07) : 876 - 884
  • [23] Reinforcement learning for resource allocation in LEO satellite networks
    Usaha, Wipawee
    Barria, Javier A.
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2007, 37 (03): : 515 - 527
  • [24] Channel Reservation based Load Aware Handover for LEO Satellite Communications
    Liu, Yaoqi
    Tang, Xiaogang
    Zhou, Yiqing
    Shi, Jinglin
    Qian, Manli
    Li, Shaoyang
    [J]. 2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [25] Reinforcement Learning Based Predictive Handover for Pedestrian-Aware mmWave Networks
    Koda, Yusuke
    Yamamoto, Koji
    Nishio, Takayuki
    Morikura, Masahiro
    [J]. IEEE INFOCOM 2018 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2018, : 692 - 697
  • [26] Adaptive dynamic channel allocation scheme for spotbeam handover in LEO satellite networks
    Cho, S
    [J]. IEEE VEHICULAR TECHNOLOGY CONFERENCE, FALL 2000, VOLS 1-6, PROCEEDINGS: BRINGING GLOBAL MOBILITY TO THE NETWORK AGE, 2000, : 1925 - 1929
  • [27] A Two-Hops State-Aware Routing Strategy Based on Deep Reinforcement Learning for LEO Satellite Networks
    Wang, Cheng
    Wang, Huiwen
    Wang, Weidong
    [J]. ELECTRONICS, 2019, 8 (09)
  • [28] A Prediction Based SCTP Handover Scheme for IP/LEO Satellite Network
    Zhang, Zhu
    Guo, Qing
    Gao, Zihe
    [J]. 2010 6TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS NETWORKING AND MOBILE COMPUTING (WICOM), 2010,
  • [29] Reinforcement Learning Based Intelligent Routing for Software Defined LEO Satellite Networks
    Fu, Liying
    Wei, Wenting
    Lu, Xueyu
    Wu, Celimuge
    Hou, Xiangwang
    Lin, Lei
    Chen, Chen
    [J]. Proceedings - IEEE Global Communications Conference, GLOBECOM, 2023, : 2323 - 2328
  • [30] Reinforcement Learning based Intelligent Routing for Software Defined LEO Satellite Networks
    Fu, Liying
    Wei, Wenting
    Lu, Xueyu
    Wu, Celimuge
    Hou, Xiangwang
    Liu, Lei
    Chen, Chen
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2323 - 2328