Intelligent Trajectory Planning in UAV-Mounted Wireless Networks: A Quantum-Inspired Reinforcement Learning Perspective

被引:30
|
作者
Li, Yuanjian [1 ]
Aghvami, A. Hamid [1 ]
Dong, Daoyi [2 ]
机构
[1] Kings Coll London, Ctr Telecommun Res, London WC2R 2LS, England
[2] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
关键词
UAV; trajectory planning; quantum computation; quantum-inspired reinforcement learning (QiRL); DESIGN;
D O I
10.1109/LWC.2021.3089876
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we consider a wireless uplink transmission scenario in which an unmanned aerial vehicle (UAV) serves as an aerial base station collecting data from ground users. To optimize the expected sum uplink transmit rate without any prior knowledge of ground users (e.g., locations, channel state information and transmit power), the trajectory planning problem is optimized via the quantum-inspired reinforcement learning (QiRL) approach. Specifically, the QiRL method adopts novel probabilistic action selection policy and new reinforcement strategy, which are inspired by the collapse phenomenon and amplitude amplification in quantum computation theory, respectively. Numerical results demonstrate that the proposed QiRL solution can offer natural balancing between exploration and exploitation via ranking collapse probabilities of possible actions, compared to the traditional reinforcement learning approaches that are highly dependent on tuned exploration parameters.
引用
收藏
页码:1994 / 1998
页数:5
相关论文
共 50 条
  • [31] Backhaul-Aware Trajectory Optimization of Fixed-Wing UAV-Mounted Base Station for Continuous Available Wireless Service
    Qiu, Chen
    Wei, Zhiqing
    Feng, Zhiyong
    Zhang, Ping
    IEEE ACCESS, 2020, 8 : 60940 - 60950
  • [32] Deep Reinforcement Learning for Trajectory Design and Power Allocation in UAV Networks
    Zhao, Nan
    Cheng, Yiqiang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [33] Intelligent trajectory planning based on reinforcement learning with KCCA inference for robot
    Fu J.
    Teng X.
    Cao C.
    Lou P.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2019, 47 (11): : 96 - 102
  • [34] Robot Intelligent Trajectory Planning Based on PCM Guided Reinforcement Learning
    Teng, Xiang
    Fu, Jian
    Li, Cong
    Ju, ZhaoJie
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PART VI, 2019, 11745 : 342 - 355
  • [35] Bayesian Optimization Enhanced Deep Reinforcement Learning for Trajectory Planning and Network Formation in Multi-UAV Networks
    Gong, Shimin
    Wang, Meng
    Gu, Bo
    Zhang, Wenjie
    Dinh Thai Hoang
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10933 - 10948
  • [36] Optimum Number of Reflecting Elements for UAV-Mounted Intelligent Reflecting Surface-Assisted Data Collection in Wireless Sensor Network
    Zhao, Hong
    Chen, Hongbin
    Tan, Fangqing
    Zhan, Ling
    IEEE SENSORS JOURNAL, 2024, 24 (14) : 23062 - 23074
  • [37] Deep reinforcement learning based trajectory optimization for magnetometer-mounted UAV to landmine detection
    Barnawi, Ahmed
    Kumar, Neeraj
    Budhiraja, Ishan
    Kumar, Krishan
    Almansour, Amal
    Alzahrani, Bander
    COMPUTER COMMUNICATIONS, 2022, 195 : 441 - 450
  • [38] AoI optimal UAV trajectory planning: A Deep Recurrent Reinforcement Learning Approach
    Wu, Mengjie
    Chi, Huijia
    Gan, Shuying
    Wang, Xijun
    Xu, Chao
    2021 IEEE 32ND ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2021,
  • [39] REPlanner: Efficient UAV Trajectory-Planning using Economic Reinforcement Learning
    Khalil, Alvi Ataur
    Byrne, Alexander J.
    Rahman, Mohammad Ashiqur
    Manshaei, Mohammad Hossein
    2021 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING (SMARTCOMP 2021), 2021, : 153 - 160
  • [40] Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation
    Estevez, Julian
    Manuel Lopez-Guede, Jose
    del Valle-Echavarri, Javier
    Grana, Manuel
    IEEE ACCESS, 2024, 12 : 144009 - 144016