Intelligent Trajectory Planning in UAV-Mounted Wireless Networks: A Quantum-Inspired Reinforcement Learning Perspective

被引:30
|
作者
Li, Yuanjian [1 ]
Aghvami, A. Hamid [1 ]
Dong, Daoyi [2 ]
机构
[1] Kings Coll London, Ctr Telecommun Res, London WC2R 2LS, England
[2] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
关键词
UAV; trajectory planning; quantum computation; quantum-inspired reinforcement learning (QiRL); DESIGN;
D O I
10.1109/LWC.2021.3089876
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we consider a wireless uplink transmission scenario in which an unmanned aerial vehicle (UAV) serves as an aerial base station collecting data from ground users. To optimize the expected sum uplink transmit rate without any prior knowledge of ground users (e.g., locations, channel state information and transmit power), the trajectory planning problem is optimized via the quantum-inspired reinforcement learning (QiRL) approach. Specifically, the QiRL method adopts novel probabilistic action selection policy and new reinforcement strategy, which are inspired by the collapse phenomenon and amplitude amplification in quantum computation theory, respectively. Numerical results demonstrate that the proposed QiRL solution can offer natural balancing between exploration and exploitation via ranking collapse probabilities of possible actions, compared to the traditional reinforcement learning approaches that are highly dependent on tuned exploration parameters.
引用
收藏
页码:1994 / 1998
页数:5
相关论文
共 50 条
  • [41] Quantum-inspired ant-based energy balanced routing in wireless sensor networks
    Rathee M.
    Kumar S.
    Dilip K.
    Rathee, Manisha (manisharathee08@gmail.com), 1600, Bentham Science Publishers (13): : 1292 - 1301
  • [42] Reinforcement Learning Meets Wireless Networks: A Layering Perspective
    Chen, Yawen
    Liu, Yu
    Zeng, Ming
    Saleem, Umber
    Lu, Zhaoming
    Wen, Xiangming
    Jin, Depeng
    Han, Zhu
    Jiang, Tao
    Li, Yong
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (01) : 85 - 111
  • [43] Deep Reinforcement Learning for Intelligent Dual-UAV Reconnaissance Mission Planning
    Zhao, Xiaoru
    Yang, Rennong
    Zhang, Ying
    Yan, Mengda
    Yue, Longfei
    ELECTRONICS, 2022, 11 (13)
  • [44] Multiagent Deep Reinforcement Learning for Wireless-Powered UAV Networks
    Oubbati, Omar Sami
    Lakas, Abderrahmane
    Guizani, Mohsen
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (17): : 16044 - 16059
  • [45] Resource Management for Edge Intelligence (EI)-Assisted IoV Using Quantum-Inspired Reinforcement Learning
    Wang, Dan
    Song, Bin
    Lin, Peng
    Yu, F. Richard
    Du, Xiaojiang
    Guizani, Mohsen
    IEEE Internet of Things Journal, 2022, 9 (14) : 12588 - 12600
  • [46] Resource Management for Edge Intelligence (EI)-Assisted IoV Using Quantum-Inspired Reinforcement Learning
    Wang, Dan
    Song, Bin
    Lin, Peng
    Yu, F. Richard
    Du, Xiaojiang
    Guizani, Mohsen
    IEEE INTERNET OF THINGS JOURNAL, 2021, 9 (14): : 12588 - 12600
  • [47] Deep Reinforcement Learning Assisted UAV Trajectory and Resource Optimization for NOMA Networks
    Chen, Peixin
    Zhao, Jian
    Shen, Furao
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 933 - 938
  • [48] Joint Optimization of Trajectory and User Association via Reinforcement Learning for UAV-Aided Data Collection in Wireless Networks
    Chen, Gong
    Zhai, Xiangping Bryce
    Li, Congduan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (05) : 3128 - 3143
  • [49] Trajectory Design and Generalization for UAV Enabled Networks:A Deep Reinforcement Learning Approach
    Li, Xuan
    Wang, Qiang
    Liu, Jie
    Zhang, Wenqi
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [50] Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning With Sequential Model
    Zhu, Botao
    Bedeer, Ebrahim
    Nguyen, Ha H.
    Barton, Robert
    Henry, Jerome
    IEEE INTERNET OF THINGS JOURNAL, 2021, 9 (14): : 12071 - 12084