Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach

被引:0
|
作者
Nie, Yiwen [1 ]
Zhao, Junhui [1 ,2 ]
Liu, Jun [3 ,4 ]
Jiang, Jing [5 ]
Ding, Ruijin [6 ,7 ,8 ]
机构
[1] Beijing Jioatong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[3] Tsinghua Univ, Inst Network Sci & Cyberspace, Beijing 100084, Peoples R China
[4] Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
[5] Xian Univ Posts & Telecommun, Shaanxi Key Lab Informat Commun Network & Secur, Xian 710121, Peoples R China
[6] Tsinghua Univ THUAI, Inst Artificial Intelligence, Beijing 100084, Peoples R China
[7] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[8] Tsinghua Univ, Beijing Natl Res Ctr Infonnat Sci & Technol BNRis, Dept Automat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
unmanned aerial vehicle (UAV); trajectory design; backscatter communication; deep reinforcement learning; energy-efficient; RESOURCE-ALLOCATION; OPTIMIZATION; PARADIGM; INTERNET; IOT; 5G;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Recently, backscatter communication (BC) has been introduced as a green paradigm for Internet of Things (IoT). Meanwhile, unmanned aerial vehicles (UAVs) can serve as aerial base stations (BSs) to enhance the performance of BC system thanks to their high mobility and flexibility. In this paper, we investigate the problem of energy efficiency (EE) for an energy-limited backscatter communication (BC) network, where backscatter devices (BDs) on the ground harvest energy from the wireless signal of a flying rotary-wing quadrotor. Specifically, we first reformulate the EE optimization problem as a Markov decision process (MDP) and then propose a deep reinforcement learning (DRL) algorithm to design the UAV trajectory with the constraints of the BD scheduling, the power reflection coefficients, the transmission power, and the fairness among BDs. Simulation results show the proposed DRL algorithm achieves close-to-optimal performance and significant EE gains compared to the benchmark schemes.
引用
收藏
页码:129 / 141
页数:13
相关论文
共 50 条
  • [41] Energy Efficient 3-D UAV Control for Persistent Communication Service and Fairness: A Deep Reinforcement Learning Approach
    Qi, Hang
    Hu, Zhiqun
    Huang, Hao
    Wen, Xiangming
    Lu, Zhaoming
    IEEE ACCESS, 2020, 8 : 53172 - 53184
  • [42] Energy-Efficient Resource Allocation and Trajectory Design for UAV Relaying Systems
    Zhang, Tong
    Liu, Gongliang
    Zhang, Haijun
    Kang, Wenjing
    Karagiannidis, George K.
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (10) : 6483 - 6498
  • [43] Energy-efficient trajectory design of UAV and resource optimization for data collection
    Guo, Shaoxiong
    Song, Zhiqun
    Li, Yong
    Liu, Lizhe
    Wang, Bin
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2024, 56 (09): : 48 - 55
  • [44] Energy-efficient UAV communication: A NOMA scheme with resource allocation and trajectory optimization
    Jin, Huilong
    Zhou, Yucong
    Jin, Xiaozi
    Zhang, Shuang
    PLOS ONE, 2024, 19 (04):
  • [45] Sub-Connected Hybrid Precoding and Trajectory Optimization Using Deep Reinforcement Learning for Energy-Efficient Millimeter-Wave UAV Communications
    Silvirianti
    Shin, Soo Young
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2023, 12 (09) : 1642 - 1646
  • [46] Trace Pheromone-Based Energy-Efficient UAV Dynamic Coverage Using Deep Reinforcement Learning
    Cheng, Xu
    Jiang, Rong
    Sang, Hongrui
    Li, Gang
    He, Bin
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (03) : 1063 - 1074
  • [47] Energy-Efficient Multi-UAV Network using Multi-Agent Deep Reinforcement Learning
    Ju, Hyungyu
    Shim, Byonghyo
    2022 IEEE VTS ASIA PACIFIC WIRELESS COMMUNICATIONS SYMPOSIUM, APWCS, 2022, : 70 - 74
  • [48] Radio Map-Based Trajectory Design for UAV-Assisted Wireless Energy Transmission Communication Network by Deep Reinforcement Learning
    Chen, Changhe
    Wu, Fahui
    ELECTRONICS, 2023, 12 (21)
  • [49] Deep Reinforcement Learning for Energy-Efficient Beamforming Design in Cell-Free Networks
    Li, Weilai
    Ni, Wanli
    Tian, Hui
    Hua, Meihui
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW), 2021,
  • [50] Energy-Efficient Mobile Crowdsensing by Unmanned Vehicles: A Sequential Deep Reinforcement Learning Approach
    Piao, Chengzhe
    Liu, Chi Harold
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 6312 - 6324