Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach

被引:0
|
作者
Nie, Yiwen [1 ]
Zhao, Junhui [1 ,2 ]
Liu, Jun [3 ,4 ]
Jiang, Jing [5 ]
Ding, Ruijin [6 ,7 ,8 ]
机构
[1] Beijing Jioatong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[3] Tsinghua Univ, Inst Network Sci & Cyberspace, Beijing 100084, Peoples R China
[4] Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
[5] Xian Univ Posts & Telecommun, Shaanxi Key Lab Informat Commun Network & Secur, Xian 710121, Peoples R China
[6] Tsinghua Univ THUAI, Inst Artificial Intelligence, Beijing 100084, Peoples R China
[7] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[8] Tsinghua Univ, Beijing Natl Res Ctr Infonnat Sci & Technol BNRis, Dept Automat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
unmanned aerial vehicle (UAV); trajectory design; backscatter communication; deep reinforcement learning; energy-efficient; RESOURCE-ALLOCATION; OPTIMIZATION; PARADIGM; INTERNET; IOT; 5G;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Recently, backscatter communication (BC) has been introduced as a green paradigm for Internet of Things (IoT). Meanwhile, unmanned aerial vehicles (UAVs) can serve as aerial base stations (BSs) to enhance the performance of BC system thanks to their high mobility and flexibility. In this paper, we investigate the problem of energy efficiency (EE) for an energy-limited backscatter communication (BC) network, where backscatter devices (BDs) on the ground harvest energy from the wireless signal of a flying rotary-wing quadrotor. Specifically, we first reformulate the EE optimization problem as a Markov decision process (MDP) and then propose a deep reinforcement learning (DRL) algorithm to design the UAV trajectory with the constraints of the BD scheduling, the power reflection coefficients, the transmission power, and the fairness among BDs. Simulation results show the proposed DRL algorithm achieves close-to-optimal performance and significant EE gains compared to the benchmark schemes.
引用
收藏
页码:129 / 141
页数:13
相关论文
共 50 条
  • [1] Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach
    Yiwen Nie
    Junhui Zhao
    Jun Liu
    Jing Jiang
    Ruijin Ding
    中国通信, 2020, 17 (10) : 129 - 141
  • [2] Energy-Efficient UAV Backscatter Communication With Joint Trajectory Design and Resource Optimization
    Yang, Gang
    Dai, Rao
    Liang, Ying-Chang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (02) : 926 - 941
  • [3] 3D UAV Trajectory Design and Frequency Band Allocation for Energy-Efficient and Fair Communication: A Deep Reinforcement Learning Approach
    Ding, Ruijin
    Gao, Feifei
    Shen, Xuemin
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (12) : 7796 - 7809
  • [4] Energy-Efficient UAV Trajectory Design with Information Freshness Constraint via Deep Reinforcement Learning
    Li, Xinmin
    Li, Jiahui
    Liu, Dandan
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [5] Energy-Efficient UAV Backscatter Communication with Joint Trajectory and Resource Optimization
    Yang, Gang
    Dai, Rao
    Liang, Ying-Chang
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [6] Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach
    Liu, Chi Harold
    Chen, Zheyu
    Tang, Jian
    Xu, Jie
    Piao, Chengzhe
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (09) : 2059 - 2070
  • [7] Energy-Efficient UAV Movement Control for Fair Communication Coverage: A Deep Reinforcement Learning Approach
    Nemer, Ibrahim A.
    Sheltami, Tarek R.
    Belhaiza, Slim
    Mahmoud, Ashraf S.
    SENSORS, 2022, 22 (05)
  • [8] Deep Reinforcement Learning for Secrecy Energy-Efficient UAV Communication with Reconfigurable Intelligent Surface
    Tham, Mau-Luen
    Wong, Yi Jie
    Iqbal, Amjad
    Bin Ramli, Nordin
    Zhu, Yongxu
    Dagiuklas, Tasos
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [9] Reinforcement Learning for Energy-Efficient Trajectory Design of UAVs
    Arani, Atefeh Hajijamali
    Azari, M. Mahdi
    Hu, Peng
    Zhu, Yeying
    Yanikomeroglu, Halim
    Safavi-Naeini, Safieddin
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (11): : 9060 - 9070
  • [10] Joint Trajectory and Power Optimization for Energy Efficient UAV Communication Using Deep Reinforcement Learning
    Cui, Yuling
    Deng, Danhao
    Wang, Chaowei
    Wang, Weidong
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,