AN ACTOR-CRITIC REINFORCEMENT LEARNING APPROACH TO MINIMUM AGE OF INFORMATION SCHEDULING IN ENERGY HARVESTING NETWORKS

被引：16

作者：

Leng, Shiyang ^{[1
]}

Yener, Aylin ^{[2
]}

机构：

[1] Penn State Univ, Elect Engn Dept, University Pk, PA 16802 USA

[2] Ohio State Univ, Elect & Comp Engn Dept, Columbus, OH 43210 USA

来源：

2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) | 2021年

关键词：

Age of information; energy harvesting; user scheduling; actor-critic deep reinforcement learning;

D O I：

10.1109/ICASSP39728.2021.9415110

中图分类号：

O42 [声学];

学科分类号：

070206 ; 082403 ;

摘要：

We study age of information (AoI) minimization in a network consisting of energy harvesting transmitters that are scheduled to send status updates to their intended receivers. We consider the user scheduling problem over a communication session. To solve online user scheduling with causal knowledge of the system state, we formulate an infinite-state Markov decision problem and adopt model-free on-policy deep reinforcement learning (DRL), where the actor-critic algorithm with deep neural network function approximation is implemented. Comparable AoI to the offline optimal is demonstrated, verifying the efficacy of learning for AoI-focused scheduling and resource allocation problems in wireless networks.

引用

页码：8128 / 8132

页数：5

共 50 条

[41] Reinforcement learning for automatic quadrilateral mesh generation: A soft actor-critic approach
Pan, Jie
Huang, Jingwei
Cheng, Gengdong
Zeng, Yong
NEURAL NETWORKS, 2023, 157 : 288 - 304
[42] A Developmental Actor-Critic Reinforcement Learning Approach for Task-Nonspecific Robot
Li, Xiaoan
Yang, Yuan
Sun, Yunming
Zhang, Lu
2016 IEEE CHINESE GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2016, : 2231 - 2237
[43] Forward Actor-Critic for Nonlinear Function Approximation in Reinforcement Learning
Veeriah, Vivek
van Seijen, Harm
Sutton, Richard S.
AAMAS'17: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2017, : 556 - 564
[44] Dynamic Actor-critic: Reinforcement Learning based Radio Resource Scheduling For LTE-Advanced
Tathe, Pallavi K.
Sharma, Manish
2018 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING COMMUNICATION CONTROL AND AUTOMATION (ICCUBEA), 2018,
[45] Asynchronous Actor-Critic for Multi-Agent Reinforcement Learning
Xiao, Yuchen
Tan, Weihao
Amato, Christopher
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
[46] ACTOR-CRITIC DEEP REINFORCEMENT LEARNING FOR DYNAMIC MULTICHANNEL ACCESS
Zhong, Chen
Lu, Ziyang
Gursoy, M. Cenk
Velipasalar, Senem
2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 599 - 603
[47] An Actor-Critic Hierarchical Reinforcement Learning Model for Course Recommendation
Liang, Kun
Zhang, Guoqiang
Guo, Jinhui
Li, Wentao
ELECTRONICS, 2023, 12 (24)
[48] Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks
Jiang, Wei
Feng, Daquan
Sun, Yao
Feng, Gang
Wang, Zhenzhong
Xia, Xiang-Gen
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (02) : 1239 - 1252
[49] Power Allocation in Dual Connectivity Networks Based on Actor-Critic Deep Reinforcement Learning
Moein, Elham
Hasibi, Ramin
Shokri, Matin
Rasti, Mehdi
17TH INTERNATIONAL SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT 2019), 2019, : 170 - 177
[50] Enhancing cotton irrigation with distributional actor-critic reinforcement learning
Chen, Yi
Lin, Meiwei
Yu, Zhuo
Sun, Weihong
Fu, Weiguo
He, Liang
AGRICULTURAL WATER MANAGEMENT, 2025, 307

← 1 2 3 4 5 →