AN ACTOR-CRITIC REINFORCEMENT LEARNING APPROACH TO MINIMUM AGE OF INFORMATION SCHEDULING IN ENERGY HARVESTING NETWORKS

被引：16

作者：

Leng, Shiyang ^{[1
]}

Yener, Aylin ^{[2
]}

机构：

[1] Penn State Univ, Elect Engn Dept, University Pk, PA 16802 USA

[2] Ohio State Univ, Elect & Comp Engn Dept, Columbus, OH 43210 USA

来源：

2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) | 2021年

关键词：

Age of information; energy harvesting; user scheduling; actor-critic deep reinforcement learning;

D O I：

10.1109/ICASSP39728.2021.9415110

中图分类号：

O42 [声学];

学科分类号：

070206 ; 082403 ;

摘要：

We study age of information (AoI) minimization in a network consisting of energy harvesting transmitters that are scheduled to send status updates to their intended receivers. We consider the user scheduling problem over a communication session. To solve online user scheduling with causal knowledge of the system state, we formulate an infinite-state Markov decision problem and adopt model-free on-policy deep reinforcement learning (DRL), where the actor-critic algorithm with deep neural network function approximation is implemented. Comparable AoI to the offline optimal is demonstrated, verifying the efficacy of learning for AoI-focused scheduling and resource allocation problems in wireless networks.

引用

页码：8128 / 8132

页数：5

共 50 条

[1] An Actor-Critic Reinforcement Learning Approach for Energy Harvesting Communications Systems
Masadeh, Ala'eddin
Wang, Zhengdao
Kamal, Ahmed E.
2019 28TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND NETWORKS (ICCCN), 2019,
[2] THE APPLICATION OF ACTOR-CRITIC REINFORCEMENT LEARNING FOR FAB DISPATCHING SCHEDULING
Kim, Namyong
Shin, IIayong
2017 WINTER SIMULATION CONFERENCE (WSC), 2017, : 4570 - 4571
[3] User Scheduling and Resource Allocation in HetNets With Hybrid Energy Supply: An Actor-Critic Reinforcement Learning Approach
Wei, Yifei
Yu, F. Richard
Song, Mei
Han, Zhu
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (01) : 680 - 692
[4] Simultaneous Vibration Control and Energy Harvesting Using Actor-Critic Based Reinforcement Learning
Loong, Cheng Ning
Chang, C. C.
Dimitrakoloulos, Elias G.
ACTIVE AND PASSIVE SMART STRUCTURES AND INTEGRATED SYSTEMS XII, 2018, 10595
[5] Dynamic Bandwidth Allocation Scheme for Wireless Networks with Energy Harvesting Using Actor-Critic Deep Reinforcement Learning
Quang Vinh Do
Koo, Insoo
2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (ICAIIC 2019), 2019, : 138 - 142
[6] Maximizing Information Usefulness in Vehicular CP Networks Using Actor-Critic Reinforcement Learning
Ghnaya, Imed
Ahmed, Toufik
Mosbah, Mohamed
Aniss, Hasnaa
2022 18TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM 2022): INTELLIGENT MANAGEMENT OF DISRUPTIVE NETWORK TECHNOLOGIES AND SERVICES, 2022, : 296 - 302
[7] Optimal scheduling strategy of electricity and thermal energy storage based on soft actor-critic reinforcement learning approach
Zheng, Yingying
Wang, Hui
Wang, Jinglong
Wang, Zichong
Zhao, Yongning
JOURNAL OF ENERGY STORAGE, 2024, 92
[8] Actor-Critic Deep Reinforcement Learning for Energy Minimization in UAV-Aided Networks
Yuan, Yaxiong
Lei, Lei
Vu, Thang X.
Chatzinotas, Symeon
Ottersten, Bjorn
2020 EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS (EUCNC 2020), 2020, : 348 - 352
[9] An Actor-Critic Deep Reinforcement Learning Approach for Transmission Scheduling in Cognitive Internet of Things Systems
Yang, Helin
Xie, Xianzhong
IEEE SYSTEMS JOURNAL, 2020, 14 (01): : 51 - 60
[10] A World Model for Actor-Critic in Reinforcement Learning
Panov, A. I.
Ugadiarov, L. A.
PATTERN RECOGNITION AND IMAGE ANALYSIS, 2023, 33 (03) : 467 - 477

← 1 2 3 4 5 →