Real-Time Online Goal Recognition in Continuous Domains via Deep Reinforcement Learning

被引:0
|
作者
Fang, Zihao [1 ]
Chen, Dejun [1 ]
Zeng, Yunxiu [1 ]
Wang, Tao [1 ]
Xu, Kai [1 ]
机构
[1] Natl Univ Def Technol, Coll Syst Engn, Changsha 410000, Peoples R China
关键词
online goal recognition; deep reinforcement learning; continuous domain; communication constraints; information entropy;
D O I
10.3390/e25101415
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The problem of goal recognition involves inferring the high-level task goals of an agent based on observations of its behavior in an environment. Current methods for achieving this task rely on offline comparison inference of observed behavior in discrete environments, which presents several challenges. First, accurately modeling the behavior of the observed agent requires significant computational resources. Second, continuous simulation environments cannot be accurately recognized using existing methods. Finally, real-time computing power is required to infer the likelihood of each potential goal. In this paper, we propose an advanced and efficient real-time online goal recognition algorithm based on deep reinforcement learning in continuous domains. By leveraging the offline modeling of the observed agent's behavior with deep reinforcement learning, our algorithm achieves real-time goal recognition. We evaluate the algorithm's online goal recognition accuracy and stability in continuous simulation environments under communication constraints.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Heuristic Online Goal Recognition in Continuous Domains
    Vered, Mor
    Kaminka, Gal A.
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 4447 - 4454
  • [2] Real-Time Defensive Strategy Selection via Deep Reinforcement Learning
    Charpentier, Axel
    Neal, Christopher
    Boulahia-Cuppens, Nora
    Cuppens, Frederic
    Yaich, Reda
    [J]. 18TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY & SECURITY, ARES 2023, 2023,
  • [3] Real-time model calibration with deep reinforcement learning
    Tian, Yuan
    Chao, Manuel Arias
    Kulkarni, Chetan
    Goebel, Kai
    Fink, Olga
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2022, 165
  • [4] TTDeep: Time-Triggered Scheduling for Real-Time Ethernet via Deep Reinforcement Learning
    Jia, Hongyu
    Jiang, Yu
    Zhong, Chunmeng
    Wan, Hai
    Zhao, Xibin
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [5] Real-time Motion Planning for Robotic Teleoperation Using Dynamic-goal Deep Reinforcement Learning
    Kamali, Kaveh
    Bonev, Ilian A.
    Desrosiers, Christian
    [J]. 2020 17TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2020), 2020, : 182 - 189
  • [6] Real-time Guidance Strategy for Active Defense Aircraft via Deep Reinforcement Learning
    Li, Zhi
    Wu, Jinze
    Wu, Yuanpei
    Zheng, Yu
    Li, Meng
    Liang, Haizhao
    [J]. PROCEEDINGS OF THE 2021 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2021, : 177 - 183
  • [7] EXPERIMENTS WITH ONLINE REINFORCEMENT LEARNING IN REAL-TIME STRATEGY GAMES
    Andersen, Kresten Toftgaard
    Zeng, Yifeng
    Christensen, Dennis Dahl
    Tran, Dung
    [J]. APPLIED ARTIFICIAL INTELLIGENCE, 2009, 23 (09) : 855 - 871
  • [8] Triboelectric signal enhancement via interface structural design and integrated with deep learning for real-time online material recognition
    Shen, Cheng
    Chen, Jingyi
    Liu, Yue
    Chen, Zhenming
    Huang, Junjun
    [J]. Chemical Engineering Journal, 1600, 500
  • [9] Learning to Calibrate Battery Models in Real-Time with Deep Reinforcement Learning
    Unagar, Ajaykumar
    Tian, Yuan
    Chao, Manuel Arias
    Fink, Olga
    [J]. ENERGIES, 2021, 14 (05)
  • [10] Real-time Yoga recognition using deep learning
    Yadav, Santosh Kumar
    Singh, Amitojdeep
    Gupta, Abhishek
    Raheja, Jagdish Lal
    [J]. NEURAL COMPUTING & APPLICATIONS, 2019, 31 (12): : 9349 - 9361