A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning

被引:36
|
作者
Morales, Eduardo F. [1 ,2 ]
Murrieta-Cid, Rafael [1 ]
Becerra, Israel [1 ,3 ]
Esquivel-Basaldua, Marco A. [1 ]
机构
[1] Ctr Invest Matemat CIMAT, Guanajuato, Mexico
[2] Inst Nacl Astrofis Opt & Elect INAOE, Tonantzintla, Mexico
[3] Consejo Nacl Ciencia & Tecnol CONACyT, Mexico City, DF, Mexico
关键词
Deep learning; Deep reinforcement learning; Mobile robotics; Mobile robot navigation; Motion planning; Mobile manipulation; END-TO-END; REACHABILITY;
D O I
10.1007/s11370-021-00398-z
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This article is about deep learning (DL) and deep reinforcement learning (DRL) works applied to robotics. Both tools have been shown to be successful in delivering data-driven solutions for robotics tasks, as well as providing a natural way to develop an end-to-end pipeline from the robot's sensing to its actuation, passing through the generation of a policy to perform the given task. These frameworks have been proven to be able to deal with real-world complications such as noise in sensing, imprecise actuation, variability in the scenarios where the robot is being deployed, among others. Following that vein, and given the growing interest in DL and DRL, the present work starts by providing a brief tutorial on deep reinforcement learning, where the goal is to understand the main concepts and approaches followed in the field. Later, the article describes the main, recent, and most promising approaches of DL and DRL in robotics, with sufficient technical detail to understand the core of the works and to motivate interested readers to initiate their own research in the area. Then, to provide a comparative analysis, we present several taxonomies in which the references can be classified, according to high-level features, the task that the work addresses, the type of system, and the learning techniques used in the work. We conclude by presenting promising research directions in both DL and DRL.
引用
收藏
页码:773 / 805
页数:33
相关论文
共 50 条
  • [21] Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey
    Frikha, Mohamed Said
    Gammar, Sonia Mettali
    Lahmadi, Abdelkader
    Andrey, Laurent
    [J]. COMPUTER COMMUNICATIONS, 2021, 178 : 98 - 113
  • [22] Bayesian Deep Reinforcement Learning via Deep Kernel Learning
    Junyu Xuan
    Jie Lu
    Zheng Yan
    Guangquan Zhang
    [J]. International Journal of Computational Intelligence Systems, 2018, 12 : 164 - 171
  • [23] Bayesian Deep Reinforcement Learning via Deep Kernel Learning
    Xuan, Junyu
    Lu, Jie
    Yan, Zheng
    Zhang, Guangquan
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2019, 12 (01) : 164 - 171
  • [24] Tutorial and Survey on Probabilistic Graphical Model and Variational Inference in Deep Reinforcement Learning
    Sun, Xudong
    Bischl, Bernd
    [J]. 2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 110 - 119
  • [25] Deep Reinforcement Learning: An Overview
    Mousavi, Seyed Sajad
    Schukat, Michael
    Howley, Enda
    [J]. PROCEEDINGS OF SAI INTELLIGENT SYSTEMS CONFERENCE (INTELLISYS) 2016, VOL 2, 2018, 16 : 426 - 440
  • [26] Deep Reinforcement Learning with Adjustments
    Khorasgani, Hamed
    Wang, Haiyan
    Gupta, Chetan
    Serita, Susumu
    [J]. 2021 IEEE 19TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2021,
  • [27] Explainability in deep reinforcement learning
    Heuillet, Alexandre
    Couthouis, Fabien
    Diaz-Rodriguez, Natalia
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 214 (214)
  • [28] Implementation of Deep Reinforcement Learning
    Li, Meng-Jhe
    Li, An-Hong
    Huang, Yu-Jung
    Chu, Shao-I
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND SYSTEMS (ICISS 2019), 2019, : 232 - 236
  • [29] Deep Reinforcement Learning and Games
    Zhao, Dongbin
    Lucas, Simon
    Togelius, Julian
    [J]. IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2019, 14 (03) : 7 - 7
  • [30] Deep Ordinal Reinforcement Learning
    Zap, Alexander
    Joppen, Tobias
    Furnkranz, Johannes
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT III, 2020, 11908 : 3 - 18