Autonomous Industrial Management via Reinforcement Learning Towards Self-Learning Agents for Decision-Making

被引:9
|
作者
Espinosa-Leal, Leonardo [1 ]
Chapman, Anthony [2 ]
Westerlund, Magnus [1 ]
机构
[1] Arcada Univ Appl Sci, Dept Business Management & Analyt, Helsinki, Finland
[2] Univ Aberdeen, Comp Dept, Aberdeen, Scotland
关键词
Autonomous systems; reinforcement learning; self-play; digital twin; industry; 4.0; FUTURE;
D O I
10.3233/JIFS-189161
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Industry has always been in the pursuit of becoming more economically efficient and the current focus has been to reduce human labour using modern technologies. Even with cutting edge technologies, which range from packaging robots to AI for fault detection, there is still some ambiguity on the aims of some new systems, namely, whether they are automated or autonomous. In this paper, we indicate the distinctions between automated and autonomous systems as well as review the current literature and identify the core challenges for creating learning mechanisms of autonomous agents. We discuss using different types of extended realities, such as digital twins, how to train reinforcement learning agents to learn specific tasks through generalisation. Once generalisation is achieved, we discuss how these can be used to develop self-learning agents. We then introduce self-play scenarios and how they can be used to teach self-learning agents through a supportive environment that focuses on how the agents can adapt to different environments. We introduce an initial prototype of our ideas by solving a multi-armed bandit problem using two E-greedy algorithms. Further, we discuss future applications in the industrial management realm and propose a modular architecture for improving the decision-making process via autonomous agents.
引用
收藏
页码:8427 / 8439
页数:13
相关论文
共 50 条
  • [1] Autonomous Decision-Making for Aerobraking via Parallel Randomized Deep Reinforcement Learning
    Falcone, Giusy
    Putnam, Zachary R. R.
    [J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (03) : 3055 - 3070
  • [2] Towards Robust Decision-Making for Autonomous Highway Driving Based on Safe Reinforcement Learning
    Zhao, Rui
    Chen, Ziguo
    Fan, Yuze
    Li, Yun
    Gao, Fei
    [J]. SENSORS, 2024, 24 (13)
  • [3] A Decision-Making Strategy for Vehicle Autonomous Braking in Emergency via Deep Reinforcement Learning
    Fu, Yuchuan
    Li, Changle
    Yu, Fei Richard
    Luan, Tom H.
    Zhang, Yao
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (06) : 5876 - 5888
  • [4] Automatic Group Decision-Making for Algal Bloom Management Based on Information Self-Learning
    Bai, Yuting
    Niu, Yijie
    Zhao, Zhiyao
    Jin, Xuebo
    Wang, Xiaoyi
    [J]. WATER, 2024, 16 (06)
  • [5] Autonomous Maneuver Decision-Making Through Curriculum Learning and Reinforcement Learning With Sparse Rewards
    Wei, Yujie
    Zhang, Hongpeng
    Wang, Yuan
    Huang, Changqiang
    [J]. IEEE ACCESS, 2023, 11 : 73543 - 73555
  • [6] Autonomous Curriculum Generation for Self-Learning Agents
    Kurkcu, Anil
    Campolo, Domenico
    Tee, Keng Peng
    [J]. 16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 1104 - 1111
  • [7] Tactical Decision-Making in Autonomous Driving by Reinforcement Learning with Uncertainty Estimation
    Hoel, Carl-Johan
    Wolff, Krister
    Laine, Leo
    [J]. 2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 1563 - 1569
  • [8] A DECISION-MAKING METHOD FOR AUTONOMOUS VEHICLES BASED ON SIMULATION AND REINFORCEMENT LEARNING
    Zheng, Rui
    Liu, Chunming
    Guo, Qi
    [J]. PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 362 - 369
  • [9] Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making
    Gao, Fei
    Wang, Xiaodong
    Fan, Yuze
    Gao, Zhenhai
    Zhao, Rui
    [J]. IEEE ACCESS, 2024, 12 : 128007 - 128023
  • [10] A reinforcement learning approach to autonomous decision-making in smart electricity markets
    Markus Peters
    Wolfgang Ketter
    Maytal Saar-Tsechansky
    John Collins
    [J]. Machine Learning, 2013, 92 : 5 - 39