Literacy Deep Reinforcement Learning-Based Federated Digital Twin Scheduling for the Software-Defined Factory

被引:0
|
作者
Ahn, Jangsu [1 ]
Yun, Seongjin [1 ]
Kwon, Jin-Woo [1 ]
Kim, Won-Tae [1 ]
机构
[1] Korea Univ Technol & Educ, Dept Comp Sci & Engn, Future Convergence Engn Major, Cheonan 31253, South Korea
关键词
industrial metaverse; federated digital twins; large language model; flexible job-shop; scheduling; the software-defined factory; MASS CUSTOMIZATION;
D O I
10.3390/electronics13224452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As user requirements become increasingly complex, the demand for product personalization is growing, but traditional hardware-centric production relies on fixed procedures that lack the flexibility to support diverse requirements. Although bespoke manufacturing has been introduced, it provides users with only a few standardized options, limiting its ability to meet a wide range of needs. To address this issue, a new manufacturing concept called the software-defined factory has emerged. It is an autonomous manufacturing system that provides reconfigurable manufacturing services to produce tailored products. Reinforcement learning has been suggested for flexible scheduling to satisfy user requirements. However, fixed rule-based methods struggle to accommodate conflicting needs. This study proposes a novel federated digital twin scheduling that combines large language models and deep reinforcement learning algorithms to meet diverse user requirements in the software-defined factory. The large language model-based literacy module analyzes requirements in natural language and assigns weights to digital twin attributes to achieve highly relevant KPIs, which are used to guide scheduling decisions. The deep reinforcement learning-based scheduling module optimizes scheduling by selecting the job and machine with the maximum reward. Different types of user requirements, such as reducing manufacturing costs and improving productivity, are input and evaluated by comparing the flow-shop scheduling with job-shop scheduling based on reinforcement learning. Experimental results indicate that in requirement case 1 (the manufacturing cost), the proposed method outperforms flow-shop scheduling by up to 14.9% and job-shop scheduling by 5.6%. For requirement case 2 (productivity), it exceeds the flow-shop method by up to 13.4% and the job-shop baseline by 7.2%. The results confirm that the literacy DRL scheduling proposed in this paper can handle the individual characteristics of requirements.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Federated Deep Reinforcement Learning for Task Offloading in Digital Twin Edge Networks
    Dai, Yueyue
    Zhao, Jintang
    Zhang, Jing
    Zhang, Yan
    Jiang, Tao
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (03): : 2849 - 2863
  • [42] Reinforcement Learning-Based DoS Mitigation in Software Defined Networks
    VishnuPriya, A.
    ICCCE 2018, 2019, 500 : 393 - 401
  • [43] Learning to Fly: A Distributed Deep Reinforcement Learning Framework for Software-Defined UAV Network Control
    Cheng, Hai
    Bertizzolo, Lorenzo
    D'oro, Salvatore
    Buczek, John
    Melodia, Tommaso
    Bentley, Elizabeth Serena
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2021, 2 : 1486 - 1504
  • [44] Reconfigurable Network Topology Based on Deep Reinforcement Learning in Software-Defined Data-Center Networks
    Yang, Wen
    Guo, Bingli
    Shang, Yu
    Huang, Shanguo
    2020 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP) AND INTERNATIONAL CONFERENCE ON INFORMATION PHOTONICS AND OPTICAL COMMUNICATIONS (IPOC), 2020,
  • [45] Flow-based Service Time optimization in software-defined networks using Deep Reinforcement Learning
    Jimenez-Lazaro, Manuel
    Berrocal, Javier
    Galan-Jimenez, Jaime
    COMPUTER COMMUNICATIONS, 2024, 216 : 54 - 67
  • [46] AQMDRL: Automatic Quality of Service Architecture Based on Multistep Deep Reinforcement Learning in Software-Defined Networking
    Chen, Junyan
    Liao, Cenhuishan
    Wang, Yong
    Jin, Lei
    Lu, Xiaoye
    Xie, Xiaolan
    Yao, Rui
    SENSORS, 2023, 23 (01)
  • [47] Reinforcement Learning for Autonomous Defence in Software-Defined Networking
    Han, Yi
    Rubinstein, Benjamin I. P.
    Abraham, Tamas
    Alpcan, Tansu
    De Vel, Olivier
    Erfani, Sarah
    Hubczenko, David
    Leckie, Christopher
    Montague, Paul
    DECISION AND GAME THEORY FOR SECURITY, GAMESEC 2018, 2018, 11199 : 145 - 165
  • [48] Optimizing QoS Metrics for Software-Defined Networking in Federated Learning
    Fallah, Mahdi
    Mohammadi, Parya
    Nasirifard, Mohammadreza
    Salehpour, Pedram
    Mobile Information Systems, 2023, 2023
  • [49] A Machine Learning-Based Anomaly Prediction Service for Software-Defined Networks
    Latif, Zohaib
    Umer, Qasim
    Lee, Choonhwa
    Sharif, Kashif
    Li, Fan
    Biswas, Sujit
    SENSORS, 2022, 22 (21)
  • [50] Learning-based Incast Performance Inference in Software-Defined Data Centers
    Nougnanke, Kokouvi Benoit
    Labit, Yann
    Bruyere, Marc
    Ferlin, Simone
    Aivodji, Ulrich
    2021 24TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS (ICIN), 2021,