ADAPTIVE SCHEDULING OF AERO-ENGINE ASSEMBLY BASED ON Q-LEARNING IN KNOWLEDGEABLE MANUFACTURE

被引:0
|
作者
Yan, Hong-Sen [1 ,2 ]
Jiang, Nan-Yun [3 ]
Wang, Hao-Xiang [1 ,2 ,4 ]
机构
[1] Southeast Univ, MOE Key Lab Measurement & Control Complex Syst En, Nanjing, Peoples R China
[2] Southeast Univ, Sch Automat, Nanjing, Peoples R China
[3] Nanjing Technol Univ, Dept Econ & Management, Nanjing, Peoples R China
[4] Nanjing Agr Univ, Coll Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive Scheduling; Aero-engine Assembly Workshop; Knowledgeable Manufacturing; Assembly Q-learning; ALGORITHM; OPTIMIZATION; UNCERTAINTY;
D O I
10.23055/ijietap.2022.29.3.3311
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
An adaptive optimization scheduling AQ (Assembly Q-learning) algorithm of knowledgeable manufacture is proposed for an aero-engine assembly line to address the scheduling of an aero-engine assembly workshop in an uncertain manufacture system, which combines the real-time feature of Q-learning with the self-adaptation feature of knowledgeable manufacture system. An adaptive scheduling model of aero-engine assembly based on Q-learning is developed for the purpose of minimizing earliness penalty and completion time cost. New production scheduling rules are proposed to deal with the aero-engine assembly scheduling problem. Addressing the characteristics of aero-engine assembly, four system-state features are defined, and a proper reward is designed as a reward function. Coherence of the reward function and the scheduling objective is proved by theorem. Simulation tests show that the developed algorithm is superior to other scheduling rules in various situations. Particularly, in the ever-changing assembling environment, better results are guaranteed by the desirable adaptivity of the proposed algorithm. An adaptive optimization scheduling algorithm of an aero-engine assembly workshop in a knowledgeable environment is designed, whereby a problem-solving method based on Q-learning and process simulation is activated. The coherence of the reward function and the scheduling objective is proven by theorem. The developed algorithm is superior to the other scheduling rules in the vast majority of cases. Thus, through self-learning, the aero-engine assembly workshop has much higher efficiency and adaptability than the others
引用
收藏
页码:302 / 314
页数:13
相关论文
共 50 条
  • [1] Adaptive dynamic scheduling strategy in knowledgeable manufacturing based on improved Q-learning
    Wang, Yu-Fang
    Yan, Hong-Sen
    [J]. Kongzhi yu Juece/Control and Decision, 2015, 30 (11): : 1930 - 1936
  • [2] Adaptive scheduling method of aero-engine assembly line in uncertain environment
    Wang Y.-L.
    Liu J.
    Qiao F.
    Zhang J.-E.
    [J]. Kongzhi yu Juece/Control and Decision, 2024, 39 (05): : 1629 - 1635
  • [3] A Research on Aero-engine Control Based on Deep Q Learning
    Zheng, Qiangang
    Xi, Zhihua
    Hu, Chunping
    Zhang, Haibo
    Hu, Zhongzhi
    [J]. INTERNATIONAL JOURNAL OF TURBO & JET-ENGINES, 2022, 39 (04) : 541 - 547
  • [4] APPLICATION EXPERIENCE IN AERO-ENGINE MANUFACTURE
    DAVIS, AN
    [J]. METAL CONSTRUCTION AND BRITISH WELDING JOURNAL, 1974, 6 (12): : 394 - 394
  • [5] Self-evolution of knowledgeable manufacturing systems oriented to aero-engine assembly shop
    School of Automation, Southeast University, Nanjing
    210096, China
    不详
    264025, China
    不详
    210096, China
    [J]. Jisuanji Jicheng Zhizao Xitong, 12 (3222-3230):
  • [6] Adaptive scheduling for assembly job shop with uncertain assembly times based on dual Q-learning
    Wang, Haoxiang
    Sarker, Bhaba R.
    Li, Jing
    Li, Jian
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2021, 59 (19) : 5867 - 5883
  • [7] Rolling self-evolution of an aero-engine assembly shop in uncertain knowledgeable manufacturing environment
    Jiang, Tianhua
    Yan, Hongsen
    Wang, Zheng
    [J]. Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2017, 53 (01): : 165 - 173
  • [8] Adaptive packet scheduling in IoT environment based on Q-learning
    Kim, Donghyun
    Lee, Taeho
    Kim, Sejun
    Lee, Byungjun
    Youn, Hee Yong
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 11 (06) : 2225 - 2235
  • [9] Adaptive packet scheduling in IoT environment based on Q-learning
    Donghyun Kim
    Taeho Lee
    Sejun Kim
    Byungjun Lee
    Hee Yong Youn
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2020, 11 : 2225 - 2235
  • [10] Self-reconfiguration and rescheduling of aero-engine assembly shop with rework disruption in knowledgeable manufacturing environment
    Yan, Hong-Sen
    Wan, Xiao-Qin
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART B-JOURNAL OF ENGINEERING MANUFACTURE, 2023, 237 (08) : 1230 - 1240