An innovative deep reinforcement learning-driven cutting parameters adaptive optimization method taking tool wear into account

被引:0
|
作者
Gao, Zhilie [1 ]
Chen, Ni [1 ]
Yang, Yingfei [1 ]
Li, Liang [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Mech & Elect Engn, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
The cutting parameters adaptive optimization; Tool wear monitoring; Markov decision process; Deep reinforcement learning; Proximal policy optimization algorithm;
D O I
10.1016/j.measurement.2024.116075
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Tool wear is critically important for the optimization of cutting parameters. However, the increasing nature of tool wear presents challenges to traditional meta-heuristic cutting parameter optimization methods. To address this issue, we propose an innovative deep reinforcement learning-driven cutting parameters adaptive optimization method taking tool wear into account. More specifically, we use the Markov Decision Process to simulate the optimization process of cutting parameters. Firstly, an innovative deep transfer learning algorithm is used for monitoring tool wear. With the progress of tool wear, the proximal policy optimization method of the transformer with multi-head attention mechanism interacts with the processing environment through a process of trial and error, and accumulates a wealth of experience in selecting cutting parameters through the reward function. The deep reinforcement learning model has quickly discern the best cutting parameters, relying on real-time tool wear value. The experimental results show that the proposed method outperforms other algorithms.
引用
收藏
页数:22
相关论文
共 21 条
  • [1] Adaptive optimization of cutting parameters in milling industry considering dynamic tool wear in intelligent manufacturing driven by reinforcement learning
    Gao, Zhilie
    Li, Liang
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 133 (9-10): : 4751 - 4760
  • [2] A data and knowledge-driven cutting parameter adaptive optimization method considering dynamic tool wear
    Li, Congbo
    Zhao, Xikun
    Cao, Huajun
    Li, Li
    Chen, Xingzheng
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2023, 81
  • [3] Deep Reinforcement Learning-Driven Optimization of End-to-End Key Provision in QKD Systems
    Seok, Yeongjun
    Kim, Ju-Bong
    Han, Youn-Hee
    Lim, Hyun-Kyo
    Lee, Chankyun
    Lee, Wonhyuk
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2025, 33 (02)
  • [4] Optimization method of CNC milling parameters based on deep reinforcement learning
    Deng Q.-L.
    Lu J.
    Chen Y.-H.
    Feng J.
    Liao X.-P.
    Ma J.-Y.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (11): : 2145 - 2155
  • [5] Deep Learning Tool Wear State Identification Method Based on Cutting Force Signal
    Li, Shuhang
    Li, Meiqiu
    Gao, Yingning
    SENSORS, 2025, 25 (03)
  • [6] An Improved Vibe Algorithm Based on Adaptive Thresholding and the Deep Learning-Driven Frame Difference Method
    Liu, Huilin
    Wei, Huazhang
    Yang, Gaoming
    Xia, Chenxing
    Zhao, Shenghui
    ELECTRONICS, 2023, 12 (16)
  • [7] An innovative Multisource Lightweight Adaptive Replayed Online Deep Transfer Learning algorithm for tool wear monitoring
    Gao, Zhilie
    Chen, Ni
    Yang, Yinfei
    Li, Liang
    JOURNAL OF MANUFACTURING PROCESSES, 2024, 124 : 261 - 281
  • [8] A deep reinforcement learning-driven multi-objective optimization and its applications on aero-engine maintenance strategy
    Wei, Zeqi
    Zhao, Zhibin
    Zhou, Zheng
    Ren, Jiaxin
    Tang, Yajun
    Yan, Ruqiang
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 74 : 316 - 328
  • [9] Deep Reinforcement Learning-Driven Adaptive Task. Offloading and Resource Allocation for UAV- Assisted Mobile Fdge Computing
    Gao, Yongqiang
    Li, Chuangxin
    Li, Zhenkun
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1004 - 1009
  • [10] Reinforcement Learning-Based Cutting Parameter Dynamic Decision Method Considering Tool Wear for a Turning Machining Process
    Zhao, Xikun
    Li, Congbo
    Tang, Ying
    Li, Xinyu
    Chen, Xingzheng
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2024, 11 (04) : 1053 - 1070