Adaptive Tuning of Dynamic Matrix Control for Uncertain Industrial Systems With Deep Reinforcement Learning

Dynamic matrix control (DMC) has been field-validated in many industrial practices, highlighting the critical importance of fine-tuning parameters for optimal performance. However, the tuning of well-performed parameters is challenging because the relationship between parameters and the performance of DMC is intricate to characterize for industrial systems with uncertainty. An adaptive tuning approach based on deep reinforcement learning (DRL) is proposed to optimize the performance of DMC for uncertain systems in this paper. The approach can online tune the horizons and weighting matrices of DMC in real time adaptive to the state and uncertainty of the systems. Compared with offline tuning approaches, the proposed approach does not need to tradeoff optimality for robustness. The proposed approach utilizes various state-of-the-art DRL algorithms, e.g., value-based and actor-critic-based, to develop online parameter tuning policies that can adapt to system uncertainty. A piecewise reward function is designed to improve the performance and stability of the agent. A novel predictor-switching criterion is developed to address the horizon inconsistency in the receding optimization process. The proposed approaches are validated by the moisture control task in industrial cigarette drying process.