Vibration Control with Reinforcement Learning Based on Multi-Reward Lightweight Networks

被引:0
|
作者
Shu, Yucheng [1 ]
He, Chaogang [1 ]
Qiao, Lihong [1 ]
Xiao, Bin [1 ]
Li, Weisheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 09期
基金
中国国家自然科学基金;
关键词
active vibration control; reinforcement learning; lightweight; neural network; prioritized experience replaying; reward function; ALGORITHM;
D O I
10.3390/app14093853
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This paper proposes a reinforcement learning method using a deep residual shrinkage network based on multi-reward priority experience playback for high-frequency and high-dimensional continuous vibration control. Firstly, we keep the underlying equipment unchanged and construct a vibration system simulator using FIR filters to ensure the complete fidelity of the physical model. Then, by interacting with the simulator using our proposed algorithm, we identify the optimal control strategy, which is directly applied to real-world scenarios in the form of a neural network. A multi-reward mechanism is proposed to assist the lightweight network to find a near-optimal control strategy, and a priority experience playback mechanism is used to prioritize the data to accelerate the convergence speed of the neural network and improve the data utilization efficiency. At the same time, the deep residual shrinkage network is introduced to realize adaptive denoising and lightweightness of the neural network. The experimental results indicate that under narrowband white-noise excitation ranging from 0 to 100 Hz, the DDPG algorithm achieved a vibration reduction effect of 12.728 dB, while our algorithm achieved a vibration reduction effect of 20.240 dB. Meanwhile, the network parameters were reduced by more than 7.5 times.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Multi-user reinforcement learning based multi-reward for spectrum access in cognitive vehicular networks
    Lingling Chen
    Quanjun Zhao
    Ke Fu
    Xiaohui Zhao
    Hongliang Sun
    [J]. Telecommunication Systems, 2023, 83 : 51 - 65
  • [2] Multi-user reinforcement learning based multi-reward for spectrum access in cognitive vehicular networks
    Chen, Lingling
    Zhao, Quanjun
    Fu, Ke
    Zhao, Xiaohui
    Sun, Hongliang
    [J]. TELECOMMUNICATION SYSTEMS, 2023, 83 (01) : 51 - 65
  • [3] Multi-Reward Architecture based Reinforcement Learning for Highway Driving Policies
    Yuan, Wei
    Yang, Ming
    He, Yuesheng
    Wang, Chunxiang
    Wang, Bing
    [J]. 2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 3810 - 3815
  • [4] Multi-reward reinforcement learning based development of inter-atomic potential models for silica
    Aditya Koneru
    Henry Chan
    Sukriti Manna
    Troy D. Loeffler
    Debdas Dhabal
    Andressa A. Bertolazzo
    Valeria Molinero
    Subramanian K. R. S. Sankaranarayanan
    [J]. npj Computational Materials, 9
  • [5] Multi-reward reinforcement learning based development of inter-atomic potential models for silica
    Koneru, Aditya
    Chan, Henry
    Manna, Sukriti
    Loeffler, Troy D.
    Dhabal, Debdas
    Bertolazzo, Andressa A.
    Molinero, Valeria
    Sankaranarayanan, Subramanian K. R. S.
    [J]. NPJ COMPUTATIONAL MATERIALS, 2023, 9 (01)
  • [6] Time-Varying Weights in Multi-Reward Architecture for Deep Reinforcement Learning
    Xu, Meng
    Chen, Xinhong
    She, Yechao
    Jin, Yang
    Wang, Jianping
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1865 - 1881
  • [7] Generating Adversarial Examples for Low-Resource NMT via Multi-Reward Reinforcement Learning
    Sun, Shuo
    Hou, Hong-xu
    Yang, Zong-heng
    Wang, Yi-song
    Wu, Ni-er
    [J]. 2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 1175 - 1180
  • [8] Multi-reward Reinforcement Learning Based Bond-Order Potential to Study Strain-Assisted Phase Transitions in Phosphorene
    Koneru, Aditya
    Batra, Rohit
    Manna, Sukriti
    Loeffler, Troy D.
    Chan, Henry
    Sternberg, Michael
    Avarca, Anthony
    Singh, Harpal
    Cherukara, Mathew J.
    Sankaranarayanan, Subramanian K. R. S.
    [J]. JOURNAL OF PHYSICAL CHEMISTRY LETTERS, 2022, 13 (07): : 1886 - 1893
  • [9] Soft-Reward Based Reinforcement Learning by Spiking Neural Networks
    Shi, Weiya
    [J]. ADVANCED RESEARCH ON INFORMATION SCIENCE, AUTOMATION AND MATERIAL SYSTEM, PTS 1-6, 2011, 219-220 : 770 - 773
  • [10] Research on Vibration Reduction Control Based on Reinforcement Learning
    Yuan, Rongyao
    Yang, Yang
    Su, Chao
    Hu, Shaopei
    Zhang, Heng
    Cao, Enhua
    [J]. ADVANCES IN CIVIL ENGINEERING, 2021, 2021