A Sample-Aware Database Tuning System With Deep Reinforcement Learning

被引:0
|
作者
Li, Zhongliang [1 ]
Tu, Yaofeng [1 ]
Ma, Zongmin [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
关键词
DBTune Scheme; Intelligent Tuning; Machine Learning; SA-DDPG Model; MANAGEMENT;
D O I
10.4018/JDM.333519
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on the relationship between client load and overall system performance, the authors propose a sample-aware deep deterministic policy gradient model. Specifically, they improve sample quality by filtering out sample noise caused by the fluctuations of client load, which accelerates the model convergence speed of the intelligent tuning system and improves the tuning effect. Also, the hardware resources and client load consumed by the database in the working process are added to the model for training. This can enhance the performance characterization ability of the model and improve the recommended parameters of the algorithm. Meanwhile, they propose an improved closed-loop distributed comprehensive training architecture of online and offline training to quickly obtain high-quality samples and improve the efficiency of parameter tuning. Experimental results show that the configuration parameters can make the performance of the database system better and shorten the tuning time.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning
    Li, Guoliang
    Zhou, Xuanhe
    Li, Shifu
    Gao, Bo
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2019, 12 (12): : 2118 - 2130
  • [2] Informative Sample-Aware Proxy for Deep Metric Learning
    Li, Aoyu
    Sato, Ikuro
    Ishikawa, Kohta
    Kawakami, Rei
    Yokota, Rio
    PROCEEDINGS OF THE 4TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA IN ASIA, MMASIA 2022, 2022,
  • [3] Learning sample-aware threshold for semi-supervised learning
    Wei, Qi
    Feng, Lei
    Sun, Haoliang
    Wang, Ren
    He, Rundong
    Yin, Yilong
    MACHINE LEARNING, 2024, 113 (08) : 5423 - 5445
  • [4] MetaAugment: Sample-Aware Data Augmentation Policy Learning
    Zhou, Fengwei
    Li, Jiawei
    Xie, Chuanlong
    Chen, Fei
    Hong, Lanqing
    Sun, Rui
    Li, Zhenguo
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 11097 - 11105
  • [5] WATuning: A Workload-Aware Tuning System with Attention-Based Deep Reinforcement Learning
    Ge, Jia-Ke
    Chai, Yan-Feng
    Chai, Yun-Peng
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2021, 36 (04) : 741 - 761
  • [6] WATuning: A Workload-Aware Tuning System with Attention-Based Deep Reinforcement Learning
    Jia-Ke Ge
    Yan-Feng Chai
    Yun-Peng Chai
    Journal of Computer Science and Technology, 2021, 36 : 741 - 761
  • [7] An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning
    Zhang, Ji
    Liu, Yu
    Zhou, Ke
    Li, Guoliang
    Xiao, Zhili
    Cheng, Bin
    Xing, Jiashu
    Wang, Yangtao
    Cheng, Tianheng
    Liu, Li
    Ran, Minwei
    Li, Zekang
    SIGMOD '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2019, : 415 - 432
  • [8] XTuning: Expert Database Tuning System Based on Reinforcement Learning
    Chai, Yanfeng
    Ge, Jiake
    Chai, Yunpeng
    Wang, Xin
    Zhao, BoXuan
    WEB INFORMATION SYSTEMS ENGINEERING - WISE 2021, PT I, 2021, 13080 : 101 - 110
  • [9] CDBTune+: An efficient deep reinforcement learning-based automatic cloud database tuning system
    Zhang, Ji
    Zhou, Ke
    Li, Guoliang
    Liu, Yu
    Xie, Ming
    Cheng, Bin
    Xing, Jiashu
    VLDB JOURNAL, 2021, 30 (06): : 959 - 987
  • [10] Parameters tuning of multi-model database based on deep reinforcement learning
    Ye, Feng
    Li, Yang
    Wang, Xiwen
    Nedjah, Nadia
    Zhang, Peng
    Shi, Hong
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2023, 61 (01) : 167 - 190