Learning Optimal Q-Function Using Deep Boltzmann Machine for Reliable Trading of Cryptocurrency

被引:10
|
作者
Bu, Seok-Jun [1 ]
Cho, Sung-Bae [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul, South Korea
关键词
Deep reinforcement learning; Q-network; Deep Boltzmann Machine; Portfolio management; NETWORKS; STOCK;
D O I
10.1007/978-3-030-03493-1_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The explosive price volatility from the end of 2017 to January 2018 shows that bitcoin is a high risk asset. The deep reinforcement algorithm is straightforward idea for directly outputs the market management actions to achieve higher profit instead of higher price-prediction accuracy. However, existing deep reinforcement learning algorithms including Q-learning are also limited to problems caused by enormous searching space. We propose a combination of double Q-network and unsupervised pre-training using Deep Boltzmann Machine (DBM) to generate and enhance the optimal Q-function in cryptocurrency trading. We obtained the profit of 2,686% in simulation, whereas the best conventional model had that of 2,087% for the same period of test. In addition, our model records 24% of profit while market price significantly drops by -64%.
引用
收藏
页码:468 / 480
页数:13
相关论文
共 50 条
  • [1] Using machine learning for cryptocurrency trading
    Sun, Jifeng
    Zhou, Yi
    Lin, Jianwu
    2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER PHYSICAL SYSTEMS (ICPS 2019), 2019, : 647 - 652
  • [2] Cryptocurrency Trading Using Machine Learning
    Koker, Thomas E.
    Koutmos, Dimitrios
    JOURNAL OF RISK AND FINANCIAL MANAGEMENT, 2020, 13 (08)
  • [3] Cryptocurrency Trading Agent Using Deep Reinforcement Learning
    Suliman, Uwais
    van Zyl, Terence L.
    Paskaramoorthy, Andrew
    2022 9TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE, ISCMI, 2022, : 6 - 10
  • [4] Lagrangian Method for Q-Function Learning (with Applications to Machine Translation)
    Huang Bojun
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [5] Trading Strategy of the Cryptocurrency Market Based on Deep Q-Learning Agents
    Huang, Chester S. J.
    Su, Yu-Sheng
    APPLIED ARTIFICIAL INTELLIGENCE, 2024, 38 (01)
  • [6] UNSURE - A machine learning approach to cryptocurrency trading
    Kochliaridis, Vasileios
    Papadopoulou, Anastasia
    Vlahavas, Ioannis
    APPLIED INTELLIGENCE, 2024, 54 (07) : 5688 - 5710
  • [7] Machine learning for cryptocurrency market prediction and trading
    Jaquart, Patrick
    Koepke, Sven
    Weinhardt, Christof
    JOURNAL OF FINANCE AND DATA SCIENCE, 2022, 8 : 331 - 352
  • [8] Deep Reinforcement Learning to Automate Cryptocurrency Trading
    Mahayana, Dimitri
    Shan, Elbert
    Fadhl'Abbas, Muhammad
    2022 12TH INTERNATIONAL CONFERENCE ON SYSTEM ENGINEERING AND TECHNOLOGY (ICSET 2022), 2022, : 36 - 41
  • [9] QFAE: Q-Function guided Action Exploration for offline deep reinforcement learning
    Pang, Teng
    Wu, Guoqiang
    Zhang, Yan
    Wang, Bingzheng
    Yin, Yilong
    PATTERN RECOGNITION, 2025, 158
  • [10] Online probabilistic knowledge distillation on cryptocurrency trading using Deep Reinforcement Learning
    Moustakidis, Vasileios
    Passalis, Nikolaos
    Tefas, Anastasios
    PATTERN RECOGNITION LETTERS, 2024, 186 : 243 - 249