An application of deep reinforcement learning to algorithmic trading

被引:68
|
作者
Theate, Thibaut [1 ]
Ernst, Damien [1 ]
机构
[1] Univ Liege, Inst Montefiore, Allee Decouverte 10, B-4000 Liege, Belgium
关键词
Artificial intelligence; Deep reinforcement learning; Algorithmic trading; Trading policy;
D O I
10.1016/j.eswa.2021.114632
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This scientific research paper presents an innovative approach based on deep reinforcement learning (DRL) to solve the algorithmic trading problem of determining the optimal trading position at any point in time during a trading activity in the stock market. It proposes a novel DRL trading policy so as to maximise the resulting Sharpe ratio performance indicator on a broad range of stock markets. Denominated the Trading Deep Q-Network algorithm (TDQN), this new DRL approach is inspired from the popular DQN algorithm and significantly adapted to the specific algorithmic trading problem at hand. The training of the resulting reinforcement learning (RL) agent is entirely based on the generation of artificial trajectories from a limited set of stock market historical data. In order to objectively assess the performance of trading strategies, the research paper also proposes a novel, more rigorous performance assessment methodology. Following this new performance assessment approach, promising results are reported for the TDQN algorithm.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Deep Robust Reinforcement Learning for Practical Algorithmic Trading
    Li, Yang
    Zheng, Wanshan
    Zheng, Zibin
    [J]. IEEE ACCESS, 2019, 7 : 108014 - 108022
  • [2] Survey on the application of deep learning in algorithmic trading
    Wang, Yongfeng
    Yan, Guofeng
    [J]. DATA SCIENCE IN FINANCE AND ECONOMICS, 2021, 1 (04): : 345 - 361
  • [3] Sentiment and Knowledge Based Algorithmic Trading with Deep Reinforcement Learning
    Nan, Abhishek
    Perumal, Anandh
    Zaiane, Osmar R.
    [J]. DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2022, PT I, 2022, 13426 : 167 - 180
  • [4] Algorithmic trading using combinational rule vector and deep reinforcement learning
    Huang, Zhen
    Li, Ning
    Mei, Wenliang
    Gong, Wenyong
    [J]. APPLIED SOFT COMPUTING, 2023, 147
  • [5] Algorithmic trading using continuous action space deep reinforcement learning
    Majidi, Naseh
    Shamsi, Mahdi
    Marvasti, Farokh
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 235
  • [6] Application of Deep Reinforcement Learning on Automated Stock Trading
    Chen, Lin
    Gao, Qiang
    [J]. PROCEEDINGS OF 2019 IEEE 10TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2019), 2019, : 29 - 33
  • [7] Using Reinforcement Learning in the Algorithmic Trading Problem
    E. S. Ponomarev
    I. V. Oseledets
    A. S. Cichocki
    [J]. Journal of Communications Technology and Electronics, 2019, 64 : 1450 - 1457
  • [8] Using Reinforcement Learning in the Algorithmic Trading Problem
    Ponomarev, E. S.
    Oseledets, I. V.
    Cichocki, A. S.
    [J]. JOURNAL OF COMMUNICATIONS TECHNOLOGY AND ELECTRONICS, 2019, 64 (12) : 1450 - 1457
  • [9] Optimal Action Space Search: an Effective Deep Reinforcement Learning Method for Algorithmic Trading
    Duan, Zhongjie
    Chen, Cen
    Cheng, Dawei
    Liang, Yuqi
    Qian, Weining
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 406 - 415
  • [10] A multi-agent deep reinforcement learning framework for algorithmic trading in financial markets
    Shavandi, Ali
    Khedmati, Majid
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 208