WaveCorr: Deep reinforcement learning with permutation invariant convolutional policy networks for portfolio management

被引:0
|
作者
Marzban, Saeed [1 ]
Delage, Erick [1 ,4 ]
Li, Jonathan Yu -Meng [2 ]
Desgagne-Bouchard, Jeremie [3 ]
Dussault, Carl [3 ]
机构
[1] HEC Montreal, GERAD & Dept Decis Sci, Montreal, PQ, Canada
[2] Univ Ottawa, Telfer Sch Management, Ottawa, ON, Canada
[3] Evovest, Montreal, PQ, Canada
[4] 3000 Chemin Cote St Catherine, Montreal, PQ H3T 2A7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Reinforcement learning; Deep learning; Portfolio optimization; Permutation invariance; OPTIMIZATION;
D O I
10.1016/j.orl.2023.10.011
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We present a new portfolio policy convolutional neural network architecture, WaveCorr, for deep reinforcement learning applied to portfolio optimization. WaveCorr is the first to treat asset correlation while preserving "asset invariance property", a new permutation invariance property that significantly increases the stability of performance in problems where input indexing is done arbitrarily. A general theory is also derived for verifying this property in other fields of application. Our experiments show that WaveCorr consistently outperforms other state-of-the-art convolutional architectures.(c) 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons .org /licenses /by /4 .0/).
引用
收藏
页码:680 / 686
页数:7
相关论文
共 50 条
  • [1] Deep reinforcement learning for portfolio management
    Yang, Shantian
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 278
  • [2] Deep graph convolutional reinforcement learning for financial portfolio management-DeepPocket
    Soleymani, Farzan
    Paquet, Eric
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 182
  • [3] Cryptocurrency Portfolio Management with Deep Reinforcement Learning
    Jiang, Zhengyao
    Liang, Jinjun
    [J]. PROCEEDINGS OF THE 2017 INTELLIGENT SYSTEMS CONFERENCE (INTELLISYS), 2017, : 905 - 913
  • [4] Deep Reinforcement Learning for Quantitative Portfolio Management
    Wei, Ziqiang
    Chen, Deng
    [J]. 2023 THE 6TH INTERNATIONAL CONFERENCE ON ROBOT SYSTEMS AND APPLICATIONS, ICRSA 2023, 2023, : 237 - 242
  • [5] Deep Reinforcement Learning for Optimizing Finance Portfolio Management
    Hu, Yuh-Jong
    Lin, Shang-Jen
    [J]. PROCEEDINGS 2019 AMITY INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE (AICAI), 2019, : 14 - 20
  • [6] PIC: Permutation Invariant Critic for Multi-Agent Deep Reinforcement Learning
    Liu, Iou-Jen
    Yeh, Raymond A.
    Schwing, Alexander G.
    [J]. CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [7] The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement Learning
    Tang, Yujin
    Ha, David
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [8] XPM: An Explainable Deep Reinforcement Learning Framework for Portfolio Management
    Shi, Si
    Li, Jianjun
    Li, Guohui
    Pan, Peng
    Liu, Ke
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1661 - 1670
  • [9] Explainable Deep Reinforcement Learning for Portfolio Management: An Empirical Approach
    Guan, Mao
    Liu, Xiao-Yang
    [J]. ICAIF 2021: THE SECOND ACM INTERNATIONAL CONFERENCE ON AI IN FINANCE, 2021,
  • [10] A Portfolio Model with Risk Control Policy Based on Deep Reinforcement Learning
    Jiang, Caiyu
    Wang, Jianhua
    [J]. MATHEMATICS, 2023, 11 (01)