Combining Principal Component Analysis, Discrete Wavelet Transform and XGBoost to trade in the financial markets

被引:162
|
作者
Nobre, Joao [1 ]
Neves, Rui Ferreira [1 ]
机构
[1] Inst Super Tecn, Inst Telecomunicacoes, Ave Rovisco Pais 1, P-1049001 Lisbon, Portugal
关键词
Financial markets; Principal Component Analysis (PCA); Discrete Wavelet Transform (DWT); Extreme Gradient Boosting (XGBoost); Multi-Objective Optimization Genetic; Algorithm (MOO-GA);
D O I
10.1016/j.eswa.2019.01.083
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
When investing in financial markets it is crucial to determine a trading signal that can provide the investor with the best entry and exit points of the financial market, however this is a difficult task and has become a very popular research topic in the financial area. This paper presents an expert system in the financial area that combines Principal Component Analysis (PCA), Discrete Wavelet Transform (DWT), Extreme Gradient Boosting (XGBoost) and a Multi-Objective Optimization Genetic Algorithm (MOO-GA) in order to achieve high returns with a low level of risk. PCA is used to reduce the dimensionality of the financial input data set and the DWT is used to perform a noise reduction to every feature. The resultant data set is then fed to an XGBoost binary classifier that has its hyperparameters optimized by a MOO-GA. The importance of the PCA is analyzed and the results obtained show that it greatly improves the performance of the system. In order to improve even more the results obtained in the system using PCA, the PCA and the DWT are then applied together in one system and the results obtained show that this system is capable of outperforming the Buy and Hold (B&H) strategy in three of the five analyzed financial markets, achieving an average rate of return of 49.26% in the portfolio, while the B&H achieves on average 32.41%. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:181 / 194
页数:14
相关论文
共 50 条
  • [1] Combining NeuroEvolution and Principal Component Analysis to trade in the financial markets
    Nadkarni, Joao
    Neves, Rui Ferreira
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2018, 103 : 184 - 195
  • [2] PRINCIPAL COMPONENT ANALYSIS BASED ON DISCRETE WAVELET TRANSFORM
    Alenzi, Venus
    AlFiras, Mohanad
    [J]. THIRD INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND TECHNOLOGY (ICCET 2011), 2011, : 777 - +
  • [3] Shape from focus using principal component analysis in discrete wavelet transform
    Mahmood, Muhammad Tariq
    Shim, Seong-O
    Choi, Tae-Sun
    [J]. OPTICAL ENGINEERING, 2009, 48 (05)
  • [4] Heartbeat Classification using Discrete Wavelet Transform and Kernel Principal Component Analysis
    Yang, Shengkai
    Shen, Haibin
    [J]. 2013 IEEE TENCON SPRING CONFERENCE, 2013, : 34 - 38
  • [5] Automatic Target Recognition Based on Discrete Wavelet Transform and Principal Component Analysis
    Xu, Ning
    Jia, Ping
    [J]. 2012 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING (WICOM), 2012,
  • [6] Robust Digital Image Watermarking Based on Principal Component Analysis and Discrete Wavelet Transform
    Tsai, Jen-Sheng
    Huang, Win-Bin
    Li, Po-Hung
    Chen, Chao-Lieh
    Kuo, Yau-Hwang
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2008, 9TH PACIFIC RIM CONFERENCE ON MULTIMEDIA, 2008, 5353 : 506 - +
  • [7] Blind source separation by combining indepandent component analysis with complex discrete wavelet transform
    Zhang, Zhong
    Enomoto, Takeshi
    Miyake, Tetsuo
    Imamura, Takashi
    [J]. 2007 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION, VOLS 1-4, PROCEEDINGS, 2007, : 549 - +
  • [8] BLIND SOURCE SEPARATION BY COMBINING INDEPENDENT COMPONENT ANALYSIS WITH THE COMPLEX DISCRETE WAVELET TRANSFORM
    Zhang, Zhong
    Miyake, Tetsuo
    Imamura, Takashi
    Enomoto, Takashi
    Toda, Hiroshi
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2010, 6 (09): : 4157 - 4172
  • [9] Application of Principal Component Analysis and Discrete Wavelet Transform in Electronic Nose for Herbal Drinks Classification
    Agustika, Dyah Kurniawati
    Triyana, Kuwat
    [J]. ADVANCES OF SCIENCE AND TECHNOLOGY FOR SOCIETY, 2016, 1755
  • [10] The use of kernel principal component analysis and discrete wavelet transform to determine the gas and oil interface
    Heidary, Mohammad
    [J]. JOURNAL OF GEOPHYSICS AND ENGINEERING, 2015, 12 (03) : 386 - 399