Jump detection in financial time series usingmachine learning algorithms

被引:19
|
作者
Yeung, Jay F. K. Au [1 ]
Wei, Zi-kai [2 ]
Chan, Kit Yan [3 ]
Lau, Henry Y. K. [1 ]
Yiu, Ka-Fai Cedric [2 ]
机构
[1] Univ Hong Kong, Dept Ind & Mfg Syst Engn, Pokfulam, Hong Kong, Peoples R China
[2] Hong Kong Polytech Univ, Dept Appl Math, Hung Hom, Kowloon, Hong Kong, Peoples R China
[3] Curtin Univ, Sch Elect Engn Comp & Math Sci, Perth, WA, Australia
关键词
Recurrent neural network; Anomaly detection; Machine learning; Long short-term memory (LSTM) neural network; OUTLIERS; MARKETS;
D O I
10.1007/s00500-019-04006-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we develop a new Hybrid method based on machine learning algorithms for jump detection in financial time series. Jump is an important behavior in financial time series, since it implies a change in volatility. Ones can buy the volatility instrument if ones expect the volatility will bloom up in the future. A jump detection model attempts to detect short-term market instability, since it could be jumping up or down, instead of a directional prediction. The directional prediction can be considered as a momentum or trend following, which is not the focus of this paper. A jump detection model is commonly applied in a systematic fast-moving strategy, which reallocates the assets automatically. Also, a systematic opening position protection strategy can be driven by a jump detection model. For example, for a tail risk protection strategy, a pair of long call and put option order could be placed in the same time, in order to protect the open position given a huge change in volatility. One of the key differentiations of the proposed model with the classical methods of time-series anomaly detection is that, jump threshold parameters are not required to be predefined in our proposed model. Also the model is a combination of a Long short-term memory (LSTM) neural network model and a machine learning pattern recognition model. The LSTM model is applied for time series prediction, which predicts the next data point. The historical prediction errors sequence can be used as the information source or input of the jump detection model/module. The machine learning pattern recognition model is applied for jump detection. The combined model attempts to determine whether the current data point is a jump or not. LSTM neural network is a type of Recurrent Neural Networks (RNNs). LSTM records not only the recent market, but also the historical status. A stacked RNN is trained on a dataset which is mixed with normal and anomalous data. We compare the performance of the proposed Hybrid jump detection model and different pattern classification algorithms, such as k-nearest neighbors algorithm identifier, Hampel identifier, and Lee Mykland test. The model is trained and tested using real financial market data, including 11 global stock market in both developed and emerging markets in US, China, Hong Kong, Taiwan, Japan, UK, German, and Israel. The experiment result shows that the proposed Hybrid jump detection model is effective to detect jumps in terms of accuracy, comparing to the other classical jump detection methods.
引用
收藏
页码:1789 / 1801
页数:13
相关论文
共 50 条
  • [31] A survey on machine learning models for financial time series forecasting
    Tang, Yajiao
    Song, Zhenyu
    Zhu, Yulin
    Yuan, Huaiyu
    Hou, Maozhang
    Ji, Junkai
    Tang, Cheng
    Li, Jianqiang
    NEUROCOMPUTING, 2022, 512 : 363 - 380
  • [32] Investigating machine learning attacks on financial time series models
    Gallagher, Michael
    Pitropakis, Nikolaos
    Chrysoulas, Christos
    Papadopoulos, Pavlos
    Mylonas, Alexios
    Katsikas, Sokratis
    COMPUTERS & SECURITY, 2022, 123
  • [33] Wavelet-based detection of outliers in financial time series
    Grane, Aurea
    Veiga, Helena
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (11) : 2580 - 2593
  • [34] Multi-Scale Event Detection in Financial Time Series
    de Salles, Diego Silva
    Gea, Cristiane
    Mello, Carlos E.
    Assis, Laura
    Coutinho, Rafaelli
    Bezerra, Eduardo
    Ogasawara, Eduardo
    COMPUTATIONAL ECONOMICS, 2025, 65 (01) : 211 - 239
  • [35] Dynamic relationship identification for abnormality detection on financial time series
    Li, Gen
    Jung, Jason J.
    PATTERN RECOGNITION LETTERS, 2021, 145 (145) : 194 - 199
  • [36] The Financial Data of Anomaly Detection Research based on Time Series
    Guo, Chen-Ming
    Xu, Ling-Yu
    Liu, Hui-Fang
    Wang, Lei
    Yu, Xiang
    Han, Bo
    2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATIONS (CSA), 2015, : 86 - 89
  • [37] Detection of outliers in the financial time series using ARIMA models
    Agnieszka, Duraj
    Magdalena, Ludwicka
    2018 APPLICATIONS OF ELECTROMAGNETICS IN MODERN TECHNIQUES AND MEDICINE (PTZE), 2018, : 49 - 52
  • [38] Data mining for the detection of turning points in financial time series
    Poddig, T
    Huber, C
    ADVANCES IN INTELLIGENT DATA ANALYSIS, PROCEEDINGS, 1999, 1642 : 427 - 436
  • [39] A Study on Outlier Detection Method for Financial Time Series Data
    Ha, M. H.
    Kim, S.
    KOREAN JOURNAL OF APPLIED STATISTICS, 2010, 23 (01) : 41 - 47
  • [40] Detection of Uncertainty Events in the Brazilian Economic and Financial Time Series
    Gea, Cristiane
    Vereda, Luciano
    Ogasawara, Eduardo
    COMPUTATIONAL ECONOMICS, 2024, 64 (03) : 1507 - 1538