Fast and Accurate Time-Series Clustering

被引:121
|
作者
Paparrizos, John [1 ]
Gravano, Luis [1 ]
机构
[1] Columbia Univ, Comp Sci Dept, 1214 Amsterdam Ave, New York, NY 10027 USA
来源
ACM TRANSACTIONS ON DATABASE SYSTEMS | 2017年 / 42卷 / 02期
关键词
Time-series clustering; time-series classification; distance measures; ALGORITHM; CLASSIFICATION; NEIGHBORHOOD;
D O I
10.1145/3044711
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The proliferation and ubiquity of temporal data across many disciplines has generated substantial interest in the analysis and mining of time series. Clustering is one of the most popular data-mining methods, not only due to its exploratory power but also because it is often a preprocessing step or subroutine for other techniques. In this article, we present k-Shape and k-MultiShapes (k-MS), two novel algorithms for time-series clustering. k-Shape and k-MS rely on a scalable iterative refinement procedure. As their distance measure, k-Shape and k-MS use shape-based distance (SBD), a normalized version of the cross-correlation measure, to consider the shapes of time series while comparing them. Based on the properties of SBD, we develop two new methods, namely ShapeExtraction (SE) and MultiShapesExtraction (MSE), to compute cluster centroids that are used in every iteration to update the assignment of time series to clusters. k-Shape relies on SE to compute a single centroid per cluster based on all time series in each cluster. In contrast, k-MS relies on MSE to compute multiple centroids per cluster to account for the proximity and spatial distribution of time series in each cluster. To demonstrate the robustness of SBD, k-Shape, and k-MS, we perform an extensive experimental evaluation on 85 datasets against state-of-the-art distance measures and clustering methods for time series using rigorous statistical analysis. SBD, our efficient and parameter-free distance measure, achieves similar accuracy to Dynamic TimeWarping (DTW), a highly accurate but computationally expensive distance measure that requires parameter tuning. For clustering, we compare k-Shape and k-MS against scalable and non-scalable partitional, hierarchical, spectral, density-based, and shapelet-based methods, with combinations of the most competitive distance measures. k-Shape outperforms all scalable methods in terms of accuracy. Furthermore, k-Shape also outperforms all non-scalable approaches, with one exception, namely k-medoids with DTW, which achieves similar accuracy. However, unlike k-Shape, this approach requires tuning of its distance measure and is significantly slower than k-Shape. k-MS performs similarly to k-Shape in comparison to rival methods, but k-MS is significantly more accurate than k-Shape. Beyond clustering, we demonstrate the effectiveness of k-Shape to reduce the search space of one-nearest-neighbor classifiers for time series. Overall, SBD, k-Shape, and k-MS emerge as domain-independent, highly accurate, and efficient methods for time-series comparison and clustering with broad applications.
引用
收藏
页数:49
相关论文
共 50 条
  • [11] Key radar signal fast recognition method based on clustering and time-series correlation
    Zhang, Yixiao
    Guo, Wenpu
    Kang, Kai
    Yao, Yunlong
    Wang, Pan
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2020, 42 (03): : 597 - 602
  • [12] Translational symmetry in subsequence time-series clustering
    Ide, Tsuyoshi
    [J]. NEW FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2007, 4384 : 5 - 18
  • [13] Clustering to Forecast Sparse Time-Series Data
    Jha, Abhay
    Ray, Shubhankar
    Seaman, Brian
    Dhillon, Inderjit S.
    [J]. 2015 IEEE 31ST INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2015, : 1388 - 1399
  • [14] Logical Clustering and Learning for Time-Series Data
    Vazquez-Chanlatte, Marcell
    Deshmukh, Jyotirmoy V.
    Jin, Xiaoqing
    Seshia, Sanjit A.
    [J]. COMPUTER AIDED VERIFICATION, CAV 2017, PT I, 2017, 10426 : 305 - 325
  • [15] Time-series data dynamic density clustering
    Chen, Hao
    Xia, Yu
    Pan, Yuekai
    Yang, Qing
    [J]. INTELLIGENT DATA ANALYSIS, 2021, 25 (06) : 1487 - 1506
  • [16] Fuzzy clustering based segmentation of time-series
    Abonyi, J
    Feil, B
    Nemeth, S
    Arva, P
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS V, 2003, 2810 : 275 - 285
  • [17] Hierarchical clustering of time-series data streams
    Rodrigues, Pedro Pereira
    Gama, Joao
    Pedroso, Joao Pedro
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2008, 20 (05) : 615 - 627
  • [18] DIAMOND FAST - INTERACTIVE GRAPHICS FOR TIME-SERIES
    UNWIN, A
    [J]. AMERICAN STATISTICIAN, 1991, 45 (04): : 340 - 340
  • [19] A Sparse Regression Mixture Model for Clustering Time-Series
    Blekas, K.
    Galatsanos, N.
    Likas, A.
    [J]. ARTIFICIAL INTELLIGENCE: THEORIES, MODELS AND APPLICATIONS, SETN 2008, 2008, 5138 : 64 - 72
  • [20] A methodology for index tracking based on time-series clustering
    Focardi, SM
    Fabozzi, FJ
    [J]. QUANTITATIVE FINANCE, 2004, 4 (04) : 417 - 425