Multi-modal and multi-scale temporal metric learning for a robust time series nearest neighbors classification

被引:9
|
作者
Do, Cao-Tri [1 ,2 ,3 ]
Douzal-Chouakria, Ahlame [1 ]
Marie, Sylvain [3 ]
Rombaut, Michele [2 ]
Varasteh, Saeed [1 ]
机构
[1] Univ Grenoble Alpes, Grenoble INP, CNRS, LIG, F-38000 Grenoble, France
[2] Univ Grenoble Alpes, GIPSA Lab, Grenoble, France
[3] Schneider Elect, Eybens, France
关键词
Metric learning; Time series; Classification; kNN; Svm; Dissimilarity space; Multi-modal metric; Multi-scale metric; EDIT DISTANCE; KERNEL; TRANSFORMATION;
D O I
10.1016/j.ins.2017.08.020
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The definition of a metric between time series is inherent to several data analysis and mining tasks, including clustering, classification or forecasting. Time series data present naturally several modalities covering their amplitude, behavior or frequential spectrum, that may be expressed with varying delays and at multiple temporal scales exhibited globally or locally. Combining several modalities at multiple temporal scales to learn a holistic metric is a key challenge for many real temporal data applications. This paper proposes a Multi-modal and Multi-scale Temporal Metric Learning ((MTML)-T-2) approach for a robust time series nearest neighbors classification. The solution lies in embedding time series into a dissimilarity space where a pairwise SVM is used to learn both linear and non linear combined metric. A sparse and interpretable variant of the solution shows the ability of the learned temporal metric to localize accurately discriminative modalities as well as their temporal scales. A wide range of 30 public and challenging datasets, encompassing images, traces and ECG data, are used to show the efficiency and the potential of (MTML)-T-2 for an effective time series nearest neighbors classification. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:272 / 285
页数:14
相关论文
共 50 条
  • [1] A Multi-modal Metric Learning Framework for Time Series kNN Classification
    Cao-Tri Do
    Douzal-Chouakria, Ahlame
    Marie, Sylvain
    Rombaut, Michele
    [J]. ADVANCED ANALYSIS AND LEARNING ON TEMPORAL DATA, AALTD 2015, 2016, 9785 : 131 - 143
  • [2] Robust Multi-Scale Multi-modal Image Registration
    Holtzman-Gazit, Michal
    Yavneh, Irad
    [J]. SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION XIX, 2010, 7697
  • [3] Multi-scale Deep Nearest Neighbors
    Chauhan, Abhijeet
    Davoudi, Omid
    Komeili, Majid
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [4] Deep Multi-Modal Metric Learning with Multi-Scale Correlation for Image-Text Retrieval
    Hua, Yan
    Yang, Yingyun
    Du, Jianhe
    [J]. ELECTRONICS, 2020, 9 (03)
  • [5] Multi-Modal Multi-Scale Deep Learning for Large-Scale Image Annotation
    Niu, Yulei
    Lu, Zhiwu
    Wen, Ji-Rong
    Xiang, Tao
    Chang, Shih-Fu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) : 1720 - 1731
  • [6] Multi-modal and multi-scale photo collection summarization
    Shen, Xu
    Tian, Xinmei
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (05) : 2527 - 2541
  • [7] Multi-modal and multi-scale photo collection summarization
    Xu Shen
    Xinmei Tian
    [J]. Multimedia Tools and Applications, 2016, 75 : 2527 - 2541
  • [8] Multi-Modal and Multi-Scale Oral Diadochokinesis Analysis using Deep Learning
    Wang, Yang Yang
    Gaol, Ke
    Hamad, Ali
    McCarthy, Brianna
    Kloepper, Ashley M.
    Lever, Teresa E.
    Bunyak, Filiz
    [J]. 2021 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2021,
  • [9] Multi-Modal and Multi-Scale Oral Diadochokinesis Analysis using Deep Learning
    Department of Electrical Engineering and Computer Science, University of Missouri, Columbia
    MO, United States
    不详
    MO, United States
    [J]. Proc. Appl. Imagery Pattern. Recogn. Workshop, 2021,
  • [10] Multi-scale, multi-modal neural modeling and simulation
    Ishii, Shin
    Diesmann, Markus
    Doya, Kenji
    [J]. NEURAL NETWORKS, 2011, 24 (09) : 917 - 917