Shift-Invariant Grouped Multi-task Learning for Gaussian Processes

被引:0
|
作者
Wang, Yuyang [1 ]
Khardon, Roni [1 ]
Protopapas, Pavlos [2 ]
机构
[1] Tufts Univ, Medford, MA 02155 USA
[2] Harvard Smithsonian Ctr Astrophys, Cambridge, MA 02138 USA
关键词
GRAVITATIONAL LENSING EXPERIMENT; MACHO PROJECT; STARS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-task learning leverages shared information among data sets to improve the learning performance of individual tasks. The paper applies this framework for data where each task is a phase-shifted periodic time series. In particular, we develop a novel Bayesian nonparametric model capturing a mixture of Gaussian processes where each task is a sum of a group-specific function and a component capturing individual variation, in addition to each task being phase shifted. We develop an efficient em algorithm to learn the parameters of the model. As a special case we obtain the Gaussian mixture model and em algorithm for phased-shifted periodic time series. Experiments in regression, classification and class discovery demonstrate the performance of the proposed model using both synthetic data and real-world time series data from astrophysics. Our methods are particularly useful when the time series are sparsely and non-synchronously sampled.
引用
收藏
页码:418 / 434
页数:17
相关论文
共 50 条
  • [1] Multi-task Causal Learning with Gaussian Processes
    Aglietti, Virginia
    Damoulas, Theodoros
    Alvarez, Mauricio A.
    Gonzalez, Javier
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [2] Hierarchical Gaussian Processes model for multi-task learning
    Li, Ping
    Chen, Songcan
    [J]. PATTERN RECOGNITION, 2018, 74 : 134 - 144
  • [3] Focused Multi-task Learning Using Gaussian Processes
    Leen, Gayle
    Peltonen, Jaakko
    Kaski, Samuel
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT II, 2011, 6912 : 310 - 325
  • [4] Multi-task Learning for Aggregated Data using Gaussian Processes
    Yousefi, Fariba
    Smith, Michael Thomas
    Alvarez, Mauricio A.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [5] Multi-task Sparse Gaussian Processes with Improved Multi-task Sparsity Regularization
    Zhu, Jiang
    Sun, Shiliang
    [J]. PATTERN RECOGNITION (CCPR 2014), PT I, 2014, 483 : 54 - 62
  • [6] Adaptive sampling design for multi-task learning of Gaussian processes in manufacturing
    Mehta, Manan
    Shao, Chenhui
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2021, 61 : 326 - 337
  • [7] Multi-resolution Multi-task Gaussian Processes
    Hamelijnck, Oliver
    Damoulas, Theodoros
    Wang, Kangrui
    Girolami, Mark A.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [8] Heterogeneous multi-task Gaussian Cox processes
    Zhou, Feng
    Kong, Quyu
    Deng, Zhijie
    He, Fengxiang
    Cui, Peng
    Zhu, Jun
    [J]. MACHINE LEARNING, 2023, 112 (12) : 5105 - 5134
  • [9] Heterogeneous multi-task Gaussian Cox processes
    Feng Zhou
    Quyu Kong
    Zhijie Deng
    Fengxiang He
    Peng Cui
    Jun Zhu
    [J]. Machine Learning, 2023, 112 : 5105 - 5134
  • [10] On learning with shift-invariant structures
    Rusu, Cristian
    [J]. DIGITAL SIGNAL PROCESSING, 2020, 99