Shift-Invariant Grouped Multi-task Learning for Gaussian Processes

被引:0
|
作者
Wang, Yuyang [1 ]
Khardon, Roni [1 ]
Protopapas, Pavlos [2 ]
机构
[1] Tufts Univ, Medford, MA 02155 USA
[2] Harvard Smithsonian Ctr Astrophys, Cambridge, MA 02138 USA
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT III | 2010年 / 6323卷
关键词
GRAVITATIONAL LENSING EXPERIMENT; MACHO PROJECT; STARS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-task learning leverages shared information among data sets to improve the learning performance of individual tasks. The paper applies this framework for data where each task is a phase-shifted periodic time series. In particular, we develop a novel Bayesian nonparametric model capturing a mixture of Gaussian processes where each task is a sum of a group-specific function and a component capturing individual variation, in addition to each task being phase shifted. We develop an efficient em algorithm to learn the parameters of the model. As a special case we obtain the Gaussian mixture model and em algorithm for phased-shifted periodic time series. Experiments in regression, classification and class discovery demonstrate the performance of the proposed model using both synthetic data and real-world time series data from astrophysics. Our methods are particularly useful when the time series are sparsely and non-synchronously sampled.
引用
收藏
页码:418 / 434
页数:17
相关论文
共 50 条
  • [31] Multi-task gradient descent for multi-task learning
    Bai, Lu
    Ong, Yew-Soon
    He, Tiantian
    Gupta, Abhishek
    MEMETIC COMPUTING, 2020, 12 (04) : 355 - 369
  • [32] Episodic Multi-Task Learning with Heterogeneous Neural Processes
    Shen, Jiayi
    Zhen, Xiantong
    Wang, Qi
    Worring, Marcel
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [33] Deep Multi-task Gaussian Processes for Survival Analysis with Competing Risks
    Alaa, Ahmed M.
    van der Schaar, Mihaela
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [34] Grouped Multi-Task CNN for Facial Attribute Recognition
    Yip, Chitung
    Hu, Haifeng
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 272 - 277
  • [35] Learning Rates of Regularized Regression With Multiple Gaussian Kernels for Multi-Task Learning
    Xu, Yong-Li
    Li, Xiao-Xing
    Chen, Di-Rong
    Li, Han-Xiong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5408 - 5418
  • [36] Aligned Multi-Task Gaussian Process
    Mikheeva, Olga
    Kazlauskaite, Ieva
    Hartshorne, Adam
    Kjellstrom, Hedvig
    Ek, Carl Henrik
    Campbell, Neill D. F.
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [37] Multi-objective Bayesian alloy design using multi-task Gaussian processes
    Khatamsaz, Danial
    Vela, Brent
    Arroyave, Raymundo
    MATERIALS LETTERS, 2023, 351
  • [38] Learning Scale and Shift-Invariant Dictionary for Sparse Representation
    Aritake, Toshimitsu
    Murata, Noboru
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, 2019, 11943 : 472 - 483
  • [39] Multi-Task Learning for Gaussian Graphical Regressions with High Dimensional Covariates
    Zhang, Jingfei
    Li, Yi
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2024,
  • [40] Average sampling and reconstruction of quasi shift-invariant stochastic processes
    Yingchun Jiang
    Haiying Zhang
    Journal of Pseudo-Differential Operators and Applications, 2023, 14