Heterogeneous multi-task Gaussian Cox processes

被引:0
|
作者
Zhou, Feng [1 ,2 ,3 ]
Kong, Quyu [4 ]
Deng, Zhijie [3 ,5 ]
He, Fengxiang [6 ]
Cui, Peng [3 ]
Zhu, Jun [3 ]
机构
[1] Renmin Univ China, Ctr Appl Stat, Beijing, Peoples R China
[2] Renmin Univ China, Sch Stat, Beijing, Peoples R China
[3] Tsinghua Univ, THU Bosch Joint ML Ctr, BNRist Ctr, Dept Comp Sci & Tech, Beijing, Peoples R China
[4] Univ Technol Sydney, Data Sci Inst, Sydney, Australia
[5] Shanghai Jiao Tong Univ, Qing Yuan Res Inst, Shanghai, Peoples R China
[6] JD Com Inc, JD Explore Acad, Beijing, Peoples R China
关键词
Heterogeneous correlation; Multi-task learning; Cox process; Multi-output Gaussian processes; Conditionally conjugate; EFFICIENT INFERENCE; BAYESIAN-INFERENCE; MODELS;
D O I
10.1007/s10994-023-06382-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel extension of multi-task Gaussian Cox processes for modeling multiple heterogeneous correlated tasks jointly, e.g., classification and regression, via multi-output Gaussian processes (MOGP). A MOGP prior over the parameters of the dedicated likelihoods for classification, regression and point process tasks can facilitate sharing of information between heterogeneous tasks, while allowing for nonparametric parameter estimation. To circumvent the non-conjugate Bayesian inference in the MOGP modulated heterogeneous multi-task framework, we employ the data augmentation technique and derive a mean-field approximation to realize closed-form iterative updates for estimating model parameters. We demonstrate the performance and inference on both 1D synthetic data as well as 2D urban data of Vancouver.
引用
收藏
页码:5105 / 5134
页数:30
相关论文
共 50 条
  • [1] Heterogeneous multi-task Gaussian Cox processes
    Feng Zhou
    Quyu Kong
    Zhijie Deng
    Fengxiang He
    Peng Cui
    Jun Zhu
    Machine Learning, 2023, 112 : 5105 - 5134
  • [2] Multi-task Sparse Gaussian Processes with Improved Multi-task Sparsity Regularization
    Zhu, Jiang
    Sun, Shiliang
    PATTERN RECOGNITION (CCPR 2014), PT I, 2014, 483 : 54 - 62
  • [3] Multi-resolution Multi-task Gaussian Processes
    Hamelijnck, Oliver
    Damoulas, Theodoros
    Wang, Kangrui
    Girolami, Mark A.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [4] Multi-task Causal Learning with Gaussian Processes
    Aglietti, Virginia
    Damoulas, Theodoros
    Alvarez, Mauricio A.
    Gonzalez, Javier
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [5] Hierarchical Gaussian Processes model for multi-task learning
    Li, Ping
    Chen, Songcan
    PATTERN RECOGNITION, 2018, 74 : 134 - 144
  • [6] Focused Multi-task Learning Using Gaussian Processes
    Leen, Gayle
    Peltonen, Jaakko
    Kaski, Samuel
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT II, 2011, 6912 : 310 - 325
  • [7] Episodic Multi-Task Learning with Heterogeneous Neural Processes
    Shen, Jiayi
    Zhen, Xiantong
    Wang, Qi
    Worring, Marcel
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [8] Cluster-Specific Predictions with Multi-Task Gaussian Processes
    Leroy, Arthur
    Latouche, Pierre
    Guedj, Benjamin
    Gey, Servane
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [9] Scalable multi-task Gaussian processes with neural embedding of coregionalization
    Liu, Haitao
    Ding, Jiaqi
    Xie, Xinyu
    Jiang, Xiaomo
    Zhao, Yusong
    Wang, Xiaofang
    KNOWLEDGE-BASED SYSTEMS, 2022, 247
  • [10] Multi-task Learning for Aggregated Data using Gaussian Processes
    Yousefi, Fariba
    Smith, Michael Thomas
    Alvarez, Mauricio A.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32