Graph-Driven Generative Models for Heterogeneous Multi-Task Learning

被引:0
|
作者
Wang, Wenlin [1 ]
Xu, Hongteng [2 ]
Gan, Zhe [3 ]
Li, Bai [1 ]
Wang, Guoyin [1 ]
Chen, Liqun [1 ]
Yang, Qian [1 ]
Wang, Wenqi [4 ]
Carin, Lawrence [1 ]
机构
[1] Duke Univ, Durham, NC 27706 USA
[2] Infinia ML Inc, Durham, NC USA
[3] Microsoft Dynam 365 AI Res, Redmond, WA USA
[4] Facebook Inc, Menlo Pk, CA USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a novel graph-driven generative model, that unifies multiple heterogeneous learning tasks into the same framework. The proposed model is based on the fact that heterogeneous learning tasks, which correspond to different generative processes, often rely on data with a shared graph structure. Accordingly, our model combines a graph convolutional network (GCN) with multiple variational autoencoders, thus embedding the nodes of the graph (i.e., samples for the tasks) in a uniform manner, while specializing their organization and usage to different tasks. With a focus on healthcare applications (tasks), including clinical topic modeling, procedure recommendation and admission-type prediction, we demonstrate that our method successfully leverages information across different tasks, boosting performance in all tasks and outperforming existing state-of-the-art approaches.
引用
收藏
页码:979 / 988
页数:10
相关论文
共 50 条
  • [1] Multi-task heterogeneous graph learning on electronic health records
    Chan, Tsai Hor
    Yin, Guosheng
    Bae, Kyongtae
    Yu, Lequan
    [J]. NEURAL NETWORKS, 2024, 180
  • [2] Multi-task Regularization of Generative Similarity Models
    Cazzanti, Luca
    Feldman, Sergey
    Gupta, Maya R.
    Gabbay, Michael
    [J]. SIMILARITY-BASED PATTERN RECOGNITION: FIRST INTERNATIONAL WORKSHOP, SIMBAD 2011, 2011, 7005 : 90 - 103
  • [3] Multi-task Regularization of Generative Similarity Models
    Cazzanti, Luca
    Feldman, Sergey
    Gupta, Maya R.
    Gabbay, Michael
    [J]. SIMILARITY-BASED PATTERN RECOGNITION, 2011, 7005 : 90 - +
  • [4] Federated Multi-task Graph Learning
    Liu, Yijing
    Han, Dongming
    Zhang, Jianwei
    Zhu, Haiyang
    Xu, Mingliang
    Chen, Wei
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [5] Generative Modeling for Multi-task Visual Learning
    Bao, Zhipeng
    Hebert, Martial
    Wang, Yu-Xiong
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [6] Generative Multi-Task Learning for Text Classification
    Zhao, Wei
    Gao, Hui
    Chen, Shuhui
    Wang, Nan
    [J]. IEEE ACCESS, 2020, 8 : 86380 - 86387
  • [7] Integrating Semantics and Neighborhood Information with Graph-Driven Generative Models for Document Retrieval
    Ou, Zijing
    Su, Qinliang
    Yu, Jianxing
    Liu, Bang
    Wang, Jingwen
    Zhao, Ruihui
    Chen, Changyou
    Zheng, Yefeng
    [J]. 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 2238 - 2249
  • [8] Amalgamating Multi-Task Models with Heterogeneous Architectures
    Thadajarassiri, Jidapa
    Gerych, Walter
    Kong, Xiangnan
    Rundensteiner, Elke
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 14, 2024, : 15346 - 15354
  • [9] Graph-based Multi-task Learning
    Li, Ya
    Tian, Xinmei
    [J]. 2015 IEEE 16TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2015, : 730 - 733
  • [10] Multi-Relational Graph based Heterogeneous Multi-Task Learning in Community Question Answering
    Lin, Zizheng
    Ke, Haowen
    Wong, Ngo-Yin
    Bai, Jiaxin
    Song, Yangqiu
    Zhao, Huan
    Ye, Junpeng
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1038 - 1047