Attention-Based Multi-Task Learning in Pharmacovigilance

被引:0
|
作者
Zhang, Shinan [1 ]
Dev, Shantanu [2 ]
Voyles, Joseph [3 ]
Rao, Anand S. [4 ]
机构
[1] PricewaterhouseCoopers Advisory, Artificial Intelligence Accelerator, New York, NY 10017 USA
[2] PricewaterhouseCoopers Advisory, Artificial Intelligence Accelerator, Chicago, IL USA
[3] PricewaterhouseCoopers Advisory, Artificial Intelligence Accelerator, Louisville, KY USA
[4] PricewaterhouseCoopers Advisory, Artificial Intelligence Accelerator, Boston, MA USA
关键词
machine learning; adverse events; clinical text; multi-task learning; pharmacovigilance; attention-based model;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Pharmacovigilance (PV) is the process of monitoring and assessing adverse events (AEs). Currently, the primary method of analysis in PV is manual inspection by individual case managers. However, this is largely unsustainable due to the increased volume of cases over the past few years. Since AE processing involves several sub-tasks, such as annotation and classification, our paper explores a novel solution to PV. In this paper, we propose a multi-task learning (MTL) model, where the hidden layers are shared, to jointly learn the tasks (Named Entity Recognition (NER), Classification). The results of our paper demonstrate that MTL is able to outperform our baseline classification model and equal the baseline model for annotation/NER.
引用
收藏
页码:2324 / 2328
页数:5
相关论文
共 50 条
  • [1] Attention-based Multi-task Learning for Sensor Analytics
    Chen, Yujing
    Rangwala, Huzefa
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2187 - 2196
  • [2] Multi-Task Reinforcement Learning With Attention-Based Mixture of Experts
    Cheng, Guangran
    Dong, Lu
    Cai, Wenzhe
    Sun, Changyin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3811 - 3818
  • [3] Attention-based LSTM with Multi-task Learning for Distant Speech Recognition
    Zhang, Yu
    Zhang, Pengyuan
    Yan, Yonghong
    [J]. 18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 3857 - 3861
  • [4] ATTENTION-BASED MULTI-TASK LEARNING FOR FINE-GRAINED IMAGE CLASSIFICATION
    Liu, Dichao
    Wang, Yu
    Mase, Kenji
    Kato, Jien
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1499 - 1503
  • [5] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Ren, Lu
    Xu, Bo
    Lin, Hongfei
    Yang, Liang
    [J]. SOFT COMPUTING, 2021, 25 (22) : 14109 - 14118
  • [6] AST-MTL: An Attention-Based Multi-Task Learning Strategy for Traffic Forecasting
    Buroni, Giovanni
    Lebichot, Bertrand
    Bontempi, Gianluca
    [J]. IEEE ACCESS, 2021, 9 : 77359 - 77370
  • [7] Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation
    Chen, Shuai
    Bortsova, Gerda
    Juarez, Antonio Garcia-Uceda
    van Tulder, Gijs
    de Bruijne, Marleen
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 : 457 - 465
  • [8] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Lu Ren
    Bo Xu
    Hongfei Lin
    Liang Yang
    [J]. Soft Computing, 2021, 25 : 14109 - 14118
  • [9] Orthogonal channel attention-based multi-task learning for multi-view facial expression recognition
    Chen, Jingying
    Yang, Lei
    Tan, Lei
    Xu, Ruyi
    [J]. PATTERN RECOGNITION, 2022, 129
  • [10] DAMTRNN: A Delta Attention-Based Multi-task RNN for Intention Recognition
    Chen, Weitong
    Yue, Lin
    Li, Bohan
    Wang, Can
    Sheng, Quan Z.
    [J]. ADVANCED DATA MINING AND APPLICATIONS, ADMA 2019, 2019, 11888 : 373 - 388