Learning Concept Embeddings from Temporal Data

被引:0
|
作者
Meyer, Francois [1 ]
van der Merwe, Brink [1 ]
Coetsee, Dirko [2 ]
机构
[1] Stellenbosch Univ, Comp Sci Div, Stellenbosch, South Africa
[2] Praelexis, Stellenbosch, South Africa
关键词
Deep Learning; Natural Language Processing; Word Embeddings; Temporal Data; Skip-Gram;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Word embedding techniques can be used to learn vector representations of concepts from temporal datasets. Previous attempts to do this amounted to applying word embedding techniques to event sequences. We propose a concept embedding model that extends existing word embedding techniques to take time into account by explicitly modelling the time between concept occurrences. The model is implemented and evaluated using medical temporal data. It is found that incorporating time into the learning algorithm can improve the quality of the resulting embeddings, as measured by an existing methodological framework for evaluating medical concept embeddings.
引用
收藏
页码:1378 / 1402
页数:25
相关论文
共 50 条
  • [41] Learning from streaming data with concept drift and imbalance: an overview
    Hoens, T. Ryan
    Polikar, Robi
    Chawla, Nitesh V.
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2012, 1 (01) : 89 - 101
  • [42] Learning from streaming data with concept drift and imbalance: an overview
    T. Ryan Hoens
    Robi Polikar
    Nitesh V. Chawla
    Progress in Artificial Intelligence, 2012, 1 (1) : 89 - 101
  • [43] Learning temporal probabilistic causal models from longitudinal data
    Riva, A
    Bellazzi, R
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 1996, 8 (03) : 217 - 234
  • [44] Learning from heterogeneous temporal data in electronic health records
    Zhao, Jing
    Papapetrou, Panagiotis
    Asker, Lars
    Bostrom, Henrik
    JOURNAL OF BIOMEDICAL INFORMATICS, 2017, 65 : 105 - 119
  • [45] Learning Word Embeddings from Dependency Relations
    Zhao, Yinggong
    Huang, Shujian
    Dai, Xinyu
    Zhang, Jianbing
    Chen, Jiajun
    PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2014), 2014, : 123 - 127
  • [46] A Robust Genetic Algorithm for Learning Temporal Specifications from Data
    Nenzi, Laura
    Silvetti, Simone
    Bartocci, Ezio
    Bortolussi, Luca
    QUANTITATIVE EVALUATION OF SYSTEMS, QEST 2018, 2018, 11024 : 323 - 338
  • [47] Contrastive Learning of Sentence Embeddings from Scratch
    Zhang, Junlei
    Lan, Zhenzhong
    He, Junxian
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 3916 - 3932
  • [48] Learning Ideological Embeddings from Information Cascades
    Monti, Corrado
    Manco, Giuseppe
    Aslay, Cigdem
    Bonchi, Francesco
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1325 - 1334
  • [49] Learning Triple Embeddings from Knowledge Graphs
    Fionda, Valeria
    Pirro, Giuseppe
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 3874 - 3881
  • [50] LEARNING SPATIAL-TEMPORAL EMBEDDINGS FOR SEQUENTIAL POINT CLOUD FRAME INTERPOLATION
    Zhao, Lili
    Sun, Zhuoqun
    Ren, Lancao
    Yin, Qian
    Yang, Lei
    Guo, Meng
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 810 - 814