Learning Concept Embeddings from Temporal Data

被引:0
|
作者
Meyer, Francois [1 ]
van der Merwe, Brink [1 ]
Coetsee, Dirko [2 ]
机构
[1] Stellenbosch Univ, Comp Sci Div, Stellenbosch, South Africa
[2] Praelexis, Stellenbosch, South Africa
关键词
Deep Learning; Natural Language Processing; Word Embeddings; Temporal Data; Skip-Gram;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Word embedding techniques can be used to learn vector representations of concepts from temporal datasets. Previous attempts to do this amounted to applying word embedding techniques to event sequences. We propose a concept embedding model that extends existing word embedding techniques to take time into account by explicitly modelling the time between concept occurrences. The model is implemented and evaluated using medical temporal data. It is found that incorporating time into the learning algorithm can improve the quality of the resulting embeddings, as measured by an existing methodological framework for evaluating medical concept embeddings.
引用
收藏
页码:1378 / 1402
页数:25
相关论文
共 50 条
  • [31] Learning Concept-Driven Document Embeddings for Medical Information Search
    Gia-Hung Nguyen
    Tamine, Lynda
    Soulier, Laure
    Souf, Nathalie
    ARTIFICIAL INTELLIGENCE IN MEDICINE, AIME 2017, 2017, 10259 : 160 - 170
  • [32] Learning bilingual word embeddings with (almost) no bilingual data
    Artetxe, Mikel
    Labaka, Gorka
    Agirre, Eneko
    PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 451 - 462
  • [33] Deep Learning Embeddings for Data Series Similarity Search
    Wang, Qitong
    Palpanas, Themis
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1708 - 1716
  • [34] LEARNING OSTEOARTHRITIS IMAGING BIOMARKERS USING LAPLACIAN EIGENMAP EMBEDDINGS WITH DATA FROM THE OAI
    Donoghue, C. R.
    Rao, A.
    Bull, A. M. J.
    Rueckert, D.
    2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), 2014, : 1011 - 1014
  • [35] Distilling Knowledge Based on Curriculum Learning for Temporal Knowledge Graph Embeddings
    Zhang, Bin
    Li, Jiayin
    Dai, Yuanfei
    PROCEEDINGS OF THE 33RD ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2024, 2024, : 4248 - 4252
  • [36] Relevant data expansion for learning concept drift from sparsely labeled data
    Widyantoro, DH
    Yen, J
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (03) : 401 - 412
  • [37] Learning Decision Trees from Data Streams with Concept Drift
    Jankowski, Dariusz
    Jackowski, Konrad
    Cyganek, Boguslaw
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE 2016 (ICCS 2016), 2016, 80 : 1682 - 1691
  • [38] Learning Concept Taxonomies from Multi-modal Data
    Zhang, Hao
    Hu, Zhiting
    Deng, Yuntian
    Sachani, Mrinmaya
    Yan, Zhicheng
    Xing, Eric P.
    PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, 2016, : 1791 - 1801
  • [39] Concept Extraction and Prerequisite Relation Learning from Educational Data
    Lu, Weiming
    Zhou, Yangfan
    Yu, Jiale
    Jia, Chenhao
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9678 - 9685
  • [40] Incremental Learning of Concept Drift from Streaming Imbalanced Data
    Ditzler, Gregory
    Polikar, Robi
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (10) : 2283 - 2301