Wiki-based Prompts for Enhancing Relation Extraction using Language Models

被引:1
|
作者
Layegh, Amirhossein [1 ]
Payberah, Amir H. [1 ]
Soylu, Ahmet [2 ]
Roman, Dumitru [3 ]
Matskin, Mihhail [1 ]
机构
[1] KTH Royal Inst Technol, Stockholm, Sweden
[2] Oslo Metropolitan Univ, Oslo, Norway
[3] SINTEF AS, Oslo, Norway
关键词
Relation Extraction; Language Models; Prompt Construction; knowledge Integration;
D O I
10.1145/3605098.3635949
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Prompt-tuning and instruction-tuning of language models have exhibited significant results in few-shot Natural Language Processing (NLP) tasks, such as Relation Extraction (RE), which involves identifying relationships between entities within a sentence. However, the effectiveness of these methods relies heavily on the design of the prompts. A compelling question is whether incorporating external knowledge can enhance the language model's understanding of NLP tasks. In this paper, we introduce wiki-based prompt construction that leverages Wikidata as a source of information to craft more informative prompts for both prompt-tuning and instructiontuning of language models in RE. Our experiments show that using wiki-based prompts enhances cutting-edge language models in RE, emphasizing their potential for improving RE tasks. Our code and datasets are available at GitHub (1).
引用
收藏
页码:731 / 740
页数:10
相关论文
共 50 条
  • [41] A 2020 perspective on "Scalable modelling and recommendation using wiki-based crowdsourced repositories:" Fairness, scalability, and real-time recommendation
    Leal, Fatima
    Veloso, Bruno
    Malheiro, Benedita
    Gonzalez-Velez, Horacio
    Carlo Burguillo, Juan
    ELECTRONIC COMMERCE RESEARCH AND APPLICATIONS, 2020, 40
  • [42] Epidemic Information Extraction for Event-Based Surveillance Using Large Language Models
    Consoli, Sergio
    Markov, Peter
    Stilianakis, Nikolaos I.
    Bertolini, Lorenzo
    Gallardo, Antonio Puertas
    Ceresa, Mario
    PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, VOL 1, ICICT 2024, 2024, 1011 : 241 - 252
  • [43] Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Models
    Zhu, Hongyi
    Huang, Jia-Hong
    Rudinac, Stevan
    Kanoulas, Evangelos
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 978 - 987
  • [44] Enhancing Genetic Improvement Mutations Using Large Language Models
    Brownlee, Alexander E.I.
    Callan, James
    Even-Mendoza, Karine
    Geiger, Alina
    Hanna, Carol
    Petke, Justyna
    Sarro, Federica
    Sobania, Dominik
    arXiv, 2023,
  • [45] Bridging the Gap: A Hybrid Approach to Medical Relation Extraction Using Pretrained Language Models and Traditional Machine Learning
    Hassan, Nesma A.
    Seoud, Rania A. Abul
    Salem, Dina A.
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2024, 15 (06) : 723 - 734
  • [46] Enhancing Genetic Improvement Mutations Using Large Language Models
    Brownlee, Alexander E. I.
    Callan, James
    Even-Mendoza, Karine
    Geiger, Alina
    Hanna, Carol
    Petke, Justyna
    Sarro, Federica
    Sobania, Dominik
    SEARCH-BASED SOFTWARE ENGINEERING, SSBSE 2023, 2024, 14415 : 153 - 159
  • [47] Enhancing Dialogue-based Relation Extraction by Speaker and TriggerWords Prediction
    Zhao, Tianyang
    Yan, Zhao
    Cao, Yunbo
    Li, Zhoujun
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 4580 - 4585
  • [48] Approaches based on language models for aspect extraction for sentiment analysis in the Portuguese language
    Neto, José Carlos Ferreira
    Pereira, Denilson Alves
    Barbosa, Bruno Henrique Groenner
    Ferreira, Danton Diego
    Neural Computing and Applications, 2024, 36 (31) : 19353 - 19363
  • [49] Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction
    Chen, Haotian
    Chen, Bingsheng
    Zhou, Xiangdong
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 6418 - 6435
  • [50] A Method of Relation Extraction Using Pre-training Models
    Wang, Yu
    Sun, Yining
    Ma, Zuchang
    Gao, Lisheng
    Xu, Yang
    Wu, Yichen
    2020 13TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2020), 2020, : 176 - 179